# audio-demo

Audio processing demos: WhisperX, Demucs, and TTS technology proofs-of-concept.

## Structure

- `whisperx/` — speech-to-text with word-level alignment and diarization
- `demucs/` — source separation (vocals/instrumentals stem splitting)
- `tts/` — text-to-speech service demos

Each subdirectory has its own README with setup and run instructions.

## Requirements

Some demos are GPU-accelerated and are best run on a CUDA-capable machine (e.g. an RTX 3090).

## Planned: full audio-translation demo

Chain the three demos together on `media-files/` into an end-to-end pipeline:

1. `demucs` — separate the source clip into vocals / instrumental stems
2. `whisperx` — transcribe the isolated vocal stem, then machine-translate the transcript
3. `tts` — clone the original speaker's voice (from the isolated vocal stem) and synthesize
   the translated text in that voice, then remix with the original instrumental stem

All three stages now have a working, if narrow, proof of concept:

- Stem separation (`demucs/README.md`) and transcription (`whisperx/README.md`) run end to end
  on the full sample clip.
- Translation + voice-cloning TTS (`tts/README.md`) works for a single short sentence
  (English → Spanish, cloned onto the isolated narrator voice via MOSS-TTS). Not yet wired up
  to run over the full transcript or to remix with the instrumental stem.