Commit full-length compressed exports of both demucs stems

vocals.mp3 (narrator only) and no_vocals.mp3 (background/instrumental only), 128kbps MP3, so both are viewable/playable directly in Gitea without needing local playback or GPU-box access. Co-Authored-By: Claude Sonnet 5 <[email protected]> Claude-Session: https://claude.ai/code/session_01Y1oQ4h4WE4R9KRvMQLr5Ey
Add demucs stem-separation demo; sketch audio-translation pipeline
2026-09-12 17:44:00 +00:00 · 2026-09-12 16:56:25 +00:00 · 2026-09-12 16:55:49 +00:00
7 changed files with 47 additions and 0 deletions
@@ -25,3 +25,11 @@ outputs/
 .DS_Store
 .idea/
 .vscode/
+
+# Full-size source video — keep locally, commit only compressed derivatives
+media-files/video/*.mp4
+!media-files/video/*-480p.mp4
+
+# Compressed exports of demucs stems — keep committed for review without
+# local playback (the raw separated/*.wav stems stay local, per *.wav above)
+!demucs/*.mp3
@@ -13,3 +13,15 @@ Each subdirectory has its own README with setup and run instructions.
 ## Requirements

 Some demos are GPU-accelerated and are best run on a CUDA-capable machine (e.g. an RTX 3090).
+
+## Planned: full audio-translation demo
+
+Chain the three demos together on `media-files/` into an end-to-end pipeline:
+
+1. `demucs` — separate the source clip into vocals / instrumental stems
+2. `whisperx` — transcribe the isolated vocal stem, then machine-translate the transcript
+3. `tts` — clone the original speaker's voice (from the isolated vocal stem) and synthesize
+   the translated text in that voice, then remix with the original instrumental stem
+
+Stem separation and transcription are already working end to end (see `demucs/README.md` and
+`whisperx/README.md`); translation and voice-cloning TTS are not yet implemented.
@@ -1,3 +1,30 @@
 # demucs

 Source separation demos using [Demucs](https://github.com/facebookresearch/demucs) — splitting audio into stems (vocals, drums, bass, other).
+
+## Demo run
+
+Ran two-stem separation (vocals vs. everything else) on an RTX 3090 against
+`media-files/audio/service-mbrs-ntscrm-01840194-01840194.m4a`:
+
+```
+python3 -m demucs --two-stems=vocals -n htdemucs \
+  -o separated \
+  ../media-files/audio/service-mbrs-ntscrm-01840194-01840194.m4a
+```
+
+Took ~12s for 11 minutes of audio. Outputs `vocals.wav` and `no_vocals.wav` (44.1kHz stereo PCM,
+duration matches source) under `separated/htdemucs/<track-name>/` — gitignored, left on the GPU
+box at `/root/projects/audio-demo/repo/demucs/separated/`.
+
+Full-length MP3 versions (128kbps, ~10MB each) are committed as `vocals.mp3` and
+`no_vocals.mp3` in this directory so both stems are reviewable directly from Gitea without
+needing local playback or GPU-box access.
+
+**Known gotcha:** demucs 4.1.0's package metadata doesn't declare `numpy` as a dependency even
+though `demucs/transformer.py` imports it directly — `pip install demucs` alone leaves the env
+broken (`ModuleNotFoundError: No module named 'numpy'` at runtime). Install `numpy` explicitly
+alongside it.
+
+The isolated `vocals.wav` is intended as the clean reference/source audio for a voice-cloning TTS
+step (see top-level README for the planned audio-translation pipeline).