steve-adminandClaude Sonnet 5
f780fbda01
Speed editing was a silent no-op - AuK needs --gen_seconds or it just preserves the input duration (vendor/AuK/docs/COOKBOOK.md 3.2). Fixed by computing the target from the current reference duration / speed factor, with a UI warning that longer references risk a memory-swap stall on this box (reproduced building a character voice: a 27s target hung 20+ minutes swapping with 0%% GPU use, a 12s source completed in seconds). Added Whisper content verification (faster-whisper, small/CPU/int8) after every AuK edit and MOSS generation. Motivated by a real incident building the-service-station cast: a chained AuK edit leaked fragments of its own instruction text into a character reference, undetected through a full listen-and-approve round because nothing had transcribed the reference itself, only generated lines. History is now per-instruction rather than per-click, so Undo is granular and a save action can derive a sensibly-scoped generation_recipe. New Characters tab: browses the-service-station repo's CHARACTER.md cards (name/role/status/reference audio/emotion_library), lets you create a new character (writes a fresh CHARACTER.md, always status: draft) or generate an emotion candidate for an existing one (writes to voices/<name>/emotion-cache/<emotion>.wav, same path the automated pipeline's own fallback uses). Approving anything stays a manual step - this tab creates candidates for a human to listen to and promote, it never self-approves. Co-Authored-By: Claude Sonnet 5 <[email protected]> Claude-Session: https://claude.ai/code/session_01Y1oQ4h4WE4R9KRvMQLr5Ey
audio-demo
Audio processing demos: WhisperX, Demucs, and TTS technology proofs-of-concept.
Structure
whisperx/— speech-to-text with word-level alignment and diarizationdemucs/— source separation (vocals/instrumentals stem splitting)tts/— text-to-speech service demos (voice cloning via MOSS-TTS)auk/— voice editing demos (emotion/pitch/speed/content editing on existing recordings, as opposed totts/'s clone-and-generate approach)webui/— interactive pipeline studio chaining demucs -> AuK -> MOSS-TTS with previews
Each subdirectory has its own README with setup and run instructions.
Requirements
Some demos are GPU-accelerated and are best run on a CUDA-capable machine (e.g. an RTX 3090).
Planned: full audio-translation demo
Chain the three demos together on media-files/ into an end-to-end pipeline:
demucs— separate the source clip into vocals / instrumental stemswhisperx— transcribe the isolated vocal stem, then machine-translate the transcripttts— clone the original speaker's voice (from the isolated vocal stem) and synthesize the translated text in that voice, then remix with the original instrumental stem
Stem separation and transcription are already working end to end (see demucs/README.md and
whisperx/README.md); translation and voice-cloning TTS are not yet implemented.