steve-adminandClaude Sonnet 5
5f97f983fe
Type any text and hear the selected character say it, in their base voice or any approved/pending emotion. Generalizes two things at once: testing an emotion candidate with real dialogue instead of the fixed "Testing the X emotion for Y" line, and just answering "how would they say this?" for the approved voice directly from the browser without switching to the Pipeline Studio tab. list_character_voices() enumerates every voice available for a character (base + approved emotion_library entries + pending emotion-cache candidates) - the voice dropdown refreshes whenever the character selection changes, and also right after generating a new emotion candidate so it is immediately pickable without reselecting the character. Every clone gets the same Whisper transcript check as everywhere else in this app. Co-Authored-By: Claude Sonnet 5 <[email protected]> Claude-Session: https://claude.ai/code/session_01Y1oQ4h4WE4R9KRvMQLr5Ey
audio-demo
Audio processing demos: WhisperX, Demucs, and TTS technology proofs-of-concept.
Structure
whisperx/— speech-to-text with word-level alignment and diarizationdemucs/— source separation (vocals/instrumentals stem splitting)tts/— text-to-speech service demos (voice cloning via MOSS-TTS)auk/— voice editing demos (emotion/pitch/speed/content editing on existing recordings, as opposed totts/'s clone-and-generate approach)webui/— interactive pipeline studio chaining demucs -> AuK -> MOSS-TTS with previews
Each subdirectory has its own README with setup and run instructions.
Requirements
Some demos are GPU-accelerated and are best run on a CUDA-capable machine (e.g. an RTX 3090).
Planned: full audio-translation demo
Chain the three demos together on media-files/ into an end-to-end pipeline:
demucs— separate the source clip into vocals / instrumental stemswhisperx— transcribe the isolated vocal stem, then machine-translate the transcripttts— clone the original speaker's voice (from the isolated vocal stem) and synthesize the translated text in that voice, then remix with the original instrumental stem
Stem separation and transcription are already working end to end (see demucs/README.md and
whisperx/README.md); translation and voice-cloning TTS are not yet implemented.