Voice Skill - Speech and Local Audio Processing

Scheduling

Goal

Generate and transcribe speech through a local speech backend (the Voicebox app, or VoiceStudio per voice.backend), and process existing audio with local media tools. The backend owns synthesis engines and profiles; FFmpeg owns file conversion, duration adjustment, and loudness processing.

Intent signature

• User asks to generate speech, narrate text, produce a voiceover, create an mp3 or wav from text.
• User wants an audio file transcribed into text, meeting notes, or a transcript.
• User asks for a voice notification when a long task completes or a workflow step is blocked.
• Another skill needs local audio generation infrastructure.
• User needs existing speech fitted to a time window, resampled, converted, or loudness-normalized.

When to use

• Generating short notification audio for agent task completion or blockers.
• Producing voiceover, narration, or audio assets (mp3 or wav) for apps and content.
• Transcribing local audio files (mp3, wav, m4a, webm, flac) to Markdown.
• Comparing voice profiles by re-running the same text against different profile ids.
• Processing an existing audio asset, including speech used in an oma-video dubbing job.

When NOT to use

• Cloud TTS or high-fidelity multilingual cloud voices -> out of scope; future multi-vendor extension.
• Real-time microphone dictation loop in the terminal -> use Voicebox app's built-in hotkey dictation.
• Voice cloning sample upload and profile creation -> done in the Voicebox desktop app UI.
• Video editing and audio/video placement -> oma-video; music and sound design are out of scope.
• Stories Editor multi-voice timeline composition -> use the Voicebox app UI.