Gemini Omni Video
Generates and edits short videos conversationally with Gemini Omni Flash.
Install
npx skills add calesthio/OpenMontage --skill gemini-omni -g -a claude-code -y- Repository
- calesthio/OpenMontage74.3k
- Category
- Media
- Updated
- 7d ago
- License
- AGPL-3.0
- Context cost
- Mediumabout 2,286 tokens
- Runs scripts
- No, instructions only
What it does
Generate and conversationally edit short videos with stable Google Gemini Omni Flash (`gemini-omni-1.1-flash`). Use when: (1) iterating on a clip with natural-language edits instead of regenerating ("make the phone invisible, keep everything else the same"), (2) generating 3-10s 720p clips with synthesized audio, rendered on-screen text, or timecoded beats, (3) binding reference images to roles with <FIRST_FRAME>/<IMAGE_REF_N> prompt tags, (4) editing an existing uploaded video. Accessed via the `gemini_omni_video` tool using the project's GEMINI_API_KEY/GOOGLE_API_KEY, the same key as Imagen and Google TTS.
Gemini Omni Flash (Google DeepMind)
Gemini Omni is Google DeepMind's video generation and editing model family. The OpenMontage direct adapter uses the generally available Gemini Omni 1.1 Flash model (gemini-omni-1.1-flash) through the Gemini Interactions API. Its implemented baseline generates 3, 10 second clips at 720p/24fps with synthesized audio. Its differentiator in the OpenMontage fleet is stateful conversational editing: each stored generation returns an interaction_id, and a follow-up call with previous_interaction_id edits that video in place, no other wrapped provider can refine a clip without regenerating it.
OpenMontage wraps it as gemini_omni_video (native Gemini API, no gateway). It shares GOOGLE_API_KEY/GEMINI_API_KEY with google_imagen and google_tts, one key, three capabilities. Paid tier only: ~$0.10 per second of output video (exactly 5,792 output tokens/sec at $17.50/1M, before input and any text/thought output).
Other documented routes are available when the direct Google key is not the chosen provider:
| Route | OpenMontage call | Important limitation |
|---|---|---|
| fal.ai | gemini_omni_fal | T2V, I2V, reference video, and edit endpoints; no Google interaction ID is returned |
| Runway | runway_video, model: "gemini_omni_flash" | T2V/I2V/V2V; video edits accept up to five image references |
| ComfyUI Partner Node | Not a stable 1.1 fallback in this adapter | The existing GeminiVideoOmni mapping targets the legacy preview node; migrate it separately to GeminiVideoOmniV2 before claiming Omni 1.1 support |
Use the direct gemini_omni_video route for stateful conversational editing.
Gateway routes return ordinary provider tasks and cannot preserve Google's
previous_interaction_id workflow. The fal edit endpoint can still be iterated
by feeding each output video URL into the next edit call.
