πΊ Watch the Vox AI Motion Graphics Generator in action β
- β Fragmented workflow β separate tools for scripting, image gen, animation, voice-over, music, and captions
- β No narrative structure β raw text-to-video models don't understand story arcs, hooks, or pacing
- β Inconsistent look β the collage aesthetic drifts from shot to shot
- β Hours of manual editing β stitching, ducking music, and burning captions by hand
π¬ Screenwriter, Collage Artist, Animator, and Editor β all in one automated pipeline.
Type one topic. The agent writes the story beats, renders each beat as a torn-paper collage poster, animates it, adds a narrator voice-over, music, and burned-in captions β then stitches everything into a finished final.mp4. You stay in control with just two approval gates: the story beat map and the visual theme.
WhatsApp.Video.2026-07-15.at.7.05.14.PM.mp4
One topic in, a fully narrated & captioned Vox-style collage video out. (download the demo)
"Make me a 15-second Vox-style collage video on the history of coffee." β a styled
final.mp4, fully narrated and captioned.
Below are end-to-end videos generated using the pipeline:
final.mp4
βΆ "History of Coffee (Ethiopia 850 AD)" Β· 5s (B-roll Film)
final.mp4
βΆ "Cold Brew Product Ad" Β· 5s (C-roll Film)
| Mode | Film Title | Topic / Subject | Playable Video Link | Keyframe Poster | Motion Model | Narration Voice |
|---|---|---|---|---|---|---|
| B-roll | β History of Coffee | Ethiopia 850 AD | Play Video (out/demo/final.mp4) |
out/demo/keyframes/kf_1a.jpg |
veo3.1-image-to-video |
MiniMax TTS (Q19bea09caa6IRAeW7) |
| C-roll | πΎ Cold Brew Product Ad | Artisanal Cold Brew Bottle | Play Video (out/demo-croll/final.mp4) |
out/demo-croll/keyframes/kf_1.jpg |
veo3.1-image-to-video |
MiniMax TTS (Q19bea09caa6IRAeW7) |
π¬ Generated Assets Summary:
- β B-roll (History of Coffee):
- πΉ Video: Play Video (
out/demo/final.mp4) | πΌοΈ Poster:out/demo/keyframes/kf_1a.jpg| πΉ Clip:out/demo/clips/clip_1a.mp4| ποΈ Voice:out/demo/audio/narr_1.mp3| π΅ BGM:out/demo/audio/bgm.mp3- πΎ C-roll (Cold Brew Product Anchor):
- πΉ Video: Play Video (
out/demo-croll/final.mp4) | πΈ Anchor Photo:out/demo-croll/anchor_photo.jpg| πΌοΈ Poster:out/demo-croll/keyframes/kf_1.jpg| πΉ Clip:out/demo-croll/clips/clip_1.mp4| ποΈ Voice:out/demo-croll/audio/narr_1.mp3| π΅ BGM:out/demo-croll/audio/bgm.mp3
- β¨ Key Features
- π¨ The Look
- π How It Works
- π§© Models
- π Quick Start
- π οΈ Project Structure
- π Related Projects
- 3 Input Modalities (A-roll, B-roll, C-roll):
- B-roll (Topic β Film) β a single one-line prompt produces a complete, captioned, narrated video
- A-roll (Talking-Head Video β Collage) β segment a presenter video with ASR (
openai-whisper) and re-style into paper-collage while keeping real face, gestures, and lip-sync - C-roll (Single Photo / Product β Anchored Collage) β cut out a selfie or product shot as a photographic sticker and build animated collage posters around it
- Authentic Vox collage aesthetic β torn paper, cutouts, tape, halftone dots, newspaper clippings, bold flat color, big headlines
- Story-first β picks a narrative arc (timeline, problem-agitate-solution, how-it-worksβ¦) and writes a hook-led beat map before generating anything
- Style bake-off β renders the same beat in 3β4 themes so you pick the look before committing
- Living-poster motion β animates each collage keyframe into dynamic motion with Google Veo 3.1
- Voice + music + captions β narration (TTS or voice cloning), background music ducked under the voice, and burned-in captions, all automated
- Two human gates, everything else automated β approve the beat map, pick the theme; the pipeline handles the rest
- Agent-native β a self-contained skill any coding agent (Claude Code, Codex, Antigravity, β¦) can read and run
- One API key + ffmpeg β no cluster of accounts to wire up
The aesthetic is the modern editorial paper-collage popularized by Vox explainers and creators like Stav Zilber and rom1trs: hand-cut paper cutouts, torn edges, tape, halftone dots, newspaper clippings, bold flat colors per beat, and big cutout headlines β brought to life with dynamic motion, a narrator voice-over, music, and burned-in captions.
The collage look is born in the image step (each beat is a finished collage poster), and the motion is added after β so the DNA of the style is locked in before anything moves.
A single topic, video, or photo flows through the pipeline driven by beats.json under out/<project>/:
topic / video / photo
β
ββ 1. Beat Map Pick a narrative arc β write beats.json βββ GATE 1: approve the beat map
ββ 2. Style Bake-Off Render the same beat in 3β4 themes βββ GATE 2: pick the look
ββ 3. Keyframes One collage poster per beat (nano-banana-2 / flux-dev)
ββ 4. Motion Animate each poster into a clip (veo3.1-image-to-video)
ββ 5. Voice & Music Narration (minimax-speech-2.6) + BGM (suno-create-music)
ββ 6. Assemble Stitch clips, duck music, burn captions (ffmpeg)
ββ final.mp4
- B-roll (Topic β Film): Topic in β script β keyframe posters β Veo 3.1 motion β TTS narration + Suno music β
final.mp4. - A-roll (Talking-Head β Collage): Presenter video in β Whisper ASR beat segmentation β video-edit restyling β audio remuxing β
final.mp4. - C-roll (Photo / Product β Collage): Product photo in β photographic sticker cutout β anchored collage posters β Veo 3.1 motion β cloned voice β
final.mp4.
| Pipeline Job | Model Endpoint |
|---|---|
| Keyframes / Collage Posters | nano-banana-2 / flux-dev |
| Motion / Animation | veo3.1-image-to-video / veo3.1-fast-image-to-video / runway-image-to-video |
| Re-style Talking-Head (A-roll) | gemini-omni-video-edit / veo3.1-image-to-video |
| Anchor Photo in Collage (C-roll) | nano-banana-2 / flux-dev |
| Narration (TTS) | minimax-speech-2.6-turbo |
| Voice Cloning (C-roll) | minimax-voice-clone |
| Background Music | suno-create-music |
| Audio Transcription (A-roll ASR) | openai-whisper |
| Background Removal | remove-background |
1. Install local dependencies
- ffmpeg + ffprobe (
brew install ffmpegon macOS /choco install ffmpegon Windows) - Python 3 with Pillow (
pip install pillow)
2. Configure environment keys
export MUAPI_API_KEY="your-api-key" # image / video / voice / music models β key from muapi.ai
export OPENAI_API_KEY="your-openai-key" # story planning & ASR3. Run Pipeline via Agent or CLI:
Ask your coding agent:
"Make me a 15-second Vox-style collage video introducing the history of coffee."
Or run CLI scripts manually:
python scripts/style_bakeoff.py out/my-topic american-retro,swiss-modern,punk-zine
python scripts/keyframes.py out/my-topic
python scripts/clips.py out/my-topic
python scripts/audio.py out/my-topic
python scripts/assemble.py out/my-topicpython scripts/asr_beats.py out/my-aroll source_presentation.mp4
python scripts/aroll_clips.py out/my-aroll
python scripts/aroll_assemble.py out/my-arollpython scripts/croll_keyframes.py out/my-croll
python scripts/clips.py out/my-croll
python scripts/audio.py out/my-croll
python scripts/assemble.py out/my-croll.
βββ SKILL.md # full agent workflow + approval gates
βββ AGENTS.md # entry point for coding agents (Claude Code, Codex, Antigravity)
βββ README.zh.md # Chinese documentation
βββ scripts/ # one script per pipeline stage
β βββ muapi_client.py # MuAPI client wrapper
β βββ provider.py # task queue & status polling
β βββ style_bakeoff.py # multi-theme style candidates
β βββ keyframes.py # B-roll collage poster generator
β βββ clips.py # B-roll video animator (Veo 3.1)
β βββ audio.py # TTS narration & Suno music generator
β βββ text_overlay.py # subtitle captions & watermark generator
β βββ assemble.py # ffmpeg video assembly, ducking & composition
β βββ asr_beats.py # A-roll Whisper ASR beat cutter
β βββ aroll_clips.py # A-roll talking-head video restyler
β βββ aroll_assemble.py # A-roll clip & audio remuxer
β βββ croll_keyframes.py # C-roll photo sticker anchor generator
βββ references/ # prompt guide, beat/story library, voices
βββ examples/ # sample beats.json
This is an agent skill β Claude Code auto-loads it from SKILL.md; Codex and other agents follow SKILL.md via AGENTS.md. Just ask for a "vox video" or a "collage video."
- Open-AI-Micro-Drama-Generator β agentic AI micro-drama video generator
- AI-B-roll β auto-generate AI b-roll for your videos
- Text-To-Video-AI β generate full videos from text
- AI-Youtube-Shorts-Generator β auto-clip long videos into viral vertical shorts
- awesome-ai-video-models β compare AI video models by API, price & speed
β Star this repo if it helped you β and explore 50+ more open-source AI apps β