ReactJS Canvas implementation for the studio.
You can choose between one of three workflow creators: Studio, Express, and VidGPT.
You can create an account and signup for a paid-plan/free-trial to send model requests.
A hosted version is available here.
To install:
- Leave the API values as is.
- In the terminal, run:
cp .env.example .env yarn install yarn start - Run the client on port 3000 for Google OAuth to work.
Use the Studio Creator to create and edit movie, narrative, and music videos. You can also create and edit images.
Define a theme to constrain the visual style of your story.
Create scenes with the "Add Scenes" button on the left toolbar. Drag to re-arrange scenes and click to change duration or remove scenes.
Use the assistant for brainstorming or refining ideas.
Generate images standalone or as starting frame images for scenes.
| Name | Key | isExpressModel |
|---|---|---|
| Flux-1.1 Pro | FLUX1.1PRO | true |
| Google Imagen3 | IMAGEN3 | true |
| Dall-E 3 | DALLE3 | - |
| Flux-1 Pro | FLUX1PRO | - |
| Flux 1.1 Ultra | FLUX1.1ULTRA | - |
| Flux-1 Dev | FLUX1DEV | - |
| Recraft V3 | RECRAFTV3 | - |
| Stable Diffusion V3.5 | SDV3.5 | - |
| Nvidia Sana | SANA | - |
| Recraft 20B | RECRAFT20B | - |
| Lumalabs Photon | PHOTON | - |
| Lumalabs Photon Flash | PHOTONFLASH | - |
| Google Imagen3 Flash | IMAGEN3FLASH | - |
Create generative videos via text-to-video or image-to-video workflows. These base videos can be further lip-synced or aligned with sound effects.
| Name | Key | isExpressModel | isTransitionModel |
|---|---|---|---|
| Runway Gen-3 | RUNWAYML | true | true |
| Kling 1.6 Pro | KLINGIMGTOVIDPRO | true | - |
| Luma Ray2 | LUMA | true | true |
| SD Video | SDVIDEO | - | - |
| Hailuo Minimax O1-Live | HAILUO | - | - |
| Haiper 2.0 | HAIPER2.0 | - | - |
Create subtitled speech, sound effects, or backing music from the Audio tab in the right toolbar.
See here for a list of supported TTS speakers.
- Add Shapes and Text
- Canvas Animations and Image Editing
- Add/Remove/Stack Layers
- Add/Remove/Re-align Audio (Music/Speech/Sound Effects) Layers
- Add Lip-Sync Video-to-Video Flow
- Add Sound-Effect Video-to-Video Flow
- Export Frame Image
- Export Session Video
- Manage Multiple Projects
- Audio/Video/Image Library to Re-use/Export Previously Generated Assets
A one-shot narrative video creation pipeline.
Edit in Studio for post-processing or to add/remove scenes.
A one-shot, full-feature film creation pipeline.
Edit in Studio for post-processing or to add/remove scenes.
Documentation is available here.
(Listed above)
| Name | Key | editType |
|---|---|---|
| Flux-1 Pro Fill | FLUX1PROFILL | inpaint |
| Flux-1.1 Pro Ultra Redux | FLUX1.1PROULTRAREDUX | prompt |
| Flux-1.1 Pro Redux | FLUX1.1PROREDUX | prompt |
| Model |
|---|
| GPT4O |
| GPTO1 |
| GPTO3MINI |
| Model |
|---|
| GPT O3 Mini (H) |
| GPT 4O |
| GPT O1 |
| Model |
|---|
| OPENAI |
| PLAYAI |
| ELEVENLABS |
This list is subject to updates as more models are added (or removed).
Contributions and pull requests are welcome.
For questions or suggestions, join the Discord.
Check out the Gallery for inspiration, and follow on X or Threads for news and updates.