Skip to content

Add GenMedia Live - real-time multimodal creation with Gemini Live, Gemini Nano Banana and Veo#2594

Merged
WafaeBakkali merged 6 commits into
GoogleCloudPlatform:mainfrom
WafaeBakkali:add-genmedia-live
Jan 27, 2026
Merged

Add GenMedia Live - real-time multimodal creation with Gemini Live, Gemini Nano Banana and Veo#2594
WafaeBakkali merged 6 commits into
GoogleCloudPlatform:mainfrom
WafaeBakkali:add-genmedia-live

Conversation

@WafaeBakkali

Copy link
Copy Markdown
Member

Summary

This PR adds GenMedia Live, a sample app demonstrating real-time multimodal creation by extending Gemini Live capabilities to image and video generation through function calling.

What it does

GenMedia Live combines Gemini Live's real-time streaming with:

  • Gemini 3 Pro Image for image generation and editing
  • Veo for video generation
  • ffmpeg for frame extraction and video combining

User can use natural voice to;

  • Generate images from descriptions or edit existing ones
  • Create videos from text prompts or animate images
  • Create short movies by combining multiple video clips
  • Ask questions about what they show on camera or upload
  • Extract frames from videos for further editing

Description

Thank you for opening a Pull Request!
Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Follow the CONTRIBUTING Guide.
  • Ensure the tests and linter pass (Run nox -s format from the repository root to format).
  • If you are creating a new notebook/sample:
    • You are listed as the author in your notebook or README file.
    • Your account is listed in CODEOWNERS for the file(s).

Fixes #<issue_number_goes_here> 🦕

@WafaeBakkali WafaeBakkali requested a review from a team as a code owner January 25, 2026 13:00
Comment thread vision/sample-apps/genmedia-live/README.md Outdated
Comment thread vision/sample-apps/genmedia-live/README.md Outdated
Comment thread vision/sample-apps/genmedia-live/app.py Outdated
@WafaeBakkali WafaeBakkali merged commit 4fff162 into GoogleCloudPlatform:main Jan 27, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants