AI Generated Video to Help Flight Director Tell the Story

[mdonahoo]

Is your feature request related to a problem? Please describe.

To help the Flight Director tell the story, or weave in a complicated plot line, they could generate a video message to a station or member of the crew.

Describe the solution you'd like

This video message would be AI generated custom avatars that could represent internal engineers or external alien threats. Has potential for being real-time streamed.

Additional context

Integration with HeyGen for prototype, investigating ElevenLabs and RunwayML and ComfyUI for open-source and paid options for AI-content generation.

And maybe show up as a video player in the station screen.

28e5f9573b8b4ea3bc6eb6a868e593b1.mp4

[alexanderson1993]

Certainly interesting. A few thoughts to consider:

• Though I haven't said it much before, one of the constraints on this project is that it can't rely on an internet connection. Any AI/LLM behavior has to work with local models.
• This could work as a kind of progressive enhancement on top of other features that don't require an internet connection.
• How would this work on a bridge, with a bunch of talking heads showing up on peoples screens? It might get a bit loud and distracting.
• That said, I could see this being more valuable for mission content created ahead of time and displayed on the viewscreen as part of a timeline. But that doesn't require it being built into the core of the program.

I'm not compelled to include this in the Thorium Nova core, and as such will close this issue in a few days unless other members of the community express strong support for this feature.

[mdonahoo]

Well, if that's the case...stay tuned for more ideas using local LLMs and Diffusion models.