Commit eef1ce5
committed
Add video generation infrastructure + LTX Video export
Shared infrastructure:
- CoreAIVideoPipeline library: VideoPipeline protocol, VideoConfiguration,
VideoGenerationResult, VideoProgress with phase tracking
- VideoWriter: MP4 (AVAssetWriter/HEVC), GIF (ImageIO), PNG frame sequence
- video-runner CLI skeleton with ArgumentParser
LTX Video Python export:
- LTXVideoTransformerWrapper with pre-computed 3D RoPE (same pattern as Flux2)
- LTXVideoTextEncoderWrapper (T5), VAE encoder/decoder 3D wrappers
- compute_ltx_video_rope() for 3-axis temporal+spatial position embeddings
- Registry preset, metadata entry, component specs
LTX Video (~2B params, Apache 2.0) uses 32x spatial + 8x temporal VAE
compression, producing only ~1024 tokens for a 5-second 512x512 video.1 parent aa3bbf6 commit eef1ce5
10 files changed
Lines changed: 808 additions & 2 deletions
File tree
- python/src/coreai_models
- diffusion
- export
- swift/Sources
- CoreAIVideoPipeline
- Output
- Pipelines
- Tools/video-runner
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
39 | 39 | | |
40 | 40 | | |
41 | 41 | | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
42 | 48 | | |
43 | 49 | | |
44 | 50 | | |
| |||
115 | 121 | | |
116 | 122 | | |
117 | 123 | | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
118 | 137 | | |
119 | 138 | | |
120 | 139 | | |
| |||
175 | 194 | | |
176 | 195 | | |
177 | 196 | | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
178 | 209 | | |
179 | 210 | | |
180 | 211 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
32 | 32 | | |
33 | 33 | | |
34 | 34 | | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
35 | 45 | | |
36 | 46 | | |
37 | 47 | | |
| |||
362 | 372 | | |
363 | 373 | | |
364 | 374 | | |
| 375 | + | |
| 376 | + | |
| 377 | + | |
| 378 | + | |
| 379 | + | |
| 380 | + | |
| 381 | + | |
| 382 | + | |
| 383 | + | |
| 384 | + | |
| 385 | + | |
| 386 | + | |
| 387 | + | |
| 388 | + | |
| 389 | + | |
| 390 | + | |
| 391 | + | |
| 392 | + | |
| 393 | + | |
| 394 | + | |
| 395 | + | |
| 396 | + | |
| 397 | + | |
| 398 | + | |
| 399 | + | |
| 400 | + | |
| 401 | + | |
| 402 | + | |
| 403 | + | |
| 404 | + | |
| 405 | + | |
| 406 | + | |
| 407 | + | |
| 408 | + | |
| 409 | + | |
| 410 | + | |
| 411 | + | |
| 412 | + | |
| 413 | + | |
| 414 | + | |
| 415 | + | |
| 416 | + | |
| 417 | + | |
365 | 418 | | |
366 | 419 | | |
367 | 420 | | |
| |||
408 | 461 | | |
409 | 462 | | |
410 | 463 | | |
411 | | - | |
| 464 | + | |
412 | 465 | | |
413 | 466 | | |
414 | 467 | | |
415 | 468 | | |
416 | 469 | | |
| 470 | + | |
| 471 | + | |
417 | 472 | | |
418 | 473 | | |
419 | 474 | | |
| |||
423 | 478 | | |
424 | 479 | | |
425 | 480 | | |
| 481 | + | |
| 482 | + | |
426 | 483 | | |
0 commit comments