Media Universe S3 Infra
Release 1.9.0 – Media Universe
This release introduces the infrastructure required for full migration to S3 storage and launches the Media Universe — an extension of our tweet model and validation system with native support for tweet media.
🚧 Infrastructure (S3 Auth, Signatures, Delay)
This release sets up the core S3 upload mechanism using presigned POST policies authenticated with Bittensor commitments and Keypair signatures.
Uploads are paused until after Easter to allow time for testing.
We will begin dual-storage (S3 + HF) temporarily and fully migrate after testing.
Keypair signing integration will be finalized before uploads resume, securing all interactions.
:camera_with_flash: Media Universe: Native Support for Tweet Media
We’re launching media validation in tweets to support richer content comparison and enable future CV-based models.
- Added Media Field to XContent
media: Optional[List[str]] added to the content schema
Uses exclude_none=True for full backward compatibility
- Introduced MEDIA_REQUIRED_DATE
New constant MEDIA_REQUIRED_DATE = 2025-05-15
Media validation only applies to tweets after this date
- Scraper Upgrades
Updated ApiDojoTwitterScraper and MicroworldsTwitterScraper to extract media_urls
Validators now extract and store media for comparison
- Validation Logic
validate_tweet_content() now checks:
If validator has media, miner must too
If both have media, media count must match
Older tweets skip media validation
- Tests Added
Media extraction tests
Media validation tests
✅ How This Works With Existing Data
No migration required
Optional field means old records still load fine
Validation is gradual, with enforcement starting May 15
We recommend miners start integrating media support immediately.
Media Universe is live.
S3 infrastructure is ready.
Uploads enabled after Easter.