[pull] main from mhdzumair:main#268
Merged
Merged
Conversation
Introduce an imdb_dataset_import worker job that streams IMDb TSV datasets into UNLOGGED staging tables and merges into existing media metadata tables, with scheduler wiring, admin status endpoint, and additive migration 0011.
The frontend sent order_by/order_dir but the backend struct only read sort_by/sort_order, so sorting was silently ignored and rows always returned in id DESC order. Added serde aliases so both names are accepted.
Move IMDb import settings into cron_jobs with admin config/run APIs, load stored payloads on manual dispatch, and add a scheduler panel for cron control, live status, and dataset runs.
Rewrite the DMM hashlist worker for Python parity, resolve titles via local IMDB FTS/AKA search and TMDB fallback without cinemeta stubs, and harden startup migrations against orphaned _sqlx_migrations rows.
The Rust port dropped the Python live-search path that fetches metadata
from TMDB/Cinemeta and creates a media row on demand when a Stremio
stream request arrives for an imdb ID not yet in the DB. Without it,
all movie requests from fresh installs returned empty streams (200) and
404 on meta, while series worked because their rows already existed.
- stream.rs: before the early-out for unresolved IDs, call
ensure_media_for_import when live_search_streams is on and the ID is
externally resolvable (tt…, tmdb:…, etc.). On success, update media_id
and the id-cache so the request falls through to the Prowlarr/Jackett
live-scrape step — matching the Python _fetch_missing_media_for_live_search
behaviour.
- metadata.rs: fall through to the Cinemeta fallback when TMDB find/
returns empty results or errors, instead of returning None early. Fixes
titles present on IMDb but missing/mismatched on TMDB.
- background_search.rs: fix lookup_movie/lookup_series_media binding
lowercase string literals ('movie', 'series') against the native
mediatype Postgres enum (labels 'MOVIE', 'SERIES') introduced in b79fccd.
The type error was swallowed by .ok()?, silently no-oping all re-scrape
queue items.
Fixes #679
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot] (v2.0.0-alpha.4)
Can you help keep this open source service alive? 💖 Please sponsor : )