feat: add UGC-CARE discontinued list backends (#1019)

* feat: add UGC-CARE discontinued list backends [AI-assisted]

Add dedicated sync-backed sources and cached backends for UGC-CARE cloned Group I, cloned Group II, and delisted Group II lists.

Update backend/source registration, config URL defaults, output formatter list presence, and docs (README + API/config references) so the new backends are discoverable and usable.

Include unit tests for source parsing, registration, and backend metadata to reduce regression risk for future list-format changes.

* feat: add included-side UGC clone backends [AI-assisted]

Add legitimate-list backends for left-side included journals from UGC clone correction pages (Group I and Group II) to prevent ISSN-only false impressions.

Fix clone parser side mapping so cloned records use cloned-side ISSN/eISSN instead of original-side identifiers.

Extend tests and documentation to cover both included and cloned sides of UGC clone pages.

* fix: satisfy mypy title typing in UGC parser [AI-assisted]

Guard clone-side title extraction with explicit type narrowing before calling _build_entry so mypy can prove non-optional str arguments.

This preserves runtime behavior while eliminating strict type-check failures in ugc_care source parsing.

---------

Co-authored-by: florath-ai-assistant[bot] <Andreas.Florath@telekom.de>

Author: coding-ai-assistant[bot]

README.md

@@ -63,14 +63,18 @@ aletheia-probe journal --format json "Nature Reviews Drug Discovery"
 
 **Output**: Combines data from multiple authoritative sources and advanced pattern analysis to provide confidence-scored assessments of journal legitimacy.
 
-**Note**: The first sync downloads and processes data from multiple sources (DOAJ, Beall's List, etc.), which takes a few minutes. After that, queries typically complete in under 5 seconds.
+**Note**: The first sync downloads and processes data from multiple sources (DOAJ, Beall's List, UGC-CARE discontinued lists, etc.), which takes a few minutes. After that, queries typically complete in under 5 seconds.
 
 ## Data Sources
 
 This tool acts as a **data aggregator** - it doesn't provide data itself, but combines information from multiple authoritative sources:
 
 - **DOAJ** - Directory of Open Access Journals
 - **Beall's List** - Historical predatory journal archives
+- **UGC-CARE Cloned (Group I)** - UGC-CARE discontinued cloned journal list
+- **UGC-CARE Cloned (Group II)** - UGC-CARE discontinued cloned journal list
+- **UGC-CARE Delisted (Group II)** - UGC-CARE discontinued delisted journal list
+- **UGC-CARE Included from Clone Page (Group I/II)** - Left-side included journals from public clone-correction pages
 - **Algerian Ministry** - Algerian Ministry of Higher Education predatory journals list
 - **OpenAlex** - Publication pattern analysis
 - **Crossref** - Metadata quality assessment
@@ -105,6 +109,11 @@ These provide authoritative yes/no decisions for journals they cover:
 | **DOAJ** | Legitimate OA journals | 22,000+ journals | Gold standard for open access legitimacy |
 | **Scopus** (optional) | Legitimate indexed journals | 30,000+ journals | Major subscription and OA journals |
 | **Beall's List** | Predatory journal archives | ~2,900 entries | Historically identified predatory publishers |
+| **UGC-CARE Cloned (Group I)** | Cloned journals | ~80 entries | Public UGC-CARE discontinued Group I clone list |
+| **UGC-CARE Cloned (Group II)** | Cloned journals | ~114 entries | Public UGC-CARE discontinued Group II clone list |
+| **UGC-CARE Delisted (Group II)** | Delisted journals | ~12 entries | Public UGC-CARE discontinued Group II delisted list |
+| **UGC-CARE Included from Clone Page (Group I)** | Included journals | ~80 entries | Left-side included journals from Group I clone-correction page |
+| **UGC-CARE Included from Clone Page (Group II)** | Included journals | ~114 entries | Left-side included journals from Group II clone-correction page |
 | **PredatoryJournals.org** | Predatory journals/publishers | 15,000+ entries | Curated lists from predatoryjournals.org |
 | **Algerian Ministry** | Predatory journal list | ~3,300 entries | Ministry of Higher Education predatory journals |
 | **Kscien Standalone Journals** | Predatory journals | 1,400+ entries | Individual predatory journals identified by Kscien |
@@ -134,6 +143,7 @@ Journal Query → [Curated Databases + Pattern Analyzers] → Combined Assessmen
                  ├─ DOAJ (legitimate OA)
                  ├─ Scopus (indexed journals)
                  ├─ Beall's List (predatory)
+                 ├─ UGC-CARE discontinued lists
                  ├─ PredatoryJournals.org
                  ├─ Kscien databases
                  ├─ Retraction Watch (quality)
@@ -145,6 +155,7 @@ Journal Query → [Curated Databases + Pattern Analyzers] → Combined Assessmen
 **Note**: Not all backends will find every journal. A journal may be:
 - Found in DOAJ → strong legitimate evidence
 - Found in Beall's → strong predatory evidence
+- Found in UGC-CARE cloned/delisted lists → strong predatory evidence
 - Not found in any curated database → rely on pattern analysis
 - Found in contradictory sources → cross-validation resolves conflicts
 
@@ -206,16 +217,16 @@ Reasoning: "Found in Scopus with excellent publication patterns and metadata qua
 
 #### **Scenario 2: Known Predatory Journal**
 ```
-Input: "International Journal of Advanced Computer Science and Applications"
+Input: "Journal Appearing in UGC-CARE Cloned Group II"
 │
 ├─ DOAJ: ✗ Not found
-├─ Predatory Lists: ✓ Found in Kscien database → "predatory"
+├─ Predatory Lists: ✓ Found in UGC-CARE Cloned (Group II) → "predatory"
 ├─ Retraction Watch: ✗ Not found
-├─ OpenAlex: ✓ Found → High volume (>800/year), low citations
-├─ Crossref: ✓ Found → Poor metadata quality
+├─ OpenAlex: ✓ Found → suspicious pattern indicators
+├─ Crossref: ✓ Found → weak metadata quality
 │
 Result: PREDATORY (confidence: 0.90)
-Reasoning: "Listed in Kscien predatory database, confirmed by publication patterns"
+Reasoning: "Listed in UGC-CARE cloned journal list, corroborated by pattern analysis"
 ```
 
 #### **Scenario 3: Unknown Journal (Pattern Analysis)**

docs/api-reference/backends.md

@@ -103,6 +103,11 @@ YAML structure:
 | Backend | Purpose | Source |
 |---------|---------|--------|
 | **bealls** | Beall's List archive | `src/aletheia_probe/backends/bealls.py` |
+| **ugc_care_cloned** | UGC-CARE Group I cloned journals | `src/aletheia_probe/backends/ugc_care_cloned.py` |
+| **ugc_care_cloned_group2** | UGC-CARE Group II cloned journals | `src/aletheia_probe/backends/ugc_care_cloned_group2.py` |
+| **ugc_care_delisted_group2** | UGC-CARE Group II delisted journals | `src/aletheia_probe/backends/ugc_care_delisted_group2.py` |
+| **ugc_care_included_from_clone_group1** | UGC-CARE Group I included journals from clone page | `src/aletheia_probe/backends/ugc_care_included_from_clone_group1.py` |
+| **ugc_care_included_from_clone_group2** | UGC-CARE Group II included journals from clone page | `src/aletheia_probe/backends/ugc_care_included_from_clone_group2.py` |
 | **predatoryjournals** | PredatoryJournals.com database | `src/aletheia_probe/backends/predatoryjournals.py` |
 | **algerian_ministry** | Algerian Ministry predatory list | `src/aletheia_probe/backends/algerian_ministry.py` |
 | **kscien_standalone_journals** | Kscien standalone journals | `src/aletheia_probe/backends/kscien_standalone_journals.py` |

docs/configuration.md

@@ -204,6 +204,63 @@ backends:
 
 See `src/aletheia_probe/backends/predatoryjournals.py`
 
+### UGC-CARE Discontinued Lists Backends
+
+```yaml
+backends:
+  ugc_care_cloned:
+    enabled: true
+    weight: 0.9
+    timeout: 5
+    config:
+      cache_ttl_hours: 720  # 30 days - discontinued static list
+
+  ugc_care_cloned_group2:
+    enabled: true
+    weight: 0.9
+    timeout: 5
+    config:
+      cache_ttl_hours: 720  # 30 days - discontinued static list
+
+  ugc_care_delisted_group2:
+    enabled: true
+    weight: 0.9
+    timeout: 5
+    config:
+      cache_ttl_hours: 720  # 30 days - discontinued static list
+
+  ugc_care_included_from_clone_group1:
+    enabled: true
+    weight: 1.0
+    timeout: 5
+    config:
+      cache_ttl_hours: 720  # 30 days - discontinued static list
+
+  ugc_care_included_from_clone_group2:
+    enabled: true
+    weight: 1.0
+    timeout: 5
+    config:
+      cache_ttl_hours: 720  # 30 days - discontinued static list
+```
+
+**Configuration**:
+- `cache_ttl_hours`: How long cached UGC-CARE list data remains valid before requiring re-sync. Default is 720 hours (30 days), appropriate for discontinued/frozen sources.
+
+**Backend Descriptions**:
+- `ugc_care_cloned`: UGC-CARE Group I cloned journals list
+- `ugc_care_cloned_group2`: UGC-CARE Group II cloned journals list
+- `ugc_care_delisted_group2`: UGC-CARE Group II delisted journals list
+- `ugc_care_included_from_clone_group1`: UGC-CARE Group I included journals from clone correction page (left side)
+- `ugc_care_included_from_clone_group2`: UGC-CARE Group II included journals from clone correction page (left side)
+
+See implementations in:
+- `src/aletheia_probe/backends/ugc_care_cloned.py`
+- `src/aletheia_probe/backends/ugc_care_cloned_group2.py`
+- `src/aletheia_probe/backends/ugc_care_delisted_group2.py`
+- `src/aletheia_probe/backends/ugc_care_included_from_clone_group1.py`
+- `src/aletheia_probe/backends/ugc_care_included_from_clone_group2.py`
+
 ### Kscien Backends
 
 The Kscien suite provides curated lists of predatory journals, publishers, hijacked journals, and conferences. All Kscien backends share the same configuration pattern.
@@ -613,4 +670,4 @@ aletheia-probe status
 
 # Test with verbose output
 aletheia-probe journal --verbose "Test Journal"
-```
+```

src/aletheia_probe/backends/__init__.py

@@ -16,6 +16,11 @@
     predatoryjournals,
     retraction_watch,
     scopus,
+    ugc_care_cloned,
+    ugc_care_cloned_group2,
+    ugc_care_delisted_group2,
+    ugc_care_included_from_clone_group1,
+    ugc_care_included_from_clone_group2,
 )
 
 
@@ -33,4 +38,9 @@
     "predatoryjournals",
     "retraction_watch",
     "scopus",
+    "ugc_care_cloned",
+    "ugc_care_cloned_group2",
+    "ugc_care_delisted_group2",
+    "ugc_care_included_from_clone_group1",
+    "ugc_care_included_from_clone_group2",
 ]

src/aletheia_probe/backends/ugc_care_cloned.py

@@ -0,0 +1,42 @@
+# SPDX-License-Identifier: MIT
+"""UGC-CARE cloned journals backend."""
+
+from typing import TYPE_CHECKING
+
+from ..enums import AssessmentType, EvidenceType
+from .base import CachedBackend, get_backend_registry
+
+
+if TYPE_CHECKING:
+    from ..updater.core import DataSource
+    from ..updater.sources.ugc_care import UgcCareClonedSource
+
+
+class UgcCareClonedBackend(CachedBackend):
+    """Backend for UGC-CARE Group-I cloned journals list."""
+
+    def __init__(self) -> None:
+        super().__init__(
+            source_name="ugc_care_cloned",
+            list_type=AssessmentType.PREDATORY,
+            cache_ttl_hours=24 * 30,
+        )
+        self._data_source: UgcCareClonedSource | None = None
+
+    def get_name(self) -> str:
+        return "ugc_care_cloned"
+
+    def get_evidence_type(self) -> EvidenceType:
+        return EvidenceType.PREDATORY_LIST
+
+    def get_data_source(self) -> "DataSource | None":
+        if self._data_source is None:
+            from ..updater.sources.ugc_care import UgcCareClonedSource
+
+            self._data_source = UgcCareClonedSource()
+        return self._data_source
+
+
+get_backend_registry().register_factory(
+    "ugc_care_cloned", lambda: UgcCareClonedBackend(), default_config={}
+)

src/aletheia_probe/backends/ugc_care_cloned_group2.py

@@ -0,0 +1,44 @@
+# SPDX-License-Identifier: MIT
+"""UGC-CARE Group-II cloned journals backend."""
+
+from typing import TYPE_CHECKING
+
+from ..enums import AssessmentType, EvidenceType
+from .base import CachedBackend, get_backend_registry
+
+
+if TYPE_CHECKING:
+    from ..updater.core import DataSource
+    from ..updater.sources.ugc_care import UgcCareClonedGroup2Source
+
+
+class UgcCareClonedGroup2Backend(CachedBackend):
+    """Backend for UGC-CARE Group-II cloned journals list."""
+
+    def __init__(self) -> None:
+        super().__init__(
+            source_name="ugc_care_cloned_group2",
+            list_type=AssessmentType.PREDATORY,
+            cache_ttl_hours=24 * 30,
+        )
+        self._data_source: UgcCareClonedGroup2Source | None = None
+
+    def get_name(self) -> str:
+        return "ugc_care_cloned_group2"
+
+    def get_evidence_type(self) -> EvidenceType:
+        return EvidenceType.PREDATORY_LIST
+
+    def get_data_source(self) -> "DataSource | None":
+        if self._data_source is None:
+            from ..updater.sources.ugc_care import UgcCareClonedGroup2Source
+
+            self._data_source = UgcCareClonedGroup2Source()
+        return self._data_source
+
+
+get_backend_registry().register_factory(
+    "ugc_care_cloned_group2",
+    lambda: UgcCareClonedGroup2Backend(),
+    default_config={},
+)

src/aletheia_probe/backends/ugc_care_delisted_group2.py

@@ -0,0 +1,44 @@
+# SPDX-License-Identifier: MIT
+"""UGC-CARE Group-II delisted journals backend."""
+
+from typing import TYPE_CHECKING
+
+from ..enums import AssessmentType, EvidenceType
+from .base import CachedBackend, get_backend_registry
+
+
+if TYPE_CHECKING:
+    from ..updater.core import DataSource
+    from ..updater.sources.ugc_care import UgcCareDelistedGroup2Source
+
+
+class UgcCareDelistedGroup2Backend(CachedBackend):
+    """Backend for UGC-CARE Group-II delisted journals."""
+
+    def __init__(self) -> None:
+        super().__init__(
+            source_name="ugc_care_delisted_group2",
+            list_type=AssessmentType.PREDATORY,
+            cache_ttl_hours=24 * 30,
+        )
+        self._data_source: UgcCareDelistedGroup2Source | None = None
+
+    def get_name(self) -> str:
+        return "ugc_care_delisted_group2"
+
+    def get_evidence_type(self) -> EvidenceType:
+        return EvidenceType.PREDATORY_LIST
+
+    def get_data_source(self) -> "DataSource | None":
+        if self._data_source is None:
+            from ..updater.sources.ugc_care import UgcCareDelistedGroup2Source
+
+            self._data_source = UgcCareDelistedGroup2Source()
+        return self._data_source
+
+
+get_backend_registry().register_factory(
+    "ugc_care_delisted_group2",
+    lambda: UgcCareDelistedGroup2Backend(),
+    default_config={},
+)

src/aletheia_probe/backends/ugc_care_included_from_clone_group1.py

@@ -0,0 +1,44 @@
+# SPDX-License-Identifier: MIT
+"""UGC-CARE included (Group I clone-page left side) backend."""
+
+from typing import TYPE_CHECKING
+
+from ..enums import AssessmentType, EvidenceType
+from .base import CachedBackend, get_backend_registry
+
+
+if TYPE_CHECKING:
+    from ..updater.core import DataSource
+    from ..updater.sources.ugc_care import UgcCareIncludedFromCloneGroup1Source
+
+
+class UgcCareIncludedFromCloneGroup1Backend(CachedBackend):
+    """Backend for included journals listed on Group-I clone correction page."""
+
+    def __init__(self) -> None:
+        super().__init__(
+            source_name="ugc_care_included_from_clone_group1",
+            list_type=AssessmentType.LEGITIMATE,
+            cache_ttl_hours=24 * 30,
+        )
+        self._data_source: UgcCareIncludedFromCloneGroup1Source | None = None
+
+    def get_name(self) -> str:
+        return "ugc_care_included_from_clone_group1"
+
+    def get_evidence_type(self) -> EvidenceType:
+        return EvidenceType.LEGITIMATE_LIST
+
+    def get_data_source(self) -> "DataSource | None":
+        if self._data_source is None:
+            from ..updater.sources.ugc_care import UgcCareIncludedFromCloneGroup1Source
+
+            self._data_source = UgcCareIncludedFromCloneGroup1Source()
+        return self._data_source
+
+
+get_backend_registry().register_factory(
+    "ugc_care_included_from_clone_group1",
+    lambda: UgcCareIncludedFromCloneGroup1Backend(),
+    default_config={},
+)

src/aletheia_probe/backends/ugc_care_included_from_clone_group2.py

@@ -0,0 +1,44 @@
+# SPDX-License-Identifier: MIT
+"""UGC-CARE included (Group II clone-page left side) backend."""
+
+from typing import TYPE_CHECKING
+
+from ..enums import AssessmentType, EvidenceType
+from .base import CachedBackend, get_backend_registry
+
+
+if TYPE_CHECKING:
+    from ..updater.core import DataSource
+    from ..updater.sources.ugc_care import UgcCareIncludedFromCloneGroup2Source
+
+
+class UgcCareIncludedFromCloneGroup2Backend(CachedBackend):
+    """Backend for included journals listed on Group-II clone correction page."""
+
+    def __init__(self) -> None:
+        super().__init__(
+            source_name="ugc_care_included_from_clone_group2",
+            list_type=AssessmentType.LEGITIMATE,
+            cache_ttl_hours=24 * 30,
+        )
+        self._data_source: UgcCareIncludedFromCloneGroup2Source | None = None
+
+    def get_name(self) -> str:
+        return "ugc_care_included_from_clone_group2"
+
+    def get_evidence_type(self) -> EvidenceType:
+        return EvidenceType.LEGITIMATE_LIST
+
+    def get_data_source(self) -> "DataSource | None":
+        if self._data_source is None:
+            from ..updater.sources.ugc_care import UgcCareIncludedFromCloneGroup2Source
+
+            self._data_source = UgcCareIncludedFromCloneGroup2Source()
+        return self._data_source
+
+
+get_backend_registry().register_factory(
+    "ugc_care_included_from_clone_group2",
+    lambda: UgcCareIncludedFromCloneGroup2Backend(),
+    default_config={},
+)