Extend support for PT 2.6 Inference (#5653)

sallyseok · web-flow · commit 6672eaac8445 · 2026-02-10T23:38:24.000Z
* Extend support for PT 2.6 Inference

Signed-off-by: Sally Seok &lt;sallyseo@amazon.com&gt;

* add .vscode to .gitignore

Signed-off-by: Sally Seok &lt;sallyseo@amazon.com&gt;

* delete .vscode

Signed-off-by: Sally Seok &lt;sallyseo@amazon.com&gt;

* comment out test; add announcement in readme

Signed-off-by: Sally Seok &lt;sallyseo@amazon.com&gt;

* note -&gt; notice

Signed-off-by: Sally Seok &lt;sallyseo@amazon.com&gt;

---------

Signed-off-by: Sally Seok &lt;sallyseo@amazon.com&gt;
diff --git a/.gitignore b/.gitignore
@@ -5,6 +5,7 @@ __pycache__
 .venv
 .ruff_cache
 .pytest_cache
+.vscode
 
 # Generated docs
 docs/index.md
diff --git a/.kiro/steering/docs.md b/.kiro/steering/docs.md
@@ -376,18 +376,28 @@ table_order:
 
 ### Support Policy Consolidation
 
-The `framework_groups` configuration consolidates support policy rows by framework. Repositories in the same group are combined into a single row using the framework name (e.g., "PyTorch").
+The `framework_groups` configuration consolidates support policy rows by framework. Repositories in the same group are combined into a single row using the framework name (e.g., "PyTorch") when they share the same GA/EOP dates.
 
 **Version Display:**
 
-- Images with the same major.minor version (e.g., `2.6.0` and `2.6.1`) are consolidated into a single row displayed as `2.6` if they have identical GA/EOP dates
-- If patch versions have different GA/EOP dates, each is displayed separately with full version (e.g., `2.6.0`, `2.6.1`) and a warning is logged
+- Images with the same major.minor version and identical GA/EOP dates are consolidated into a single row displayed as `2.6` with the framework group name (e.g., "PyTorch")
+- If the same version has different GA/EOP dates across repository types (e.g., training vs inference), separate rows are created showing the specific repository type: "PyTorch Training" and "PyTorch Inference"
+- ARM64 variants are automatically consolidated with their base repository (e.g., "PyTorch Training" and "PyTorch Training ARM64" both show as "PyTorch Training")
+- If patch versions within the same repository have different GA/EOP dates, each is displayed separately with full version (e.g., `2.6.0`, `2.6.1`) and a warning is logged
 
-**Requirements:**
+**Behavior:**
 
-- All repositories in a group that have a given full version (X.Y.Z) must have identical GA/EOP dates
-- Missing versions in some repositories are allowed (only present repos are consolidated)
-- A `ValueError` is raised if dates differ within a group for the same full version
+- Repositories in the same framework group can have different GA/EOP dates for the same version (e.g., inference can have a different EOP than training)
+- When dates match across all repositories in a group, they are consolidated into a single row with the framework group name
+- When dates differ by repository type (training vs inference), separate rows show the specific repository type names
+- Missing versions in some repositories are allowed (only present repos are included)
+
+**Example:**
+
+If PyTorch 2.6 Training has EOP 2025-10-15 but PyTorch 2.6 Inference has EOP 2026-10-15, the support policy table will show:
+
+- Row 1: Framework="PyTorch Training", Version="2.6", EOP="2025-10-15"
+- Row 2: Framework="PyTorch Inference", Version="2.6", EOP="2026-10-15"
 
 To add a new framework group, add an entry to `framework_groups` with the framework name as key and list of repositories as value.
 
diff --git a/README.md b/README.md
@@ -19,6 +19,12 @@ ______________________________________________________________________
 - **[2025/11/17]** Released first [SGLang DLCs](https://gallery.ecr.aws/deep-learning-containers/sglang)
   - SageMaker: `public.ecr.aws/deep-learning-containers/sglang:0.5.5-gpu-py312`
 
+### 📢 Support Updates
+
+- **[2026/02/10]** Extended support for PyTorch 2.6 Inference containers until June 30, 2026
+  - PyTorch 2.6 Inference images will continue to receive security patches and updates through end of June 2026
+  - For complete framework support timelines, see our [Support Policy](https://aws.github.io/deep-learning-containers/reference/support_policy/)
+
 ### 🎉 Hot Off the Press
 
 - 🌐
diff --git a/docs/DEVELOPMENT.md b/docs/DEVELOPMENT.md
@@ -81,10 +81,14 @@ eop: "2035-10-15"   # End of Patch date
 
 **Version Consolidation:**
 
-- Images with the same major.minor version (e.g., `2.6.0` and `2.6.1`) are consolidated into a single row displayed as `2.6` if they have identical GA/EOP dates
-- If patch versions have different GA/EOP dates, each is displayed separately with full version (e.g., `2.6.0`, `2.6.1`) and a warning is logged
+- Images with the same major.minor version and identical GA/EOP dates are consolidated into a single row displayed as `2.6` with the framework group name (e.g., "PyTorch")
+- If the same version has different GA/EOP dates across repository types (e.g., training vs inference), separate rows are created showing the specific repository type: "PyTorch Training" and "PyTorch Inference"
+- ARM64 variants are automatically consolidated with their base repository
+- If patch versions within the same repository have different GA/EOP dates, each is displayed separately with full version (e.g., `2.6.0`, `2.6.1`) and a warning is logged
 
-**Validation:** All images in the same framework group with the same full version (X.Y.Z) must have identical GA/EOP dates.
+**Flexibility:** Repositories in the same framework group (e.g., pytorch-training and pytorch-inference) can have different GA/EOP dates for the same version. The system will automatically create separate rows showing the specific repository type when dates differ.
+
+**Example:** If PyTorch 2.6 Training has EOP 2025-10-15 but PyTorch 2.6 Inference has EOP 2026-10-15, the support policy table will show two separate rows with "PyTorch Training" and "PyTorch Inference" in the Framework column.
 
 ---
 
diff --git a/docs/src/data/pytorch-inference-arm64/2.6-cpu-ec2.yml b/docs/src/data/pytorch-inference-arm64/2.6-cpu-ec2.yml
@@ -5,7 +5,7 @@ python: py312
 os: ubuntu22.04
 platform: ec2
 ga: "2025-01-29"
-eop: "2026-01-29"
+eop: "2026-06-30"
 public_registry: true
 
 tags:
diff --git a/docs/src/data/pytorch-inference-arm64/2.6-cpu-sagemaker.yml b/docs/src/data/pytorch-inference-arm64/2.6-cpu-sagemaker.yml
@@ -5,7 +5,7 @@ python: py312
 os: ubuntu22.04
 platform: sagemaker
 ga: "2025-01-29"
-eop: "2026-01-29"
+eop: "2026-06-30"
 public_registry: true
 
 tags:
diff --git a/docs/src/data/pytorch-inference-arm64/2.6-gpu-ec2.yml b/docs/src/data/pytorch-inference-arm64/2.6-gpu-ec2.yml
@@ -6,7 +6,7 @@ cuda: cu124
 os: ubuntu22.04
 platform: ec2
 ga: "2025-01-29"
-eop: "2026-01-29"
+eop: "2026-06-30"
 public_registry: true
 
 tags:
diff --git a/docs/src/data/pytorch-inference/2.6-cpu-ec2.yml b/docs/src/data/pytorch-inference/2.6-cpu-ec2.yml
@@ -5,7 +5,7 @@ python: py312
 os: ubuntu22.04
 platform: ec2
 ga: "2025-01-29"
-eop: "2026-01-29"
+eop: "2026-06-30"
 public_registry: true
 
 tags:
diff --git a/docs/src/data/pytorch-inference/2.6-cpu-sagemaker.yml b/docs/src/data/pytorch-inference/2.6-cpu-sagemaker.yml
@@ -5,7 +5,7 @@ python: py312
 os: ubuntu22.04
 platform: sagemaker
 ga: "2025-01-29"
-eop: "2026-01-29"
+eop: "2026-06-30"
 public_registry: true
 
 tags:
diff --git a/docs/src/data/pytorch-inference/2.6-gpu-ec2.yml b/docs/src/data/pytorch-inference/2.6-gpu-ec2.yml
@@ -6,7 +6,7 @@ cuda: cu124
 os: ubuntu22.04
 platform: ec2
 ga: "2025-01-29"
-eop: "2026-01-29"
+eop: "2026-06-30"
 public_registry: true
 
 tags:
diff --git a/docs/src/data/pytorch-inference/2.6-gpu-sagemaker.yml b/docs/src/data/pytorch-inference/2.6-gpu-sagemaker.yml
@@ -6,7 +6,7 @@ cuda: cu124
 os: ubuntu22.04
 platform: sagemaker
 ga: "2025-01-29"
-eop: "2026-01-29"
+eop: "2026-06-30"
 public_registry: true
 
 tags:
diff --git a/docs/src/generate.py b/docs/src/generate.py
@@ -197,67 +197,156 @@ def generate_support_policy(dry_run: bool = False) -> str:
         if not images:
             continue
 
-        # Group by major.minor, then decide display format based on date consistency
-        major_minor_groups: dict[str, list[ImageConfig]] = {}
+        # Group by (major.minor, ga, eop) to allow different dates for same version
+        # This enables training and inference to have different EOP dates
+        date_groups: dict[tuple[str, str, str], list[ImageConfig]] = {}
         for img in images:
             v = parse_version(img.version)
             major_minor = f"{v.major}.{v.minor}"
-            major_minor_groups.setdefault(major_minor, []).append(img)
-
-        version_map: dict[str, ImageConfig] = {}
-        for major_minor, group in major_minor_groups.items():
-            # Check if all images in group have same ga/eop
-            first = group[0]
-            all_same_dates = all(img.ga == first.ga and img.eop == first.eop for img in group)
-
-            if all_same_dates:
-                # Consolidate to major.minor display
-                version_map[major_minor] = first
+            key = (major_minor, img.ga, img.eop)
+            date_groups.setdefault(key, []).append(img)
+
+        # Track which versions have multiple date groups (need repository-specific display)
+        version_date_count: dict[str, int] = {}
+        for (major_minor, ga, eop), group in date_groups.items():
+            version_date_count[major_minor] = version_date_count.get(major_minor, 0) + 1
+
+        version_map: dict[str, tuple[ImageConfig, bool]] = {}
+
+        # Process each unique (version, ga, eop) combination
+        for (major_minor, ga, eop), group in date_groups.items():
+            # Check if all images in this date group have the same full version
+            versions_in_group = {img.version for img in group}
+
+            # Determine if this version needs repository-specific display
+            needs_repo_display = version_date_count[major_minor] > 1
+
+            if len(versions_in_group) == 1:
+                # All images have same patch version
+                first = group[0]
+
+                if needs_repo_display:
+                    # Same version exists with different dates - use repository-specific display
+                    # Store with flag indicating we need to override framework_group display
+                    repos_in_group = {img._repository for img in group}
+                    # Create a unique key for this date group
+                    repo_suffix = "-".join(sorted(repos_in_group))
+                    display_key = f"{major_minor}:{repo_suffix}"
+                    version_map[display_key] = (first, True)  # True = use repo display
+                else:
+                    # No conflict - use simple major.minor key with framework display
+                    version_map[major_minor] = (first, False)  # False = use framework display
             else:
-                # Keep full versions, warn about inconsistency
-                versions_info = ", ".join(f"{img.version} ({img.ga}, {img.eop})" for img in group)
+                # Multiple patch versions with same dates - warn and keep separate
+                versions_info = ", ".join(sorted(versions_in_group))
                 LOGGER.warning(
-                    f"Different GA/EOP dates for {framework_group} patch versions: {versions_info}"
+                    f"Different patch versions for {framework_group} with same GA/EOP dates: {versions_info}"
                 )
-                # Keep each patch version as separate row with full version display
                 for img in group:
-                    existing = version_map.get(img.version)
-                    # Error if same full version (e.g., X.Y.Z) has different dates across images
-                    if existing and (existing.ga != img.ga or existing.eop != img.eop):
-                        raise ValueError(
-                            f"Inconsistent dates for {framework_group} {img.version}: \n"
-                            f"\tExisting: {existing._repository}-{existing.version}-{existing.accelerator}-{existing.platform}\n"
-                            f"\tImage: {img._repository}-{img.version}-{img.accelerator}-{img.platform}\n"
-                            f"\t({existing.ga}, {existing.eop}) vs ({img.ga}, {img.eop})"
-                        )
-                    # Deduplicate same full version with same dates
-                    version_map[img.version] = img
+                    version_map[img.version] = (img, needs_repo_display)
 
         # Merge legacy entries for this framework
         for legacy_img in legacy_data.get(framework_group, []):
             if legacy_img.version not in version_map:
-                version_map[legacy_img.version] = legacy_img
+                version_map[legacy_img.version] = (
+                    legacy_img,
+                    False,
+                )  # Legacy uses framework display
 
         # Sort by version descending within this framework group
-        # Key is the display version (major.minor if consolidated, full version otherwise)
+        # Extract version for sorting from the tuple
         sorted_keys = sorted(
-            version_map.keys(), key=lambda k: parse_version(version_map[k].version), reverse=True
+            version_map.keys(), key=lambda k: parse_version(version_map[k][0].version), reverse=True
         )
         for key in sorted_keys:
-            img = version_map[key]
-            (supported if img.is_supported else unsupported).append((img, key))
+            img, use_repo_display = version_map[key]
+            # Extract clean version for display (remove repo suffix if present)
+            display_version = key.split(":")[0] if ":" in key else key
+            (supported if img.is_supported else unsupported).append(
+                (img, display_version, use_repo_display)
+            )
 
     # Build tables
     table_config = load_table_config("extra/support_policy")
     columns = table_config.get("columns", [])
     headers = [col["header"] for col in columns]
 
-    supported_table = render_table(
-        headers, [build_image_row(img, columns, {"version": ver}) for img, ver in supported]
-    )
-    unsupported_table = render_table(
-        headers, [build_image_row(img, columns, {"version": ver}) for img, ver in unsupported]
-    )
+    # Build rows with appropriate framework display
+    supported_rows = []
+    for img, ver, use_repo_display in supported:
+        overrides = {"version": ver}
+        if use_repo_display:
+            # Find all repositories in this framework group with this version and same dates
+            # to create a comprehensive display name
+            all_repos_with_dates = [
+                i
+                for i in images_by_group.get(img.framework_group, [])
+                if parse_version(i.version).major == parse_version(img.version).major
+                and parse_version(i.version).minor == parse_version(img.version).minor
+                and i.ga == img.ga
+                and i.eop == img.eop
+            ]
+            unique_repos = sorted(set(i._repository for i in all_repos_with_dates))
+            display_names = GLOBAL_CONFIG.get("display_names", {})
+
+            # Determine the common prefix (e.g., "PyTorch") and suffix (e.g., "Training", "Inference")
+            repo_displays = [display_names.get(repo, repo) for repo in unique_repos]
+
+            # If all repos share a common framework prefix, consolidate intelligently
+            # e.g., ["PyTorch Training", "PyTorch Training ARM64"] -> "PyTorch Training"
+            # e.g., ["PyTorch Inference", "PyTorch Inference ARM64"] -> "PyTorch Inference"
+            if len(repo_displays) > 1:
+                # Check if we can consolidate (e.g., remove ARM64 variants)
+                base_displays = set()
+                for display in repo_displays:
+                    # Remove " ARM64" suffix if present
+                    base = display.replace(" ARM64", "").strip()
+                    base_displays.add(base)
+
+                if len(base_displays) == 1:
+                    # All are variants of the same base (e.g., all "PyTorch Training")
+                    overrides["framework_group"] = base_displays.pop()
+                else:
+                    # Multiple different bases - show them all
+                    overrides["framework_group"] = ", ".join(sorted(base_displays))
+            else:
+                overrides["framework_group"] = repo_displays[0]
+        supported_rows.append(build_image_row(img, columns, overrides))
+
+    unsupported_rows = []
+    for img, ver, use_repo_display in unsupported:
+        overrides = {"version": ver}
+        if use_repo_display:
+            # Find all repositories in this framework group with this version and same dates
+            all_repos_with_dates = [
+                i
+                for i in images_by_group.get(img.framework_group, [])
+                if parse_version(i.version).major == parse_version(img.version).major
+                and parse_version(i.version).minor == parse_version(img.version).minor
+                and i.ga == img.ga
+                and i.eop == img.eop
+            ]
+            unique_repos = sorted(set(i._repository for i in all_repos_with_dates))
+            display_names = GLOBAL_CONFIG.get("display_names", {})
+
+            repo_displays = [display_names.get(repo, repo) for repo in unique_repos]
+
+            if len(repo_displays) > 1:
+                base_displays = set()
+                for display in repo_displays:
+                    base = display.replace(" ARM64", "").strip()
+                    base_displays.add(base)
+
+                if len(base_displays) == 1:
+                    overrides["framework_group"] = base_displays.pop()
+                else:
+                    overrides["framework_group"] = ", ".join(sorted(base_displays))
+            else:
+                overrides["framework_group"] = repo_displays[0]
+        unsupported_rows.append(build_image_row(img, columns, overrides))
+
+    supported_table = render_table(headers, supported_rows)
+    unsupported_table = render_table(headers, unsupported_rows)
 
     # Render template
     template = Template(load_jinja2(template_path))
diff --git a/docs/src/templates/reference/support_policy.template.md b/docs/src/templates/reference/support_policy.template.md
@@ -7,6 +7,10 @@
 - **GA (General Availability)**: The date when a framework version becomes officially supported and available for production use.
 - **EOP (End of Patch)**: The date after which a framework version no longer receives security patches or bug fixes.
 
+## Notice
+
+- We are extending support for PyTorch 2.6 Inference images until end of June 2026 as these are the last available PyTorch inference images with torchserve support.
+
 ## Supported Frameworks
 
 {{ supported_table }}
diff --git a/test/docs/test_generate.py b/test/docs/test_generate.py
@@ -109,17 +109,17 @@ def test_consistent_dates(self, mock_paths, mock_repo_images):
         content = generate_support_policy(dry_run=True)
         assert "Test Group" in content
 
-    @pytest.mark.parametrize(
-        "mock_repo_images",
-        [
-            (("2025-01-01", "2500-01-01"), ("2025-01-01", "2500-06-01")),
-            (("2025-01-01", "2500-01-01"), ("2025-02-01", "2500-01-01")),
-            (("2025-01-01", "2500-01-01"), ("2025-06-01", "2500-06-01")),
-        ],
-        indirect=True,
-        ids=["inconsistent_eop", "inconsistent_ga", "both_inconsistent"],
-    )
-    def test_inconsistent_dates_raises(self, mock_paths, mock_repo_images):
-        """Test that inconsistent dates across repos in same framework group raise ValueError."""
-        with pytest.raises(ValueError, match="Inconsistent dates"):
-            generate_support_policy(dry_run=True)
+    # @pytest.mark.parametrize(
+    #     "mock_repo_images",
+    #     [
+    #         (("2025-01-01", "2500-01-01"), ("2025-01-01", "2500-06-01")),
+    #         (("2025-01-01", "2500-01-01"), ("2025-02-01", "2500-01-01")),
+    #         (("2025-01-01", "2500-01-01"), ("2025-06-01", "2500-06-01")),
+    #     ],
+    #     indirect=True,
+    #     ids=["inconsistent_eop", "inconsistent_ga", "both_inconsistent"],
+    # )
+    # def test_inconsistent_dates_raises(self, mock_paths, mock_repo_images):
+    #     """Test that inconsistent dates across repos in same framework group raise ValueError."""
+    #     with pytest.raises(ValueError, match="Inconsistent dates"):
+    #         generate_support_policy(dry_run=True)
