Skip to content

CHANGELOG.md

Latest commit

 

History

History
162 lines (137 loc) · 14.7 KB

CHANGELOG.md

File metadata and controls

162 lines (137 loc) · 14.7 KB
Raw

Changelog

Unreleased

[0.1.11] - 2026-07-17

What's Changed

  • Update start_server signature in pathwaysutils.profiling to accept requires_backend by @copybara-service[bot] in #267
  • Extract TPU specifications and helper functions for Shared Pathways Service by @copybara-service[bot] in #272
  • Add JAX 0.10.2 to test matrix by @wstcliyu in #276
  • bump py version in pyproject.toml by @sadikneipp in #277
  • Automated Code Change by @copybara-service[bot] in #271
  • Add GCSFuse support to PathwaysJobSet. by @copybara-service[bot] in #252
  • Add Colocated Python support to PathwaysJobSet. by @copybara-service[bot] in #253
  • Unify monitor thread lifecycle and implement robust set-based slice tracking in pathwaysutils. by @copybara-service[bot] in #257
  • Add YAML serialization and deployment to GKE for PathwaysJobSet. by @copybara-service[bot] in #254
  • Add Shared Pathways Service support to PathwaysJobSet. by @copybara-service[bot] in #255
  • Replace Shared Pathways Service YAML templates with PathwaysJobSet. by @copybara-service[bot] in #256

[0.1.10] - 2026-06-30

What's Changed

  • Add retry_policy and deprecate max_retries in pathwaysutils.elastic.manager.elastic_retry. by @copybara-service[bot] in #246
  • Add support for a static colocated Python sidecar by @copybara-service[bot] in #243
  • Refactor pathwaysutils resharding APIs to establish IFRT/sidechannel split. by @copybara-service[bot] in #248
  • Add cluster and job name labels to Shared Pathways Service metrics by @copybara-service[bot] in #249
  • fix serialization of int values matching tensorflow.ProfileOptions.AdvancedConfigValue by @copybara-service[bot] in #260
  • Add sidecar image version validation to ISC Pathways connection by @copybara-service[bot] in #247
  • Fix JAX device compatibility in profiling.py for elasticity. by @copybara-service[bot] in #261
  • Add Worker Job configuration to PathwaysJobSet. by @copybara-service[bot] in #251
  • Monkey-patch jax._src.profiler.start_server and stop_server in pathwaysutils by @copybara-service[bot] in #266

[0.1.9] - 2026-06-12

What's Changed

  • Add --dns-endpoint to the get-credentials command by @copybara-service[bot] in #224
  • Add support for passing XLA flags to the Pathways proxy by @copybara-service[bot] in #225
  • Generalize TPU Slice Health Checks for elasticity by @copybara-service[bot] in #218
  • Fix the accelerator label for tpu7x by @copybara-service[bot] in #226
  • Rename "v5p" to "v5" TPU type by @copybara-service[bot] in #230
  • Fix argument and resource type injection in gke_utils.py by @copybara-service[bot] in #228
  • Plumb session_id from ProfileOptions to traceSessionName. by @copybara-service[bot] in #232
  • Add JAX 0.10.1 to test matrix by @wstcliyu in #234
  • Sync session_id format between JAX client and Pathways server in pathwaysutils. by @copybara-service[bot] in #236
  • Clean up ProfileOptions getattr usages in pathwaysutils. by @copybara-service[bot] in #237
  • Bump min JAX version to 0.8.3 by @wstcliyu in #240
  • Add base PathwaysJobSet builder by @copybara-service[bot] in #239
  • Add Head Job configuration to PathwaysJobSet by @copybara-service[bot] in #241
  • Add a script to deploy VS Code on GKE CPU node pool by @copybara-service[bot] in #242

[0.1.8] - 2026-04-24

What's Changed

  • Add background log streaming to detect TPU placement completion by @copybara-service[bot] in #204
  • Add a script to deploy Pathways service as a JobSet by @copybara-service[bot] in #211
  • Integrate metrics collection into ISC Pathways by @copybara-service[bot] in #214
  • add support for max_num_hosts in start_trace. the default now is to trace one host. by @copybara-service[bot] in #213
  • Remove redundant user waiting metric update by @copybara-service[bot] in #215
  • Rename pw-service-example to pw-service by @copybara-service[bot] in #219
  • Expose concatenate_by_mesh_axis in pathwaysutils. by @copybara-service[bot] in #217
  • Update concatenate_by_mesh_axis to preserve memory kind by @copybara-service[bot] in #220

[0.1.7] - 2026-04-03

What's Changed

  • Refactor elasticity retry logic into a reusable private method. by @copybara-service[bot] in #177
  • Add a name parameter to the watchdog context manager. by @copybara-service[bot] in #199
  • Use abstract types for return type hints in pathwaysutils. by @copybara-service[bot] in #198
  • Update environment variables for JAX backend by @copybara-service[bot] in #203
  • Enable Pathways profiling with jax.profiler.ProfileOptions. by @copybara-service[bot] in #201
  • Refactor elastic retry decorators into a single elastic_retry method. by @copybara-service[bot] in #202
  • Fix JaxRuntimeError during profiler stop_trace with profile options by @copybara-service[bot] in #205
  • Add CLI mode to Shared Pathways Service by @copybara-service[bot] in #200

[0.1.6] - 2026-02-27

  • Fix --proxy_options to use flags.DEFINE_list by @copybara-service[bot] in #191

[0.1.5] - 2026-02-27

  • Refactor: Simplify Elasticity Manager to focus on slice availability. by @copybara-service[bot] in #167
  • Make Pathways proxy server image user-configurable by @copybara-service[bot] in #159
  • This change introduces reshard_with_intermediate_sharding which will first look for intermediate shardings, perform all intermediate resharding, and then perform the final reshard into the out sharding. by @copybara-service[bot] in #145
  • Update active_slice_indices after waiting for slices within pause-resume. by @copybara-service[bot] in #174
  • Add cleanup to restore JAX config and environment variables in tests. by @copybara-service[bot] in #185
  • Change Pathways backend target from localhost to 127.0.0.1 by @copybara-service[bot] in #186
  • Move ifrt based reshard out of experimental. Leaving intermediate resharding and sidechannel resharding in experimental. by @copybara-service[bot] in #176
  • Add support for passing environment variables to the Pathways proxy by @copybara-service[bot] in #187

[0.1.4] - 2026-01-26

  • Extract lambda to a named function to ensure cache hits. by @copybara-service[bot] in #127
  • Always write array metadata if self._array_metadata_store is not None. by @copybara-service[bot] in #125
  • Add "Shared Pathways Service" for Pathways-on-Cloud by @copybara-service[bot] in #128
  • Exposes pathwaysutils.profiling._start_trace_from_profile_request as pathwaysutils.experimental.profiling.start_trace. by @copybara-service[bot] in #141
  • Patch internal JAX profiler functions (enabling jax.profiler.trace) and add a test for jax.profiler.trace. by @copybara-service[bot] in #140
  • Expose _split_by_mesh_axis directly in pw_jax. by @copybara-service[bot] in #147
  • Use Pathways _transfer_to_sharding for resharding in experimental reshard API. by @copybara-service[bot] in #148
  • Allow specifying a custom proxy job name in _ISCPathways by @copybara-service[bot] in #157

[0.1.3] - 2025-10-08

  • Update the github action for PyPI by @lukebaumann in #105
  • Expose is_pathways_backend_used in pathwaysutils. by @copybara-service[bot] in #107
  • Treat additional error types as potential slice down issues. by @copybara-service[bot] in #109
  • Adding split_by_mesh_axis to experimental for use by a new experimental reshard. by @copybara-service[bot] in #112
  • Update pathways.experimental.reshard so that PyTrees with arrays that have different device sets can be resharded. by @copybara-service[bot] in #113
  • Update GitHub action unittest matrix by @lukebaumann in #111
  • Handle new style PRNG keys in reshard and CloudPathwaysArrayHandler

[0.1.2] - 2025-08-25

  • Updates to Pathways orbax handler. In #81 #89 #90
  • Improvements to pathwaysutils/elastic by @copybara-service[bot] inhttps://github.com//pull/72 #84 #85 #86 #99 #100 #102
  • Handle JAX API interface compatibility by @copybara-service[bot] in #88 #93 #95
  • Adding jax version to the github actions matrix by @lukebaumann in #94
  • Added LRU cache and tests to pathwaysutils. by @copybara-service[bot] in #83
  • Moving initialization logic into its own module by @copybara-service[bot] in #96

[0.1.1] - 2025-04-25

  • Port the collect_profile script from JAX to PathwaysUtils
  • Remove support for legacy initialize
  • Add collect_profile as a script of pathwaysutils
  • Make CloudPathwaysArrayHandler compatible with async directory creation feature in orbax

[0.1.0] - 2025-04-07

  • Bump the JAX requirement to 0.5.1
  • Introduce pathwaysutils.initialize() to remove relying on side-effects from import pathwaysutils. by @copybara-service in #47
  • Add a test for proxy backend registration by @copybara-service in #55
  • Adding debugging utilities by @copybara-service in #57
  • Adding an elastic manager and reshard modules by @copybara-service in #58
  • Update README for Colocated Python Sidecar. by @copybara-service in #60

[0.0.8] - 2024-02-12

  • Disabled JAX's compilation cache
  • Updated Orbax handler to use bulk APIs
  • Updates to support JAX 0.5.0

[0.0.7] - 2024-10-23

  • Updated setup.py to pyproject.toml
  • Added this changelog
  • Added unittests
  • Prepared for PyPI release

[0.0.6] - 2024-10-10

  • Decreased logging severity for most logs
  • Persistence enabled
  • General argument type fixes