ModelExpress - Release 0.2.1
Summary
ModelExpress 0.2.1 is a maintenance release focused on stability and critical fixes. This update incorporates backported fixes to ensure a smoother and more reliable deployment experience for users.This release addresses specific issues identified in previous versions—specifically around CI stability, model directory handling, and system observability—and prepares the environment for future feature updates.
Bug Fixes
- Upgraded Rust Version to 1.90: Upgraded the Rust compiler to version 1.90 to resolve continuous integration (CI) issues, ensuring compatibility with the latest Rust features and maintaining build stability 1.
- Ignore Hugging Face Sub-Directories: Updated the system to exclude Hugging Face sub-directories during operations, preventing potential errors and improving compatibility with Hugging Face models 2.
- Improved Logging Mechanism: Enhanced the logging system to provide more detailed and informative logs, facilitating easier debugging and monitoring 3.
Known Limitations
- Aggregated Kubernetes Example Deployment Failure: The
examples/aggregated_k8s/agg.yamlconfiguration file currently fails to deploy with Dynamo 0.7.0. This is due to the deprecation and removal of thepvcfield underspec.services.<serviceName>in the newer Dynamo CRD. Users attempting to deploy this example will encounter astrict decoding error. - Workaround: Update the
agg.yamlfile to adhere to the new API format by defining PVCs at thespec.pvcslevel and referencing them usingspec.services.<name>.volumeMounts.