You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This weekly update is generated by LLMs. You're welcome to join our Discord for in-depth discussions.
Overall Activity Summary
This week, the Apache OpenDAL repository saw a steady flow of contributions, including feature implementations, bug fixes, and discussions around enhancing the project. Key highlights include the addition of new features like chunked caching in the Foyer Layer, migration of services to reqsign-core v2, and improvements to WASI compatibility. Several PRs were merged, and new issues were raised to track ongoing enhancements and bug fixes.
Key Ongoing Projects
Chunked Cache Mode for Foyer Layer (feat(foyer-layer): add chunked cache mode #7170) @flaneur2020 introduced a chunked caching mode to improve efficiency for large files with partial reads. This feature enables caching fixed-size chunks independently, optimizing performance for range queries.
Azure Blob Storage API Compatibility (ci: skip azurite's version check #7162)
Azurite-based behavior tests are failing due to unsupported API versions. @meteorgan addressed this by skipping the version check in CI.
Tracking Issues for reqsign-core v2 Migration (Tracking issues for reqsign-core v2 #6553)
Migration of services like Azblob, GCS, and others to reqsign-core v2 is ongoing. Contributors are encouraged to assist with this effort.
Notable Discussions
Per-Operation Timeout Configuration (new feature: provide timeout for each operation #7168) @dentiny proposed adding per-operation timeout settings to better handle operations like list and read. This sparked discussions on how to implement fine-grained timeout controls.
Focus on Modularization: The migration to reqsign-core v2 and splitting services into independent crates reflect a trend toward modular and maintainable architecture.
WASI Compatibility: Efforts to make OpenDAL compatible with WASI targets highlight the growing importance of supporting diverse runtime environments.
Enhanced Cloud Integration: Features like AWS container credentials and Azure Blob Storage improvements indicate a focus on seamless cloud service integration.
Implement Write Returns Metadata for All Services (Implement Write Returns Metadata for all services #5693)
Contributors can help extend the Write Returns Metadata feature to additional services like Azblob, GCS, and OSS. This task involves extracting metadata from write responses.
Tracking Issues for RFC-6828: Core (Tracking issues for RFC-6828: Core #6829)
Contributors can assist in splitting services and layers into independent crates, improving modularity and maintainability.
We welcome new contributors to join these efforts and help shape the future of OpenDAL!
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
This weekly update is generated by LLMs. You're welcome to join our Discord for in-depth discussions.
Overall Activity Summary
This week, the Apache OpenDAL repository saw a steady flow of contributions, including feature implementations, bug fixes, and discussions around enhancing the project. Key highlights include the addition of new features like chunked caching in the Foyer Layer, migration of services to
reqsign-core v2, and improvements to WASI compatibility. Several PRs were merged, and new issues were raised to track ongoing enhancements and bug fixes.Key Ongoing Projects
Chunked Cache Mode for Foyer Layer (feat(foyer-layer): add chunked cache mode #7170)
@flaneur2020 introduced a chunked caching mode to improve efficiency for large files with partial reads. This feature enables caching fixed-size chunks independently, optimizing performance for range queries.
Migration to
reqsign-core v2(refactor: Migrate oss to reqsign core v2 #7165, refactor(services/obs): migrate obs to reqsign-core v2 #7169)@Xuanwo and @koushiro are actively migrating services like OSS and OBS to the new
reqsign-core v2, which improves credential handling and aligns with the latest library updates.WASI Compatibility Enhancements (feat(core): make reqwest/tokio optional and fix WASI compatibility #7156)
@JMLX42 worked on making
reqwestandtokiooptional, enabling OpenDAL to compile for WASI targets. This includes fixing compatibility issues and adding a CI job for WASI-specific builds.AWS Container Credentials Support (feat(services/s3): Add AWS container credentials support for ECS and EKS Pod Identity #7166)
@rohankmr414 added support for AWS container credentials, enabling authentication in ECS and EKS environments. This includes new configuration fields and integration with the credential chain.
Priority Items
Bug: Tests Failing on Fedora (bug: tests:assert_size fails on Fedora #7158)
A test (
assert_size) fails on Fedora due to differences in struct sizes across toolchains. This issue has been resolved by removing the test in test(core): remove assert_size tests #7167 by @Xuanwo.Azure Blob Storage API Compatibility (ci: skip azurite's version check #7162)
Azurite-based behavior tests are failing due to unsupported API versions. @meteorgan addressed this by skipping the version check in CI.
Tracking Issues for
reqsign-core v2Migration (Tracking issues for reqsign-core v2 #6553)Migration of services like Azblob, GCS, and others to
reqsign-core v2is ongoing. Contributors are encouraged to assist with this effort.Notable Discussions
Per-Operation Timeout Configuration (new feature: provide timeout for each operation #7168)
@dentiny proposed adding per-operation timeout settings to better handle operations like
listandread. This sparked discussions on how to implement fine-grained timeout controls.AWS Container Credential Provider (new feature: support AWS Container credential provider #4903)
@Samrose-Ahmed raised the need for supporting AWS container credentials for ECS environments, which has now been addressed in feat(services/s3): Add AWS container credentials support for ECS and EKS Pod Identity #7166 by @rohankmr414.
Emerging Trends
reqsign-core v2and splitting services into independent crates reflect a trend toward modular and maintainable architecture.Good First Issues
Allow S3 Service to Configure Assume Role's Duration-Seconds (new feature: Allow s3 service to configure assume role's duration-seconds #4976)
This issue involves adding support for configuring the duration of assume-role sessions in S3. It's a straightforward enhancement for contributors familiar with AWS.
Implement
Write Returns Metadatafor All Services (ImplementWrite Returns Metadatafor all services #5693)Contributors can help extend the
Write Returns Metadatafeature to additional services like Azblob, GCS, and OSS. This task involves extracting metadata from write responses.Tracking Issues for RFC-6828: Core (Tracking issues for RFC-6828: Core #6829)
Contributors can assist in splitting services and layers into independent crates, improving modularity and maintainability.
We welcome new contributors to join these efforts and help shape the future of OpenDAL!
Beta Was this translation helpful? Give feedback.
All reactions