December 28, 2025: This Week in OpenDAL

[github-actions[bot]]

This weekly update is generated by LLMs. You're welcome to join our Discord for in-depth discussions.

Overall Activity Summary

The Apache OpenDAL repository has seen significant activity this week, with a focus on refactoring services and layers into separate crates as part of the RFC-6828 core split initiative. Contributors have also worked on new features, bug fixes, and performance improvements across multiple areas, including bindings, caching layers, and service-specific enhancements. Discussions around upcoming releases and cross-language FFI integration have also gained traction.

Key Ongoing Projects

• Core Split Initiative:

  • Multiple services and layers have been refactored into standalone crates, improving modularity and maintainability. Examples include refactor(services/mongodb): split mongodb service into separate crate #7079 and refactor(services/rocksdb): split rocksdb service as a crate #7081 by @PiyushXCoder and @KarinaMilet, respectively.
  • The MongoDB service (refactor(services/mongodb): split mongodb service into separate crate #7079) and RocksDB service (refactor(services/rocksdb): split rocksdb service as a crate #7081) were successfully split into independent crates, preserving public APIs.
  • The DTrace layer (refactor(layers/dtrace): split dtrace layer into separate crate #7078) was refactored into a standalone crate by @PiyushXCoder.

• Cache Layer Development:

  • Work continues on implementing a robust caching layer for OpenDAL, with contributions such as feat(layers): implement CacheLayer #7108 and RFC-6297: Cache Layer #6297 by @koushiro.

• Performance Enhancements:

  • The Java bindings received a significant performance boost for OperatorInputStream (feat(bindings/java): Speed up the performance of OperatorInputStream #7088) by @Xuanwo, with follow-up fine-tuning in chore: fine tune OperatorInputStream #7089 by @tisonkun.

• New Features:

  • The HotpathLayer was introduced (feat(layers/hotpath): add HotpathLayer integration #7083) by @PsiACE, enabling profiling of operations with the hotpath crate.
  • Support for user-defined metadata was added to the WebDAV (feat(services/webdav): Add user defined metadata support #7074) and Upyun (feat(services/upyun): Add user_metadata support #7068) services by @userzhy.

Priority Items

• Open Pull Requests:

  • feat(layers): implement CacheLayer #7108 by @koushiro: Implementation of the Cache Layer, part of the ongoing caching initiative. Needs review and feedback.
  • fix(core): skip PermissionDenied errors in recursive lister #7096 by @userzhy: Fix for recursive lister behavior when encountering PermissionDenied errors. Requires testing and validation.
  • make sure CompleteWriter is enforcing the right invariants #7056 by @carlsverre: Updates to CompleteWriter for enforcing invariants. Needs further review.

• Critical Issues:

  • bug: Onedrive service list("/") returns empty result due to incorrect URL construction #7102 by @fadflka: Bug in OneDrive service where list("/") returns an empty result due to incorrect URL construction.
  • bug: Recursive lister stops iteration after encountering PermissionDenied error #7095 by @cjlee38: Recursive lister stops iteration after encountering PermissionDenied errors, impacting usability.
  • bug: opendal-java is not available on musl #7086 by @Xuanwo: Java bindings fail on musl-based environments due to missing shared libraries.

Notable Discussions

• Cross-language FFI Integration (Cross-language FFI #7103): @gatesn initiated a discussion on enabling OpenDAL clients configured in Python to be passed to Rust libraries using PyO3, fostering interoperability.
• Release Planning ([DISCUSS] Release Apache OpenDAL v0.56.0 #7092): @Xuanwo proposed releasing Apache OpenDAL v0.56.0, inviting community feedback on the change list and release process.

Emerging Trends

• Refactoring Focus: The ongoing core split initiative is driving a major restructuring of the repository, with services and layers being moved into standalone crates for better modularity.
• Increased Collaboration: Contributors are actively engaging in discussions and collaborating across issues and pull requests, reflecting a vibrant and growing community.
• Performance Optimization: Several PRs focused on improving performance, particularly in bindings and layer implementations.

Good First Issues

• Tracking issues for RFC-6828: Core #6829: Tracking issues for RFC-6828 (Core Split Initiative). This issue provides detailed steps for splitting services and layers into standalone crates, making it an excellent entry point for new contributors.
• Implement Write Returns Metadata for all services #5693: Implement Write Returns Metadata for all services. Contributors can help extend this feature to services like Azfile, B2, and GDrive by extracting relevant metadata from write responses.
• Tracking issues of RFC: Object Versioning #2611: Tracking issues of RFC: Object Versioning. New contributors can help implement object versioning for services like Azblob, B2, and GCS.
• Tracking issues of RFC-5479: Context #5480: Tracking issues of RFC-5479 (Context). This issue focuses on migrating OpenDAL to a context-based approach, with tasks available for various layers.

We encourage new contributors to explore these issues and join the OpenDAL community to make an impact!