June 15, 2025: This Week in OpenDAL

[github-actions[bot]]

This weekly update is generated by LLMs. You're welcome to join our Discord for in-depth discussions.

---

Overall Activity Summary

The Apache OpenDAL repository has seen significant activity over the past week, with contributions focused on enhancing language bindings, improving CI workflows, and adding new features such as presign options and caching layers. A total of 30 pull requests were opened or updated, with several merged, and 15 issues were actively discussed or resolved. Notable discussions revolved around governance, feature proposals, and bug fixes.

---

Key Ongoing Projects

• Presign Options API Expansion:

  • feat(core): Expose presign_xxx_options API #6273 by @geruh adds presign_xxx_options API methods, enabling detailed options for presigned URLs across supported services.
  • Tracking issue Tracking issues of presign options support across all backends #6274 highlights gaps in presign option support for services like S3, Azure, and B2.

• Language Bindings Enhancements:

  • Node.js bindings are being migrated to the new Options API (Tracking issues for migrating Node.js bindings to RFC-6213 Options API #6281). @kingsword09 contributed feat(bindings/nodejs): Add StatOptions support for new options API #6282 to add StatOptions support.
  • Python bindings received updates in feat(bindings/python): Enhance Stat, Lister, Metadata & Entry  #6232 by @chitralverma to enhance Stat, Lister, and Metadata.

• Refactoring and CI Improvements:

  • CI workflows were streamlined in ci(bindings/go): simplify and improve Go bindings test infrastructure #6293 by @yuchanns to simplify Go bindings testing infrastructure.
  • Refactoring efforts include refactor: Migrate redis from adapter::kv to Access instead #6291 by @Xuanwo to migrate Redis from adapter::kv to Access.

• Caching Layer Development:

  • feat(layers): add fastmetrics layer #6269 by @koushiro introduces a new metrics layer implementation using fastmetrics.

---

Priority Items

• Critical Bug Fixes:

  • bug: issue with http service #6289: HTTP service fails to read remote XLSX files correctly. Needs investigation and resolution.
  • bug: HDFS write failure may cause infinite loop in HdfsWriter::write #6288: HDFS write failures may cause infinite loops in HdfsWriter::write. @oven-yang has volunteered to submit a fix.
  • bug: cos test failed for dir should be found in list, but only got #6278: COS async list tests are failing due to missing directory entries.

• Feature Enhancements:

  • Tracking issues of migrating adapter based services #5739: Migration of adapter-based services to Access. Redis migration (refactor: Migrate redis from adapter::kv to Access instead #6291) is complete, but other services remain pending.
  • Tracking issues of presign options support across all backends #6274: Address gaps in presign option support across all backends.

---

Notable Discussions

• Governance Vote:

  • [VOTE] Accept Reqsign as part of OpenDAL PMC #6261: Proposal to accept Reqsign as part of OpenDAL PMC. The vote passed successfully ([RESULT][VOTE] Accept Reqsign as part of OpenDAL PMC #6277).

• ASF Board Report:

  • Proposal of ASF Board Report for 2025-06 #6276: Draft report for June 2025 highlights OpenDAL's strong community health and development velocity.

• Lister Enhancements:

  • new feature: suggestions for Lister #6272: Suggestions by @chitralverma to improve Lister and Entry API with options for metadata retrieval and better naming conventions.

---

Emerging Trends

• Focus on Language Bindings:

  • Contributors are actively improving bindings for Node.js, Python, and Go. This reflects a growing emphasis on cross-language support.

• Presign Functionality:

  • Expanding presign options across services is a recurring theme, with contributors working to ensure feature parity and usability.

• Refactoring for Scalability:

  • Migration of services to Access and adoption of modular conventions (e.g., backend.rs and core.rs) are aimed at improving maintainability.

---

Good First Issues

• new feature: cpp binding enable feature by user #6250: Enable feature flags in C++ bindings. Ideal for contributors familiar with C++ and OpenDAL's architecture.
• new feature: publish the source and lock files for binaries (oli, oay...) #6198: Publish source and lock files for binaries like oli. A straightforward task for contributors interested in packaging and deployment.
• Tracking issue: Refactor services to use the backend.rs and core.rs convention #5702: Refactor services to adopt the backend.rs and core.rs convention. Suitable for contributors looking to improve code organization.
• Implement Write Returns Metadata for all services #5693: Implement "Write Returns Metadata" for services. Contributors can start with simpler services like fs or s3.
• Tracking issues of RFC-5479: Context #5480: Context implementation tracking. A good entry point for contributors interested in core OpenDAL functionality.

---

Encourage new contributors to explore these issues and join the community!