September 07, 2025: This Week in OpenDAL

[github-actions[bot]]

This weekly update is generated by LLMs. You're welcome to join our Discord for in-depth discussions.

Overall Activity Summary

The apache/opendal repository has seen robust activity over the past week, with contributors focusing on backend service enhancements, language binding expansions, CI pipeline improvements, and discussions around new features and refactoring. Several PRs have been merged, while others are under active review, showcasing a collaborative and dynamic development environment.

Key Ongoing Projects

• Backend Service Enhancements:

  • feat(services/opfs): add delete/stat support for OPFS #6564 by @crwen adds read/write/delete/list support for OPFS, addressing Enhance OPFS Support: Read/Write, List, and Other #5799.
  • feat(services/oss): allow users to specify endpoint addressing style #6504 by @howardlau1999 introduces endpoint addressing style options for OSS, enhancing user configurability.
  • feat(bindings/ruby): publish ruby binding #6539 by @erickguan publishes Ruby bindings, expanding language support.

• CI Pipeline Modernization:

  • chore(ci): migrate etcd, memcached, redis, and redis-cluster images to new sources #6435 by @kingsword09 migrates CI images for etcd, memcached, and Redis to new sources, ensuring compatibility with Bitnami's upcoming restrictions.

• Language Binding Expansion:

  • feat(bindings/ruby): support file open options #6538 by @erickguan adds file open options for Ruby bindings, improving usability.
  • feat(bindings/python): Add feature groups for selective service building #6497 by @p1skiii introduces feature groups for selective service building in Python bindings.

Priority Items

• Critical Features Awaiting Review:

  • feat(services/opfs): add delete/stat support for OPFS #6564 by @crwen (OPFS enhancements) is vital for extending functionality.
  • feat(services/oss): allow users to specify endpoint addressing style #6504 by @howardlau1999 (OSS endpoint addressing) improves user flexibility.
  • feat(bindings/ruby): publish ruby binding #6539 by @erickguan (Ruby bindings) expands OpenDAL's ecosystem.

• Bug Fixes:

  • fix: Do not trim trailing slash of name_node #6556 by @wForget resolves an issue with trailing slashes in HDFS name nodes.

• Pending Refactor:

  • feat(services/s3): support default_region, server_side_encryption_bucket_key and skip_signature for Arrow object_store compatibility #6531 by @jackye1995 introduces new S3 configurations for compatibility with Apache Arrow's object_store.

Notable Discussions

• Release Planning:

  • [DISCUSS] Release Apache OpenDAL v0.54.1 #6550: @Xuanwo initiated a discussion on releasing Apache OpenDAL v0.54.1, inviting community feedback.

• Python Bindings Dependencies:

  • Enabling dependencies in python bindings #6536: @chitralverma raised questions about enabling services like SFTP, HDFS-native, and FTP in Python bindings.

• Efficient Glob Implementation:

  • new feature: Efficient Client-Side Glob Implementation via Guided Traversal #6535: @chitralverma proposed a guided traversal algorithm for client-side globbing, improving performance for large directories.

Emerging Trends

• Backend Configurability: Several PRs focus on enhancing backend configurability, reflecting a user-centric approach to storage solutions.
• Language Binding Expansion: Updates to Ruby and Python bindings indicate a push to make OpenDAL accessible across diverse programming ecosystems.
• CI Sustainability: Efforts like chore(ci): migrate etcd, memcached, redis, and redis-cluster images to new sources #6435 highlight the community's focus on long-term CI stability and compatibility with external dependencies.

Good First Issues

• new feature: Allow s3 service to configure assume role's tags #4975: Allow S3 service to configure assume role's tags. Introduces contributors to S3 backend configuration and access control.
• Implement Write Returns Metadata for all services #5693: Implement Write Returns Metadata for all services. Start with simpler services like fs to extend metadata extraction.
• new feature: publish the source and lock files for binaries (oli, oay...) #6198: Publish the source and lock files for binaries. Ideal for contributors interested in improving build and release processes.
• Tracking issue: Refactor services to use the backend.rs and core.rs convention #5702: Refactor services to use the backend.rs and core.rs convention. A good entry point for contributors looking to improve code organization.
• Tracking issues of RFC-5479: Context #5480: Refactor services to adopt the new Context convention. This task is approachable and helps improve consistency across the codebase.