OLake roadmap

[zriyanshdz]

Hello everyone! We’re thrilled to share our open-source roadmap for Olake, starting from April 2025. This overview highlights upcoming connectors, integrations, and platform enhancements. As this is a living document, changes may occur based on community feedback and evolving project priorities.

We’d love your thoughts on:

• Which features you’d like to see prioritized
• Areas that might need extra attention or rethinking
• Any potential contributions you’d be interested in making

Your input is valuable, so feel free to comment below!

Roadmap (April 2025 – October 2025)

Quarter	Roadmap Items & Descriptions
Q2 2025	Scalability & Orchestration • Scaling & Vertical Scaling – Enhancing performance and stability for heavier workloads • Orchestration Support – Basic internal scheduling and coordination of data tasks • Scalability Optimization – Further refinements to concurrency and throughput UI repo & Connectors • UI/Configurator – A more intuitive setup and configuration interface • MySQL Connector Optimization – Improved chunking/parallelism for faster, more stable data ingestion • S3 issue /Kafka issue Connector – A stable bridge for streaming data into or out of S3/Kafka Observability & Compliance • Monitoring & Alerting – Initial health checks and real-time notifications Data & Storage • Iceberg Go/Rust Writer issue – Exploring Go and Rust for flexible Iceberg write operations • Compaction Research – Investigations into reducing fragmentation and boosting query performance
Q3 2025	Continuing Enhancements • Compaction Research (Continued) – Ongoing study of methods to reduce storage overhead and improve speed • S3 / Kafka Connector (Continued) – Additional development and refinements for specialized streaming needs

Note: This roadmap may be revised based on community feedback or shifting priorities. Please share your ideas or contributions in the discussion!

How to Contribute

1. Suggest Changes: Share your ideas, concerns, or feature requests in this discussion.
2. Open Issues: If a particular item intrigues you or you’ve got an alternate approach, open a GitHub Issue to start a more focused conversation.
3. Submit PRs: We wholeheartedly welcome pull requests! If you’re ready to code, open a PR referencing the roadmap item you’re tackling.

Feedback & Discussion Points

1. Feature Prioritization: Which of the roadmap items should be at the top of our list, based on your needs or experiences?
2. Technical Feedback: Have suggestions for frameworks, libraries, or best practices we could adopt?
3. Missing Features: Is there anything crucial you’d like to see added to the roadmap?
4. Community Resources: Would supporting documentation, tutorials, or sample projects make Olake easier to adopt?

Closing Thoughts

We’re excited to collaborate with the community to make Olake even more powerful and flexible. Please leave your comments, ideas, or questions below. Thank you for being part of the journey!