Azure EventHubs connector for Apache Spark Roadmap

Many changes are already about to be merged - see What's new in the latest connector? for more details on that!

Features on our radar

• back pressure support
• preferred location (i.e. locality of task assignment for a given partition)
• once we have locality, we can start re-using the EventHub receiver pre-fetch queues across batches. This would require receiver pooling.
• Continued removal of out-of-date documentation on Azure docs and out-of-date repos on GitHub.

Service side features

These are features that we're interested in for the EventHubs service that will improve the quality of this library. No timeline exists for these features just yet!

• Service-side checkpoints
• Idempotent sends

If there is anything you'd like to see added to this list, please open an issue. 👍 Or, better yet! Join our gitter chat.