-
Notifications
You must be signed in to change notification settings - Fork 414
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Make LakeSoul as Datafusion's native source & sink, so that LakeSoul can be more easily integrated into Rust ecosystem, like vector.io etc, and Python interface can be refactored based on this to enable both read and write for LakeSoul.
Moreover, standalone Rust source & sink could enable integration with more data ingestion tools including SeaTunnel, Kafka Connect, Logstash and more.
Tasks:
- [Rust][Metadata]Asynchronized rust metadata method #365
- [Rust]DataFusion version upgraded to 33.0.0 #372
- [Rust] Add LakeSoulHashTable Sink for DataFusion #382
- [Rust]fix hash value to spark_murmur3 #385
- Python Interface Refactor
- Java Interface
- Vector.io sink
- Seatunnel sink
- Logstash sink
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request