HybridBackend v0.5.2
Objectives:
- Memory-efficient loading of categorical data
- Easy to use with existing AI workflows
Features:
-
Parquet Dataset
- Reading batch of tensors from numeric fields in zero-copy way
- Reading batch of sparse tensors from numeric list fields in zero-copy way
- Support of string fields
- Support of local filesystem, HDFS, S3 and OSS -
Data Pipeline Functions
- Resizing batch of tensors and ragged tensors
- Converting ragged tensors to sparse tensors
- Objective: "Easy to use with existing AI workflows" -
Compatibility
- Support of TensorFlow 1.15 and Tensorflow 1.14
- GitHub actions for uploading wheels to PyPI
Bug Fixes: