Skip to content

HybridBackend v0.5.2

Choose a tag to compare

@2sin18 2sin18 released this 02 Dec 09:36
· 69 commits to main since this release
fec2c1e

Objectives:

  • Memory-efficient loading of categorical data
  • Easy to use with existing AI workflows

Features:

  1. Parquet Dataset
    - Reading batch of tensors from numeric fields in zero-copy way
    - Reading batch of sparse tensors from numeric list fields in zero-copy way
    - Support of string fields
    - Support of local filesystem, HDFS, S3 and OSS

  2. Data Pipeline Functions
    - Resizing batch of tensors and ragged tensors
    - Converting ragged tensors to sparse tensors
    - Objective: "Easy to use with existing AI workflows"

  3. Compatibility
    - Support of TensorFlow 1.15 and Tensorflow 1.14
    - GitHub actions for uploading wheels to PyPI

Bug Fixes:

  • [#11][#12][#13] Supports manylinux_2_24 platform.