Skip to content
This repository was archived by the owner on Nov 1, 2024. It is now read-only.
This repository was archived by the owner on Nov 1, 2024. It is now read-only.

[Arrow] bf16 support in arrow #521

@changhiskhan

Description

@changhiskhan

🚀 The feature, motivation and pitch

We're working on supporting bf16 in lance format, which will be presented as a bf16 extension type in Arrow (see PR for details: lance-format/lance#1002).

We're considering contributing the Arrow extension type as a canonical extension to the Arrow project. Would this be of interest / value to the pytorch community? How would this be integrated into the pytorch library?

If y'all are interested, we could start a discussion thread on Arrow mailing list and chat together?

Alternatives

No response

Additional context

No response

cc @ssnl @VitalyFedyunin @ejguan @dzhulgakov

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions