Skip to content

[FEATURE]: Support Non-inplace Tensor Sharding #4017

Open
@FrankLeeeee

Description

@FrankLeeeee

Describe the feature

The current API in shardformer such as shard_rowwise and shard_colwise will shard the tensor in place. This might cause unwanted usage, therefore, we should support non-inplace sharding.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions