Skip to content

Commit 75cea34

Browse files
committed
More readme
1 parent db22649 commit 75cea34

File tree

1 file changed

+7
-1
lines changed

1 file changed

+7
-1
lines changed

examples/mlp-mpi/README.md

Lines changed: 7 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,10 @@
1-
# Computing a MLP sigmoid(A@B)@C on multiple ranks using MPI through MLIR
1+
# Computing an MLP sigmoid(A@B)@C on multiple ranks using MPI through MLIR
2+
3+
This example shows how MLIR's sharding infrastructure can be used to distribute data and computation across multiple nodes with non-shared memory.
4+
5+
Currently, only the lower part of the sharding pipeline is used: `shard-partition`, `convert-shard-to-mpi`, and lowering to LLVM. Therefore, the ingress MLIR is fully annotated.
6+
7+
The example implements a "single MLP", following a 1D/2D weight-stationary partition strategy as described in figures 2a and 2b of https://arxiv.org/pdf/2211.05102.
28

39
## Prerequisites
410

0 commit comments

Comments
 (0)