Skip to content

Commit 5f3c84f

Browse files
authored
add fp8-fbgemm kernels (#86)
* add fp8-fbgemm kernels Signed-off-by: Wang, Yi A <[email protected]> * add license Signed-off-by: Wang, Yi A <[email protected]> --------- Signed-off-by: Wang, Yi A <[email protected]>
1 parent 23bf3fb commit 5f3c84f

File tree

5 files changed

+455
-0
lines changed

5 files changed

+455
-0
lines changed

fp8-fbgemm/build.toml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
[general]
2+
name = "fp8-fbgemm"
3+
universal = true

fp8-fbgemm/flake.lock

Lines changed: 168 additions & 0 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

fp8-fbgemm/flake.nix

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
1+
{
2+
description = "Flake for fp8-fbgemm kernels";
3+
4+
inputs = {
5+
kernel-builder.url = "github:huggingface/kernel-builder";
6+
};
7+
8+
outputs =
9+
{
10+
self,
11+
kernel-builder,
12+
}:
13+
kernel-builder.lib.genFlakeOutputs {
14+
inherit self;
15+
path = ./.;
16+
};
17+
}
Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
from .quantizer import quantize_fp8_per_row
2+
3+
__all__ = [
4+
quantize_fp8_per_row
5+
]

0 commit comments

Comments
 (0)