File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -8,7 +8,7 @@ A grab-bag of experimental transformer kernels and utilities (mostly PyTorch + T
88
99- ** ` transformer_nuggets/flash ` ** : Triton FlashAttention experiments + masking/bias utilities.
1010- ** ` transformer_nuggets/quant ` ** : NF4 tensor subclass + QLoRA building blocks (pure PyTorch).
11- - ** ` transformer_nuggets/fp8 ` ** : FP8 casting / scaled-quantization kernels (Triton).
11+ - ** ` transformer_nuggets/fp8 ` ** : FP8 casting / scaled-quantization kernels (Triton). Try helion :)
1212- ** ` transformer_nuggets/cute ` ** : CUTE DSL experiments and tooling (includes an intra-kernel profiler).
1313- ** ` transformer_nuggets/misc ` ** : Odds and ends (e.g. attention wrappers, utilities).
1414- ** ` transformer_nuggets/llama ` ** : LLaMA-ish model + training/finetune scripts (research-grade).
You can’t perform that action at this time.
0 commit comments