Search results

What the dtype of input in Float8Linear backward?

questionFurther information is requestedFurther information is requested

Status: Open.

#1850 In pytorch/ao;

· yh8899 opened on Mar 7, 2025

Bias quantization for prequantized checkpoints

enhancementNew feature or requestNew feature or request

quantize

Status: Open.

#1821 In pytorch/ao;

· jackzhxng opened on Mar 3, 2025

TorchAo autoquant + hugging face breaks on Load

Status: Open.

#1819 In pytorch/ao;

· drisspg opened on Mar 3, 2025

Status of prototype features

rfc

topic: deprecationUse this tag if this PR deprecates a featureUse this tag if this PR deprecates a feature

tracker

Status: Open.

#1807 In pytorch/ao;

· msaroufim opened on Mar 1, 2025

What kind of layers are optimized by torchao on a RTX 4090?

performance

questionFurther information is requestedFurther information is requested

Status: Open.

#1805 In pytorch/ao;

· naiveen opened on Mar 1, 2025

New Pytorch Triton breaks custom cast kernel MX

mx

Status: Open.

#1799 In pytorch/ao;

· drisspg opened on Feb 28, 2025

An error was encountered setting torch._dynamo.decorators.mark_unbacked

quantize

questionFurther information is requestedFurther information is requested

triaged

Status: Open.

#1790 In pytorch/ao;

· songh11 opened on Feb 27, 2025

mx cast to mxfp8 across dim0 and dim1 should be performant

mx

triaged

Status: Open.

#1788 In pytorch/ao;

· vkuzo opened on Feb 26, 2025

error in using torchao and torch compile on rtx 4090

autoquant

bugSomething isn't workingSomething isn't working

performance

quantize

Status: Open.

#1775 In pytorch/ao;

· zhangvia opened on Feb 25, 2025

torch.compile cast to mxfp8 with blocked scales should be performant

Status: Open.

#1773 In pytorch/ao;

· vkuzo opened on Feb 24, 2025

MX single node performance tracker

Status: Open.

#1768 In pytorch/ao;

· vkuzo opened on Feb 24, 2025

The cpython structures(e.g. Py_buffer) are excluded, compiling failed (e.g.ao/torchao/csrc/cuda/tensor_core_tiled_layout/tensor_core_tiled_layout.cu)

build

Status: Open.

#1767 In pytorch/ao;

· codereba opened on Feb 24, 2025