Skip to content

Commit 8a5f42c

Browse files
committed
[circle-schema] Add MX dtype restrictions comment
This commit adds comprehensive comments documenting current restrictions for MX dtypes (MXFP4, MXINT8) in the circle schema. ONE-DCO-1.0-Signed-off-by: Hyeongseok Oh <hseok82.oh@samsung.com>
1 parent 5b5a249 commit 8a5f42c

3 files changed

Lines changed: 15 additions & 0 deletions

File tree

nnpackage/schema/circle_schema.fbs

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -87,6 +87,11 @@ enum TensorType : byte {
8787
GGML_Q8_1 = -5,
8888

8989
// MX dtypes
90+
// Current restrictions of MX dtypes
91+
// - MX dtypes are not used for model I/O
92+
// - MX dtypes are used for activations, not for constant inputs (ex. weight)
93+
// - Model does not have MX dtype's parameters (block size, exponent scale, etc).
94+
// Backend should define and use internally if needed
9095
MXFP4 = -6,
9196
MXINT8 = -7,
9297
}

res/CircleSchema/0.10/circle_schema.fbs

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -87,6 +87,11 @@ enum TensorType : byte {
8787
GGML_Q8_1 = -5,
8888

8989
// MX dtypes
90+
// Current restrictions of MX dtypes
91+
// - MX dtypes are not used for model I/O
92+
// - MX dtypes are used for activations, not for constant inputs (ex. weight)
93+
// - Model does not have MX dtype's parameters (block size, exponent scale, etc).
94+
// Backend should define and use internally if needed
9095
MXFP4 = -6,
9196
MXINT8 = -7,
9297
}

runtime/libs/circle-schema/circle_schema.fbs

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -87,6 +87,11 @@ enum TensorType : byte {
8787
GGML_Q8_1 = -5,
8888

8989
// MX dtypes
90+
// Current restrictions of MX dtypes
91+
// - MX dtypes are not used for model I/O
92+
// - MX dtypes are used for activations, not for constant inputs (ex. weight)
93+
// - Model does not have MX dtype's parameters (block size, exponent scale, etc).
94+
// Backend should define and use internally if needed
9095
MXFP4 = -6,
9196
MXINT8 = -7,
9297
}

0 commit comments

Comments
 (0)