v0.0.7

Core

• Support for loading and saving HuggingFace's safetensor format
• Transposed quantization matmul kernels
• mlx.core.linalg sub-package with mx.linalg.norm (Frobenius, infininty, p-norms)
• tensordot and repeat

NN

• Layers
  • Bilinear,Identity, InstanceNorm
  • Dropout2D, Dropout3D
  • more customizable Transformer (pre/post norm, dropout)
  • More activations: SoftSign, Softmax, HardSwish, LogSoftmax
  • Configurable scale in RoPE positional encodings
• Losses: hinge, huber, log_cosh

Misc

• Faster GPU reductions for certain cases
• Change to memory allocation to allow swapping