v0.16.3

🚀

v0.16.2

🚀🚀

0.16.1

🚀

v0.16.0

Highlights

• @mx.custom_function for custom vjp/jvp/vmap transforms
• Up to 2x faster Metal GEMV and fast masked GEMV
  • benchmarks
• Fast hadamard_transform
  • benchmarks

Core

• Metal 3.2 support
• Reduced CPU binary size
• Added quantized GPU ops to JIT
• Faster GPU compilation
• Added grads for bitwise ops + indexing

Bug Fixes

• 1D scatter bug
• Strided sort bug
• Reshape copy bug
• Seg fault in mx.compile
• Donation condition in compilation
• Compilation of accelerate on iOS

v0.15.2

🚀

v0.15.1

🚀

v0.15.0

Highlights

• Fast Metal GPU FFTs
  • On average ~30x faster than CPU
  • More benchmarks
• mx.distributed with all_sum and all_gather

Core

• Added dlpack device __dlpack_device__
• Fast GPU FFTs benchmarks
• Add docs for the mx.distributed
• Add mx.view op

NN

• softmin, hardshrink, and hardtanh activations

Bugfixes

• Fix broadcast bug in bitwise ops
• Allow more buffers for JIT compilation
• Fix matvec vector stride bug
• Fix multi-block sort stride management
• Stable cumprod grad at 0
• Buf fix with race condition in scan

v0.14.1

🚀

v0.14.0

Highlights

• Small-size build that JIT compiles kernels and omits the CPU backend which results in a binary <4MB
  • Series of PRs 1, 2, 3, 4, 5
• mx.gather_qmm quantized equivalent for mx.gather_mm which speeds up MoE inference by ~2x
  • Some numbers
• Grouped 2D convolutions
  • Some numbers

Core

• mx.conjugate
• mx.conv3d and nn.Conv3d
• List based indexing
• Started mx.distributed which uses MPI (if installed) for communication across machines
  • mx.distributed.init
  • mx.distributed.all_gather
  • mx.distributed.all_reduce_sum
• Support conversion to and from dlpack
• mx.linalg.cholesky on CPU
• mx.quantized_matmul sped up for vector-matrix products
• mx.trace
• mx.block_masked_mm now supports floating point masks!

Fixes

• Error messaging in eval
• Add some missing docs
• Scatter index bug
• The extensions example now compiles and runs
• CPU copy bug with many dimensions

v0.13.1

🚀