quantization-alternative

Here is 1 public repository matching this topic...

Lossless compression of BF16 LLM weights, outputs bit-identical to the original. MLX on Apple Silicon and NVIDIA GPUs.

compression metal cuda inference gemma mlx huggingface lossless-compression apple-silicon bf16 llm quantization-alternative

To associate your repository with the quantization-alternative topic, visit your repo's landing page and select "manage topics."