README.md

metadata

title: README
emoji: 🍎
colorFrom: gray
colorTo: blue
sdk: static
pinned: false

NetProjects

Open models, ready to run on Apple Silicon.

We convert and test open models for MLX, so they run locally on a Mac with no cloud and no API keys. We check every build against the original model before it goes up, and we publish speed numbers from real hardware (MacBook Pro M5 Max, 128 GB).

Models

Family	Builds	What it's for
H2O-Lightning 4B	q8 · q4	Small vision-language model from H2O.ai; reads documents and images
IBM Granite Switch 4.1	8B 8-bit · 4-bit — 30B 8-bit · 4-bit	IBM Granite with switchable chat, decision and guardian modes
NVIDIA Nemotron Dory 1.0 4B	8-bit · bf16	Compact NVIDIA-based model for fast local use
AutoTrust JEV 35B	8-bit · 4-bit mixed · 3-bit mixed	AutoTrust decision and classification model
AutoTrust JEV 27B v1.1	8-bit · 4-bit	Decision model with bidirectional prompt reading (custom loader included)

How we build

• Conversions use the standard mlx-lm / mlx-vlm tools; where a model needs custom code, the loader is open source on GitHub.
• Each card says which upstream revision it was built from, how it was quantized and how it was checked, with speed and memory measured on an M5 Max.
• Licences follow the original model.

Code

• h2o-lightning-mlx
• granite-switch-mlx

Also

We also work on small calibrated decision models, fact-checking and content quality for long-running websites, and open-source tooling for small teams.

Spotted a problem or want a model converted? Open a discussion on any model page.