Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,10 +1,48 @@
|
|
| 1 |
---
|
| 2 |
title: README
|
| 3 |
-
emoji:
|
| 4 |
-
colorFrom:
|
| 5 |
-
colorTo:
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
title: README
|
| 3 |
+
emoji: 🍎
|
| 4 |
+
colorFrom: gray
|
| 5 |
+
colorTo: blue
|
| 6 |
sdk: static
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# NetProjects
|
| 11 |
+
|
| 12 |
+
**Open models, ready to run on Apple Silicon.**
|
| 13 |
+
|
| 14 |
+
We convert and test open models for [MLX](https://github.com/ml-explore/mlx),
|
| 15 |
+
so they run locally on a Mac with no cloud and no API keys. We check every
|
| 16 |
+
build against the original model before it goes up, and we publish speed
|
| 17 |
+
numbers from real hardware (MacBook Pro M5 Max, 128 GB).
|
| 18 |
+
|
| 19 |
+
## Models
|
| 20 |
+
|
| 21 |
+
| Family | Builds | What it's for |
|
| 22 |
+
|---|---|---|
|
| 23 |
+
| **H2O-Lightning 4B** | [q8](https://huggingface.co/netprojects/h2o-lightning-4b-mlx-q8) · [q4](https://huggingface.co/netprojects/h2o-lightning-4b-mlx-q4) | Small vision-language model from H2O.ai; reads documents and images |
|
| 24 |
+
| **IBM Granite Switch 4.1** | 8B [8-bit](https://huggingface.co/netprojects/granite-switch-4.1-8b-mlx-8bit) · [4-bit](https://huggingface.co/netprojects/granite-switch-4.1-8b-mlx-4bit) — 30B [8-bit](https://huggingface.co/netprojects/granite-switch-4.1-30b-mlx-8bit) · [4-bit](https://huggingface.co/netprojects/granite-switch-4.1-30b-mlx-4bit) | IBM Granite with switchable chat, decision and guardian modes |
|
| 25 |
+
| **NVIDIA Nemotron Dory 1.0 4B** | [8-bit](https://huggingface.co/netprojects/nemotron-dory1.0-4b-mlx-8bit) · [bf16](https://huggingface.co/netprojects/nemotron-dory1.0-4b-mlx-bf16) | Compact NVIDIA-based model for fast local use |
|
| 26 |
+
| **AutoTrust JEV 35B** | [8-bit](https://huggingface.co/netprojects/JEV-35B-mlx-8bit) · [4-bit mixed](https://huggingface.co/netprojects/JEV-35B-mlx-4bit-mixed) · [3-bit mixed](https://huggingface.co/netprojects/JEV-35B-mlx-3bit-mixed) | AutoTrust decision and classification model |
|
| 27 |
+
| **AutoTrust JEV 27B v1.1** | [8-bit](https://huggingface.co/netprojects/AutoTrust-JEV-27B-v1.1-mlx-8bit) · [4-bit](https://huggingface.co/netprojects/AutoTrust-JEV-27B-v1.1-mlx-4bit) | Decision model with bidirectional prompt reading (custom loader included) |
|
| 28 |
+
|
| 29 |
+
## How we build
|
| 30 |
+
|
| 31 |
+
- Conversions use the standard `mlx-lm` / `mlx-vlm` tools; where a model
|
| 32 |
+
needs custom code, the loader is open source on GitHub.
|
| 33 |
+
- Each card says which upstream revision it was built from, how it was
|
| 34 |
+
quantized and how it was checked, with speed and memory measured on an M5 Max.
|
| 35 |
+
- Licences follow the original model.
|
| 36 |
+
|
| 37 |
+
## Code
|
| 38 |
+
|
| 39 |
+
- [h2o-lightning-mlx](https://github.com/internet-projects/h2o-lightning-mlx)
|
| 40 |
+
- [granite-switch-mlx](https://github.com/internet-projects/granite-switch-mlx)
|
| 41 |
+
|
| 42 |
+
## Also
|
| 43 |
+
|
| 44 |
+
We also work on small calibrated decision models, fact-checking and
|
| 45 |
+
content quality for long-running websites, and open-source tooling
|
| 46 |
+
for small teams.
|
| 47 |
+
|
| 48 |
+
Spotted a problem or want a model converted? Open a discussion on any model page.
|