Paris99 commited on
Commit
bf88e51
·
verified ·
1 Parent(s): 08bb4e0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -4
README.md CHANGED
@@ -1,10 +1,48 @@
1
  ---
2
  title: README
3
- emoji: 🏃
4
- colorFrom: yellow
5
- colorTo: green
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  title: README
3
+ emoji: 🍎
4
+ colorFrom: gray
5
+ colorTo: blue
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
+ # NetProjects
11
+
12
+ **Open models, ready to run on Apple Silicon.**
13
+
14
+ We convert and test open models for [MLX](https://github.com/ml-explore/mlx),
15
+ so they run locally on a Mac with no cloud and no API keys. We check every
16
+ build against the original model before it goes up, and we publish speed
17
+ numbers from real hardware (MacBook Pro M5 Max, 128 GB).
18
+
19
+ ## Models
20
+
21
+ | Family | Builds | What it's for |
22
+ |---|---|---|
23
+ | **H2O-Lightning 4B** | [q8](https://huggingface.co/netprojects/h2o-lightning-4b-mlx-q8) · [q4](https://huggingface.co/netprojects/h2o-lightning-4b-mlx-q4) | Small vision-language model from H2O.ai; reads documents and images |
24
+ | **IBM Granite Switch 4.1** | 8B [8-bit](https://huggingface.co/netprojects/granite-switch-4.1-8b-mlx-8bit) · [4-bit](https://huggingface.co/netprojects/granite-switch-4.1-8b-mlx-4bit) — 30B [8-bit](https://huggingface.co/netprojects/granite-switch-4.1-30b-mlx-8bit) · [4-bit](https://huggingface.co/netprojects/granite-switch-4.1-30b-mlx-4bit) | IBM Granite with switchable chat, decision and guardian modes |
25
+ | **NVIDIA Nemotron Dory 1.0 4B** | [8-bit](https://huggingface.co/netprojects/nemotron-dory1.0-4b-mlx-8bit) · [bf16](https://huggingface.co/netprojects/nemotron-dory1.0-4b-mlx-bf16) | Compact NVIDIA-based model for fast local use |
26
+ | **AutoTrust JEV 35B** | [8-bit](https://huggingface.co/netprojects/JEV-35B-mlx-8bit) · [4-bit mixed](https://huggingface.co/netprojects/JEV-35B-mlx-4bit-mixed) · [3-bit mixed](https://huggingface.co/netprojects/JEV-35B-mlx-3bit-mixed) | AutoTrust decision and classification model |
27
+ | **AutoTrust JEV 27B v1.1** | [8-bit](https://huggingface.co/netprojects/AutoTrust-JEV-27B-v1.1-mlx-8bit) · [4-bit](https://huggingface.co/netprojects/AutoTrust-JEV-27B-v1.1-mlx-4bit) | Decision model with bidirectional prompt reading (custom loader included) |
28
+
29
+ ## How we build
30
+
31
+ - Conversions use the standard `mlx-lm` / `mlx-vlm` tools; where a model
32
+ needs custom code, the loader is open source on GitHub.
33
+ - Each card says which upstream revision it was built from, how it was
34
+ quantized and how it was checked, with speed and memory measured on an M5 Max.
35
+ - Licences follow the original model.
36
+
37
+ ## Code
38
+
39
+ - [h2o-lightning-mlx](https://github.com/internet-projects/h2o-lightning-mlx)
40
+ - [granite-switch-mlx](https://github.com/internet-projects/granite-switch-mlx)
41
+
42
+ ## Also
43
+
44
+ We also work on small calibrated decision models, fact-checking and
45
+ content quality for long-running websites, and open-source tooling
46
+ for small teams.
47
+
48
+ Spotted a problem or want a model converted? Open a discussion on any model page.