Spaces:
Running
Running
New org mission: open weights, no matter what
Browse files
README.md
CHANGED
|
@@ -8,37 +8,44 @@ pinned: false
|
|
| 8 |
|
| 9 |
# Vertex Research
|
| 10 |
|
| 11 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
## What we do
|
| 14 |
|
| 15 |
-
|
|
|
|
|
|
|
| 16 |
|
| 17 |
## Models
|
| 18 |
|
| 19 |
-
|
| 20 |
| Model | Parameters | Status |
|
| 21 |
|-------|------------|--------|
|
| 22 |
-
| Vertex 0.6
|
| 23 |
-
| Vertex 0.6
|
| 24 |
-
| Vertex 0.1
|
| 25 |
|
| 26 |
More sizes and versions are on the way. Follow the org to stay updated.
|
| 27 |
|
| 28 |
## In training
|
| 29 |
|
| 30 |
-
- Vertex 0.6
|
| 31 |
-
- Vertex 0.6
|
|
|
|
|
|
|
| 32 |
|
| 33 |
-
## Vertex 0.6 models to train
|
| 34 |
(Top model is the next to train)
|
| 35 |
|
| 36 |
-
- [ ]
|
| 37 |
-
- [ ]
|
| 38 |
-
- [ ]
|
| 39 |
-
- [ ]
|
| 40 |
-
- [ ] 35m
|
| 41 |
|
| 42 |
---
|
| 43 |
|
| 44 |
-
*Vertex Research: small models, sharp edges.*
|
|
|
|
| 8 |
|
| 9 |
# Vertex Research
|
| 10 |
|
| 11 |
+
**Open weights, no matter what.**
|
| 12 |
+
|
| 13 |
+
Vertex Research exists for one reason: to make sure open weight models keep getting made. As frontier labs release fewer and fewer open models, we train our own — from scratch, fully open, Apache 2.0 — so that anyone can always download, run, study, and build on a model that nobody can take away.
|
| 14 |
+
|
| 15 |
+
## Why
|
| 16 |
+
|
| 17 |
+
The industry is drifting toward closed APIs. Weights that used to be published now stay behind endpoints. If that trend continues, the ability to run a model on your own machine — offline, private, forever — depends on groups that keep releasing weights anyway. We intend to be one of them.
|
| 18 |
|
| 19 |
## What we do
|
| 20 |
|
| 21 |
+
- Train compact language models from scratch and release every usable artifact: base, instruct, and reasoning variants, plus GGUF quantizations for llama.cpp.
|
| 22 |
+
- Keep everything Apache 2.0. No gated downloads, no acceptance forms, no API-only releases.
|
| 23 |
+
- Document what worked and what didn't, so others can train their own.
|
| 24 |
|
| 25 |
## Models
|
| 26 |
|
|
|
|
| 27 |
| Model | Parameters | Status |
|
| 28 |
|-------|------------|--------|
|
| 29 |
+
| Vertex 0.6 100M | 100M | Released (base 1024–8192 ctx, instruct, GGUF) |
|
| 30 |
+
| Vertex 0.6 35M | 35M | Released |
|
| 31 |
+
| Vertex 0.1 10M | 10M | Released |
|
| 32 |
|
| 33 |
More sizes and versions are on the way. Follow the org to stay updated.
|
| 34 |
|
| 35 |
## In training
|
| 36 |
|
| 37 |
+
- Vertex 0.6 100M plus (annealed, benchmark-tuned)
|
| 38 |
+
- Vertex 0.6 200M preview
|
| 39 |
+
|
| 40 |
+
## Roadmap
|
| 41 |
|
|
|
|
| 42 |
(Top model is the next to train)
|
| 43 |
|
| 44 |
+
- [ ] 200M preview
|
| 45 |
+
- [ ] 15M (multi-turn chat focus)
|
| 46 |
+
- [ ] 10M
|
| 47 |
+
- [ ] 50M
|
|
|
|
| 48 |
|
| 49 |
---
|
| 50 |
|
| 51 |
+
*Vertex Research: small models, sharp edges, weights you keep.*
|