REZIRETSA commited on
Commit
8cd40d1
Β·
verified Β·
1 Parent(s): 51ad3a4

Add company details + tokenizer/model benchmarks to org card

Browse files
Files changed (1) hide show
  1. README.md +22 -17
README.md CHANGED
@@ -1,17 +1,22 @@
1
- ---
2
- title: ASTERIZER
3
- emoji: πŸš€
4
- colorFrom: gray
5
- colorTo: gray
6
- sdk: static
7
- pinned: false
8
- ---
9
-
10
- # ASTERIZER
11
-
12
- **Building AI β€” from the model to the device.**
13
-
14
- - **LUNA-100M** β€” pretrained on 4.5B tokens, then RAG + MCP instruction-tuned
15
- - **LUNA-300M** β€” pretrained on 4.5B tokens (scale-up from 100M)
16
- - **LUNA-1B** β€” in progress
17
- - **Tokenizer** β€” multilingual BPE (128K / 64K / 8K)
 
 
 
 
 
 
1
+ ---
2
+ title: ASTERIZER
3
+ emoji: πŸš€
4
+ colorFrom: gray
5
+ colorTo: gray
6
+ sdk: static
7
+ pinned: false
8
+ ---
9
+
10
+ # ASTERIZER
11
+
12
+ **Building AI from the model to the device** β€” self-hosted language models, a memory layer, application framework, and on-device AI, engineered in-house with 100% owned IP.
13
+
14
+ **Models (trained from scratch)**
15
+ - [LUNA-100M](https://huggingface.co/ASTERIZER/LUNA-100M) β€” 4.5B-token pretrain + RAG/MCP SFT
16
+ - [LUNA-300M](https://huggingface.co/ASTERIZER/LUNA-300M) β€” 4.5B-token pretrain (2.7Γ— scale-up)
17
+ - LUNA-1B β€” in progress
18
+
19
+ **Tokenizer (multilingual BPE)**
20
+ - [LUNA-1B-Tokenizer](https://huggingface.co/ASTERIZER/LUNA-1B-Tokenizer) β€” 128K / 64K / 8K vocab
21
+ - **2.8Γ— better compression** than GPT-NeoX, **67% fewer tokens** on Indic text (Kannada 7Γ—, Telugu 6Γ—, Tamil 5Γ—)
22
+ - Beats `cl100k_base` on Indic; competitive with Sarvam (34/55 head-to-head wins)