|
Download docs/MODEL_SPECIFICATION.md from tokenaii/Neo-Ar: direct link, hf CLI and curl.
- Browser
- Download file 686 Bytes
-
https://huggingface.co/tokenaii/Neo-Ar/resolve/main/docs/MODEL_SPECIFICATION.md
- Command line
-
hf download hf://tokenaii/Neo-Ar/docs/MODEL_SPECIFICATION.md
-
curl -L -o MODEL_SPECIFICATION.md https://huggingface.co/tokenaii/Neo-Ar/resolve/main/docs/MODEL_SPECIFICATION.md
686 Bytes
Neo Ar Model Specification
Neo Ar is an Arabic-only System One decision model with a larger encoder than the English Neo model.
- 12 Transformer layers.
- Hidden size 768.
- 12 attention heads.
- Intermediate size 3,072.
- Maximum context 1,024 tokens.
- Up to 64 choice options.
- Up to 7 score levels.
- Binary
nouldecision. - Custom Arabic WordPiece tokenizer.
The released architecture contains 86,393,160 trainable parameters with a 644-token Arabic vocabulary.
The final parameter count is measured from the released checkpoint after the Arabic tokenizer vocabulary is finalized. The full source and training process are documented at https://github.com/tokenaii/Neo-Ar.