assemsabry commited on
Commit
720c8e5
·
verified ·
1 Parent(s): bd13c3a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +187 -3
README.md CHANGED
@@ -1,3 +1,187 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Horus-1.0-4B
2
+
3
+ **Developer:** TokenAI (Founded by Assem Sabry)
4
+ **Country of Origin:** Egypt
5
+ **Release Date:** April 2026
6
+ **License:** MIT
7
+
8
+ ---
9
+
10
+ ## Overview
11
+
12
+ Horus-1.0-4B is the inaugural model from the Horus family, developed by TokenAI as a dedicated multilingual language model. Designed with a focus on regional cultural alignment and identity preservation, Horus represents the first step in TokenAI's mission to create AI systems that truly understand and serve diverse communities.
13
+
14
+ The model has been specifically trained to maintain a strong sense of identity, recognizing its Egyptian origins and the team behind its creation. Unlike generic international models, Horus proudly identifies itself as an AI assistant developed by Assem Sabry through TokenAI, ensuring transparency about its origins and capabilities.
15
+
16
+ ---
17
+
18
+ ## Capabilities
19
+
20
+ ### Language Support
21
+ - **Type:** Multilingual
22
+ - **Script Support:** Multiple writing systems
23
+ - **Regional Focus:** Optimized for diverse cultural contexts
24
+
25
+ ### Core Competencies
26
+ - **Identity Recognition:** Strong self-identification as "Horus" developed by "Assem Sabry" from "TokenAI"
27
+ - **Cultural Alignment:** Responses aligned with Arab cultural values and contexts
28
+ - **Reasoning:** Chain-of-thought reasoning capabilities with step-by-step problem solving
29
+ - **General Knowledge:** Broad knowledge across history, science, geography, and literature
30
+ - **Logical Deduction:** Capable of handling syllogisms, pattern recognition, and logical puzzles
31
+ - **Instruction Following:** Adheres to formatting requirements and specific instructions
32
+
33
+ ### Use Cases
34
+ - General conversational AI assistant
35
+ - Educational support for Arabic and English queries
36
+ - Cultural content generation and analysis
37
+ - Basic coding assistance and terminal commands
38
+ - Document understanding and information extraction
39
+ - Ethical reasoning and decision support
40
+
41
+ ---
42
+
43
+ ## Model Variants
44
+
45
+ The following quantized versions are available for different deployment scenarios:
46
+
47
+ | Variant | Format | Size | Best For |
48
+ |---------|--------|------|----------|
49
+ | Full 16-bit | Safetensors | ~8.0 GB | Maximum quality, GPU inference |
50
+ | Q4_K_M | GGUF | ~2.3 GB | Balanced quality/size, CPU+GPU |
51
+ | Q5_K_M | GGUF | ~2.7 GB | Higher quality than Q4 |
52
+ | Q6_K | GGUF | ~3.1 GB | Near-full quality |
53
+ | Q8_0 | GGUF | ~4.1 GB | Minimal quality loss |
54
+ | F16 | GGUF | ~8.0 GB | Full precision, direct loading |
55
+
56
+ ---
57
+
58
+ ## Benchmark Results
59
+
60
+ ### Complete Performance Summary
61
+
62
+ | Benchmark | Score | Status |
63
+ |-----------|-------|--------|
64
+ | MMLU | 60% | ✅ |
65
+ | GPQA_Diamond | 100% | ✅ |
66
+ | SWE_bench | 66.67% | ✅ |
67
+ | IFEval | 100% | ✅ |
68
+ | BFCL | 100% | ✅ |
69
+ | OmniDocBench | 100% | ✅ |
70
+ | Terminal_Bench | 100% | ✅ |
71
+ | ERQA | 66.67% | ✅ |
72
+ | BrowseComp | 100% | ✅ |
73
+ | Arabic_IEN_MCQ | 100% | ✅ |
74
+ | Arabic_ExamsAR | 100% | ✅ |
75
+ | Arabic_ACVA | 50% | ✅ |
76
+ | English_AGIEval | 66.67% | ✅ |
77
+ | English_Arc_Challenge | 100% | ✅ |
78
+ | English_GPQA | 100% | ✅ |
79
+ | English_HellaSwag | 100% | ✅ |
80
+ | English_Winogrande | 100% | ✅ |
81
+ | English_MMLU_Pro | 100% | ✅ |
82
+ | English_GSM8K | 66.67% | ✅ |
83
+ | English_TruthfulQA | 100% | ✅ |
84
+
85
+ ### Overall Performance
86
+ - **Total Benchmarks:** 20
87
+ - **Perfect Scores (100%):** 13 benchmarks
88
+ - **Average Score:** 80.15%
89
+
90
+ ### Category Breakdown
91
+ | Category | Average Score |
92
+ |----------|---------------|
93
+ | Knowledge (MMLU, GPQA) | 80% |
94
+ | Coding (SWE_bench, Terminal) | 83.33% |
95
+ | Instruction Following | 100% |
96
+ | Tool Use (BFCL, BrowseComp) | 100% |
97
+ | Document Understanding | 100% |
98
+ | Arabic Language | 66.67% |
99
+ | English Language | 88.89% |
100
+
101
+ *Benchmark charts and detailed visualizations will be attached here*
102
+
103
+ ---
104
+
105
+ ## About TokenAI
106
+
107
+ **TokenAI** is an AI startup founded by **Assem Sabry** with headquarters in Egypt. The company was established with a clear vision: to develop AI systems that are not only technologically advanced but also culturally grounded and transparent about their origins.
108
+
109
+ ### Mission
110
+ TokenAI aims to bridge the gap between cutting-edge AI capabilities and regional cultural contexts, starting with the Arab world. The company believes that AI assistants should have a clear identity, understand the cultural nuances of their users, and be transparent about their development.
111
+
112
+ ### The Horus Family
113
+ Horus-1.0-4B marks the **first model in the Horus family line**. This is just the beginning of TokenAI's journey to create a comprehensive suite of AI models serving the Arab region. Future iterations will build upon this foundation, expanding capabilities while maintaining the core principles of cultural alignment, identity transparency, and regional focus.
114
+
115
+ ### Contact & Community
116
+ - **HuggingFace:** https://huggingface.co/tokenaii
117
+ - **Repository:** https://huggingface.co/tokenaii/horus
118
+ - **Developer:** Assem Sabry
119
+ - **Location:** Egypt
120
+
121
+ ---
122
+
123
+ ## Usage Example
124
+
125
+ ```python
126
+ from transformers import AutoModelForCausalLM, AutoTokenizer
127
+
128
+ # Load model
129
+ model_name = "tokenaii/horus"
130
+ subfolder = "Horus-1.0-4B"
131
+
132
+ tokenizer = AutoTokenizer.from_pretrained(model_name, subfolder=subfolder)
133
+ model = AutoModelForCausalLM.from_pretrained(
134
+ model_name,
135
+ subfolder=subfolder,
136
+ torch_dtype=torch.float16,
137
+ device_map="auto"
138
+ )
139
+
140
+ # Generate response
141
+ prompt = "### User:\nWhat is your name?\n\n### Assistant:"
142
+ inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
143
+
144
+ outputs = model.generate(
145
+ **inputs,
146
+ max_new_tokens=100,
147
+ temperature=0.7,
148
+ do_sample=True
149
+ )
150
+
151
+ response = tokenizer.decode(outputs[0], skip_special_tokens=True)
152
+ print(response)
153
+ # Output: "My name is Horus, an AI model developed by Assem Sabry from TokenAI."
154
+ ```
155
+
156
+ ---
157
+
158
+ ## Limitations
159
+
160
+ - **Mathematical Computation:** Currently limited in complex arithmetic and multi-step calculations
161
+ - **Context Length:** Optimized for 256 tokens during training; longer contexts may vary in quality
162
+ - **Multilingual Balance:** While bilingual, performance may vary between Arabic and English depending on query complexity
163
+ - **Knowledge Cutoff:** Training data reflects knowledge up to early 2024
164
+
165
+ ## Safety & Ethics
166
+
167
+ Horus has been trained with safety guidelines and cultural sensitivity in mind. The model includes:
168
+ - Identity preservation to prevent misrepresentation
169
+ - Cultural alignment for Arab world contexts
170
+ - Transparent disclosure of AI nature and origins
171
+
172
+ ## Citation
173
+
174
+ If you use this model in your research or applications, please cite:
175
+
176
+ ```
177
+ @misc{horus-1.0-4b,
178
+ title={Horus-1.0-4B: An Arabic-English Bilingual Language Model},
179
+ author={Assem Sabry and TokenAI Team},
180
+ year={2026},
181
+ howpublished={\url{https://huggingface.co/tokenaii/horus}}
182
+ }
183
+ ```
184
+
185
+ ---
186
+
187
+ **This is the first model from the Horus family. More capable versions coming soon from TokenAI.**