Text Generation
Transformers
PyTorch
Thai
English
gpt2
thai
Hanuman
reasoning
JonusNattapong commited on
Commit
f886350
·
verified ·
1 Parent(s): b18c332

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -3
README.md CHANGED
@@ -74,9 +74,7 @@ inference:
74
  - [HelpingAI/Dhanishtha-2.0-SUPERTHINKER](https://huggingface.co/datasets/HelpingAI/Dhanishtha-2.0-SUPERTHINKER)
75
  - [HuggingFaceH4/no_robots](https://huggingface.co/datasets/HuggingFaceH4/no_robots)
76
 
77
- ### Architecture
78
- - Based on a **Small Language Model (SLM) with Mixture of Experts**
79
- - Context length: **4,096 tokens** (extended via RoPE scaling)
80
  - Custom tokenizer for Thai language (handles whitespace, newline, tab, `<NL>`, `<SPACE>`, `<TAB>` etc.)
81
 
82
  ---
 
74
  - [HelpingAI/Dhanishtha-2.0-SUPERTHINKER](https://huggingface.co/datasets/HelpingAI/Dhanishtha-2.0-SUPERTHINKER)
75
  - [HuggingFaceH4/no_robots](https://huggingface.co/datasets/HuggingFaceH4/no_robots)
76
 
77
+ ### Architecture
 
 
78
  - Custom tokenizer for Thai language (handles whitespace, newline, tab, `<NL>`, `<SPACE>`, `<TAB>` etc.)
79
 
80
  ---