R3iwan commited on
Commit
a45c99f
Β·
verified Β·
1 Parent(s): 502d14d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -13
README.md CHANGED
@@ -9,43 +9,46 @@ pinned: false
9
 
10
  # Darmm AI
11
 
12
- **Darmm** is an independent R&D effort focused on language and document AI for Kazakh and the broader Central Asian context. Maintained by [R3iwan](https://github.com/R3iwan).
13
 
14
- The focus is the underserved part of the AI landscape: languages and domains where global open-source models drop in quality, and where local context, script, and terminology matter.
15
 
16
  Website: [darmm.kz](https://darmm.kz) β€” currently AI tutoring, gradually becoming a project showcase.
17
 
18
  ## What I'm working on
19
 
20
- * **Text / NLP** β€” LLM fine-tuning, embeddings, classification, and generation for Kazakh/Russian text, with a focus on legal and technical terminology.
21
- * **Kazakh-aware tokenization & adaptation** β€” measuring and closing the gap between how global models handle Kazakh versus how they should: tokenizer efficiency, vocabulary extension, continued pretraining on Kazakh data.
22
- * **OCR & document AI** β€” recognition of printed and handwritten Kazakh text, adapted for legal, educational, and government documents; extraction and validation pipelines on top of it.
23
- * **Retrieval & RAG** β€” embedding models, hybrid search, and RAG/GraphRAG pipelines tuned for Kazakh/Russian corpora, evaluated against curated golden sets.
24
- * **Benchmarks & datasets** β€” open Kazakh-language datasets and honest, reproducible evaluation reports of where current models actually stand.
25
 
26
  Most work is published as open models, datasets, and benchmarks on Hugging Face. Production-specific components stay closed.
27
 
28
  ## Technical focus
29
 
30
- * **LLM adaptation**: LoRA/QLoRA fine-tuning on Kazakh/Russian data, vocabulary extension, domain-specific embeddings, instruction tuning.
31
- * **OCR**: classical and transformer-based OCR pipelines, support for Cyrillic and Latin variants of the Kazakh alphabet, document layout and field extraction.
32
  * **Retrieval**: embedding benchmarking, hybrid scoring (BM25 + dense), rerankers, RAG and GraphRAG pipelines.
33
  * **Inference**: vLLM serving, quantization (AWQ, GGUF), latency optimization for production deployment.
34
  * **Evaluation**: CER for OCR, retrieval and generation metrics for RAG (including LLM-as-judge calibrated against human labels), honest reporting of where models fail.
35
 
36
- ## Why Kazakh
37
 
38
- Kazakh is the native language of over 20 million people, the state language of Kazakhstan, and the language of a growing digital economy. In AI research, it is consistently treated as an afterthought.
39
 
40
  Tokenizers of major open models fragment Kazakh text far more than English or Russian, degrading both quality and cost. General-purpose LLMs either slip into Russian when prompted in Kazakh, or produce degraded output. OCR systems regularly confuse Kazakh Cyrillic with Russian. Domain terminology β€” legal, governmental, technical β€” is where the drop is sharpest.
41
 
42
- This is not a niche academic gap. It's a practical failure affecting real users, real products, and a language that deserves better infrastructure. Darmm exists to close that gap β€” not through scattered experiments, but through systematic benchmarking, open models, and honest reporting of where the current state of the art actually stands.
 
 
43
 
44
  ## Coming later
45
 
46
- * Kazakh ↔ Russian / Kazakh ↔ English translation
47
  * Multimodal document understanding (vision + language)
48
  * Domain-specific verticals β€” legal, medical, education
 
49
  * Speech (ASR/TTS) β€” deliberately parked until the text and document stack is solid
50
 
51
  ## Status
 
9
 
10
  # Darmm AI
11
 
12
+ **Darmm** is an independent R&D effort focused on language and document AI for underserved languages β€” starting with Kazakh and the broader Central Asian context. Maintained by [R3iwan](https://github.com/R3iwan).
13
 
14
+ The focus is the neglected part of the AI landscape: languages and domains where global open-source models quietly drop in quality β€” where tokenizers fragment text, models drift into a dominant neighbor language, and local script, context, and terminology are treated as edge cases.
15
 
16
  Website: [darmm.kz](https://darmm.kz) β€” currently AI tutoring, gradually becoming a project showcase.
17
 
18
  ## What I'm working on
19
 
20
+ * **Text / NLP** β€” LLM fine-tuning, embeddings, classification, and generation for low-resource languages, with a focus on legal and technical terminology. Current work centers on Kazakh and Russian.
21
+ * **Tokenization & language adaptation** β€” measuring and closing the gap between how global models handle underserved languages versus how they should: tokenizer efficiency, vocabulary extension, continued pretraining on native-language data. A methodology built on Kazakh, designed to transfer.
22
+ * **OCR & document AI** β€” recognition of printed and handwritten text in underrepresented scripts, adapted for legal, educational, and government documents; extraction and validation pipelines on top of it.
23
+ * **Retrieval & RAG** β€” embedding models, hybrid search, and RAG/GraphRAG pipelines tuned for non-English corpora, evaluated against curated golden sets.
24
+ * **Benchmarks & datasets** β€” open datasets and honest, reproducible evaluation reports of where current models actually stand on languages the leaderboards ignore.
25
 
26
  Most work is published as open models, datasets, and benchmarks on Hugging Face. Production-specific components stay closed.
27
 
28
  ## Technical focus
29
 
30
+ * **LLM adaptation**: LoRA/QLoRA fine-tuning, vocabulary extension, domain-specific embeddings, instruction tuning for low-resource settings.
31
+ * **OCR**: classical and transformer-based OCR pipelines, support for multiple scripts and alphabet variants (currently Kazakh Cyrillic and Latin), document layout and field extraction.
32
  * **Retrieval**: embedding benchmarking, hybrid scoring (BM25 + dense), rerankers, RAG and GraphRAG pipelines.
33
  * **Inference**: vLLM serving, quantization (AWQ, GGUF), latency optimization for production deployment.
34
  * **Evaluation**: CER for OCR, retrieval and generation metrics for RAG (including LLM-as-judge calibrated against human labels), honest reporting of where models fail.
35
 
36
+ ## Why start with Kazakh
37
 
38
+ Kazakh is the native language of over 20 million people, the state language of Kazakhstan, and the language of a growing digital economy. In AI research, it is consistently treated as an afterthought β€” and it is far from alone.
39
 
40
  Tokenizers of major open models fragment Kazakh text far more than English or Russian, degrading both quality and cost. General-purpose LLMs either slip into Russian when prompted in Kazakh, or produce degraded output. OCR systems regularly confuse Kazakh Cyrillic with Russian. Domain terminology β€” legal, governmental, technical β€” is where the drop is sharpest.
41
 
42
+ The same failure pattern repeats across dozens of languages worldwide: a dominant neighbor language the model falls back to, a script the tokenizer wasn't built for, domain vocabulary nobody benchmarked. Kazakh is where Darmm builds and validates the playbook β€” systematic benchmarking, open models, honest reporting β€” with the explicit goal of making the methods, tooling, and evaluation practices reusable for other underserved languages.
43
+
44
+ This is not a niche academic gap. It's a practical failure affecting real users and real products, in languages that deserve better infrastructure.
45
 
46
  ## Coming later
47
 
48
+ * Kazakh ↔ Russian / Kazakh ↔ English translation, with the pipeline generalized to other language pairs
49
  * Multimodal document understanding (vision + language)
50
  * Domain-specific verticals β€” legal, medical, education
51
+ * Extension of the adaptation and benchmarking stack to other Central Asian and low-resource languages
52
  * Speech (ASR/TTS) β€” deliberately parked until the text and document stack is solid
53
 
54
  ## Status