Update README.md
Browse files
README.md
CHANGED
|
@@ -9,43 +9,46 @@ pinned: false
|
|
| 9 |
|
| 10 |
# Darmm AI
|
| 11 |
|
| 12 |
-
**Darmm** is an independent R&D effort focused on language and document AI for Kazakh and the broader Central Asian context. Maintained by [R3iwan](https://github.com/R3iwan).
|
| 13 |
|
| 14 |
-
The focus is the
|
| 15 |
|
| 16 |
Website: [darmm.kz](https://darmm.kz) β currently AI tutoring, gradually becoming a project showcase.
|
| 17 |
|
| 18 |
## What I'm working on
|
| 19 |
|
| 20 |
-
* **Text / NLP** β LLM fine-tuning, embeddings, classification, and generation for
|
| 21 |
-
* **
|
| 22 |
-
* **OCR & document AI** β recognition of printed and handwritten
|
| 23 |
-
* **Retrieval & RAG** β embedding models, hybrid search, and RAG/GraphRAG pipelines tuned for
|
| 24 |
-
* **Benchmarks & datasets** β open
|
| 25 |
|
| 26 |
Most work is published as open models, datasets, and benchmarks on Hugging Face. Production-specific components stay closed.
|
| 27 |
|
| 28 |
## Technical focus
|
| 29 |
|
| 30 |
-
* **LLM adaptation**: LoRA/QLoRA fine-tuning
|
| 31 |
-
* **OCR**: classical and transformer-based OCR pipelines, support for
|
| 32 |
* **Retrieval**: embedding benchmarking, hybrid scoring (BM25 + dense), rerankers, RAG and GraphRAG pipelines.
|
| 33 |
* **Inference**: vLLM serving, quantization (AWQ, GGUF), latency optimization for production deployment.
|
| 34 |
* **Evaluation**: CER for OCR, retrieval and generation metrics for RAG (including LLM-as-judge calibrated against human labels), honest reporting of where models fail.
|
| 35 |
|
| 36 |
-
## Why Kazakh
|
| 37 |
|
| 38 |
-
Kazakh is the native language of over 20 million people, the state language of Kazakhstan, and the language of a growing digital economy. In AI research, it is consistently treated as an afterthought.
|
| 39 |
|
| 40 |
Tokenizers of major open models fragment Kazakh text far more than English or Russian, degrading both quality and cost. General-purpose LLMs either slip into Russian when prompted in Kazakh, or produce degraded output. OCR systems regularly confuse Kazakh Cyrillic with Russian. Domain terminology β legal, governmental, technical β is where the drop is sharpest.
|
| 41 |
|
| 42 |
-
|
|
|
|
|
|
|
| 43 |
|
| 44 |
## Coming later
|
| 45 |
|
| 46 |
-
* Kazakh β Russian / Kazakh β English translation
|
| 47 |
* Multimodal document understanding (vision + language)
|
| 48 |
* Domain-specific verticals β legal, medical, education
|
|
|
|
| 49 |
* Speech (ASR/TTS) β deliberately parked until the text and document stack is solid
|
| 50 |
|
| 51 |
## Status
|
|
|
|
| 9 |
|
| 10 |
# Darmm AI
|
| 11 |
|
| 12 |
+
**Darmm** is an independent R&D effort focused on language and document AI for underserved languages β starting with Kazakh and the broader Central Asian context. Maintained by [R3iwan](https://github.com/R3iwan).
|
| 13 |
|
| 14 |
+
The focus is the neglected part of the AI landscape: languages and domains where global open-source models quietly drop in quality β where tokenizers fragment text, models drift into a dominant neighbor language, and local script, context, and terminology are treated as edge cases.
|
| 15 |
|
| 16 |
Website: [darmm.kz](https://darmm.kz) β currently AI tutoring, gradually becoming a project showcase.
|
| 17 |
|
| 18 |
## What I'm working on
|
| 19 |
|
| 20 |
+
* **Text / NLP** β LLM fine-tuning, embeddings, classification, and generation for low-resource languages, with a focus on legal and technical terminology. Current work centers on Kazakh and Russian.
|
| 21 |
+
* **Tokenization & language adaptation** β measuring and closing the gap between how global models handle underserved languages versus how they should: tokenizer efficiency, vocabulary extension, continued pretraining on native-language data. A methodology built on Kazakh, designed to transfer.
|
| 22 |
+
* **OCR & document AI** β recognition of printed and handwritten text in underrepresented scripts, adapted for legal, educational, and government documents; extraction and validation pipelines on top of it.
|
| 23 |
+
* **Retrieval & RAG** β embedding models, hybrid search, and RAG/GraphRAG pipelines tuned for non-English corpora, evaluated against curated golden sets.
|
| 24 |
+
* **Benchmarks & datasets** β open datasets and honest, reproducible evaluation reports of where current models actually stand on languages the leaderboards ignore.
|
| 25 |
|
| 26 |
Most work is published as open models, datasets, and benchmarks on Hugging Face. Production-specific components stay closed.
|
| 27 |
|
| 28 |
## Technical focus
|
| 29 |
|
| 30 |
+
* **LLM adaptation**: LoRA/QLoRA fine-tuning, vocabulary extension, domain-specific embeddings, instruction tuning for low-resource settings.
|
| 31 |
+
* **OCR**: classical and transformer-based OCR pipelines, support for multiple scripts and alphabet variants (currently Kazakh Cyrillic and Latin), document layout and field extraction.
|
| 32 |
* **Retrieval**: embedding benchmarking, hybrid scoring (BM25 + dense), rerankers, RAG and GraphRAG pipelines.
|
| 33 |
* **Inference**: vLLM serving, quantization (AWQ, GGUF), latency optimization for production deployment.
|
| 34 |
* **Evaluation**: CER for OCR, retrieval and generation metrics for RAG (including LLM-as-judge calibrated against human labels), honest reporting of where models fail.
|
| 35 |
|
| 36 |
+
## Why start with Kazakh
|
| 37 |
|
| 38 |
+
Kazakh is the native language of over 20 million people, the state language of Kazakhstan, and the language of a growing digital economy. In AI research, it is consistently treated as an afterthought β and it is far from alone.
|
| 39 |
|
| 40 |
Tokenizers of major open models fragment Kazakh text far more than English or Russian, degrading both quality and cost. General-purpose LLMs either slip into Russian when prompted in Kazakh, or produce degraded output. OCR systems regularly confuse Kazakh Cyrillic with Russian. Domain terminology β legal, governmental, technical β is where the drop is sharpest.
|
| 41 |
|
| 42 |
+
The same failure pattern repeats across dozens of languages worldwide: a dominant neighbor language the model falls back to, a script the tokenizer wasn't built for, domain vocabulary nobody benchmarked. Kazakh is where Darmm builds and validates the playbook β systematic benchmarking, open models, honest reporting β with the explicit goal of making the methods, tooling, and evaluation practices reusable for other underserved languages.
|
| 43 |
+
|
| 44 |
+
This is not a niche academic gap. It's a practical failure affecting real users and real products, in languages that deserve better infrastructure.
|
| 45 |
|
| 46 |
## Coming later
|
| 47 |
|
| 48 |
+
* Kazakh β Russian / Kazakh β English translation, with the pipeline generalized to other language pairs
|
| 49 |
* Multimodal document understanding (vision + language)
|
| 50 |
* Domain-specific verticals β legal, medical, education
|
| 51 |
+
* Extension of the adaptation and benchmarking stack to other Central Asian and low-resource languages
|
| 52 |
* Speech (ASR/TTS) β deliberately parked until the text and document stack is solid
|
| 53 |
|
| 54 |
## Status
|