Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,37 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# MALM: Modular Adapter-based Language Model
|
| 2 |
+
๐ [Read the full paper (MALM.pdf)](./MALM.pdf)
|
| 3 |
+
๐ Author: **Hilal Limo (Independent Researcher, 15)**
|
| 4 |
+
๐ License: [Apache-2.0](./LICENSE)
|
| 5 |
+
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
## Overview
|
| 9 |
+
This repository contains the research paper **MALM: Modular Adapter-based Language Model**, which introduces a lightweight and scalable framework for multilingual AI.
|
| 10 |
+
Instead of relying on massive monolithic models, MALM separates **reasoning** and **translation** into two modular parts:
|
| 11 |
+
|
| 12 |
+
- **Core Language Model (CLM):** A compact, English-focused reasoning engine.
|
| 13 |
+
- **Specialized Translation Adapters (STAs):** Lightweight, swappable neural machine translation models.
|
| 14 |
+
- **Orchestration Layer:** Connects the pieces, parsing delegation tokens (e.g. `<to:de> ... </to>`) and routing requests to the right adapter.
|
| 15 |
+
|
| 16 |
+
This design drastically reduces compute cost, makes it easier to add new languages, and is especially useful for **small models**, edge devices, and research settings.
|
| 17 |
+
|
| 18 |
+
---
|
| 19 |
+
|
| 20 |
+
## Why MALM?
|
| 21 |
+
- ๐ **Efficiency:** Keep one reasoning core small and sharp.
|
| 22 |
+
- ๐ **Scalability:** Add or update languages by swapping STAs.
|
| 23 |
+
- ๐ ๏ธ **Maintainability:** Upgrade individual adapters without retraining the whole system.
|
| 24 |
+
- ๐ฑ **Small Models:** Perfect for low-resource environments, edge devices, and startups.
|
| 25 |
+
|
| 26 |
+
---
|
| 27 |
+
|
| 28 |
+
## Example Conversation Flows
|
| 29 |
+
```text
|
| 30 |
+
User: Translate "my name is Adam" into German.
|
| 31 |
+
CLM โ <to:de> my name is Adam </to>
|
| 32 |
+
STA โ "Mein Name ist Adam"
|
| 33 |
+
|
| 34 |
+
User (in Spanish): "ยฟCuรกnto es 12 + 7?"
|
| 35 |
+
Input STA (esโen) โ "How much is 12 + 7?"
|
| 36 |
+
CLM โ "The answer is <to:es> 19 </to>"
|
| 37 |
+
Output STA โ "La respuesta es 19"
|