Text Generation
Transformers
Safetensors
lora
aya
tiny-aya
multilingual
code
legesher
tiny-aya-expedition
language-decoded
unsloth
arxiv:2603.11510
arxiv:2211.15533
arxiv:2510.09591
arxiv:1809.05053
arxiv:2308.16884
arxiv:2106.06937
arxiv:2210.03057
Instructions to use legesher/language-decoded-lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use legesher/language-decoded-lora with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="legesher/language-decoded-lora")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("legesher/language-decoded-lora", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use legesher/language-decoded-lora with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "legesher/language-decoded-lora" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "legesher/language-decoded-lora", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/legesher/language-decoded-lora
- SGLang
How to use legesher/language-decoded-lora with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "legesher/language-decoded-lora" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "legesher/language-decoded-lora", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "legesher/language-decoded-lora" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "legesher/language-decoded-lora", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Unsloth Desktop
- Docker Model Runner
How to use legesher/language-decoded-lora with Docker Model Runner:
docker model run hf.co/legesher/language-decoded-lora
docs: register the October 2026 seed-123 adapters in the card and manifest
#18
by madiedgar - opened
- MANIFEST.md +8 -0
- README.md +5 -5
MANIFEST.md
CHANGED
|
@@ -9,25 +9,33 @@ Generated from the repo file tree; one row per directory containing `adapter_con
|
|
| 9 |
| Adapter path | Condition | Seed |
|
| 10 |
| --- | --- | --- |
|
| 11 |
| `tiny-aya-base/condition-1-en-20k-seed42/` | 1 | 42 |
|
|
|
|
| 12 |
| `tiny-aya-base/condition-1-en-5k-seed123/` | 1 | 123 |
|
| 13 |
| `tiny-aya-base/condition-1-en-5k-seed42/` | 1 | 42 |
|
| 14 |
| `tiny-aya-base/condition-1-en-5k-seed456/` | 1 | 456 |
|
| 15 |
| `tiny-aya-base/condition-2-es-20k-seed42/` | 2 | 42 |
|
|
|
|
| 16 |
| `tiny-aya-base/condition-2-es-5k-seed123/` | 2 | 123 |
|
| 17 |
| `tiny-aya-base/condition-2-es-5k-seed42/` | 2 | 42 |
|
| 18 |
| `tiny-aya-base/condition-2-es-5k-seed456/` | 2 | 456 |
|
| 19 |
| `tiny-aya-base/condition-2-ur-20k-seed42/` | 2 | 42 |
|
|
|
|
| 20 |
| `tiny-aya-base/condition-2-ur-5k-seed123/` | 2 | 123 |
|
| 21 |
| `tiny-aya-base/condition-2-ur-5k-seed42/` | 2 | 42 |
|
| 22 |
| `tiny-aya-base/condition-2-ur-5k-seed456/` | 2 | 456 |
|
| 23 |
| `tiny-aya-base/condition-2-zh-20k-seed42/` | 2 | 42 |
|
|
|
|
| 24 |
| `tiny-aya-base/condition-2-zh-5k-seed123/` | 2 | 123 |
|
| 25 |
| `tiny-aya-base/condition-2-zh-5k-seed42/` | 2 | 42 |
|
| 26 |
| `tiny-aya-base/condition-2-zh-5k-seed456/` | 2 | 456 |
|
| 27 |
| `tiny-aya-base/condition-3-zh-5k-native-code-seed42/` | 3 | 42 |
|
|
|
|
| 28 |
| `tiny-aya-base/condition-5-es-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
|
|
|
|
| 29 |
| `tiny-aya-base/condition-5-ur-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
|
|
|
|
| 30 |
| `tiny-aya-base/condition-5-zh-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
|
|
|
|
| 31 |
|
| 32 |
## Phase 2 β preliminary adapters (`bigcode/the-stack` v1, Legesher v0.5.1 / v0.6.0)
|
| 33 |
|
|
|
|
| 9 |
| Adapter path | Condition | Seed |
|
| 10 |
| --- | --- | --- |
|
| 11 |
| `tiny-aya-base/condition-1-en-20k-seed42/` | 1 | 42 |
|
| 12 |
+
| `tiny-aya-base/condition-1-en-20k-seed123/` | 1 | 123 |
|
| 13 |
| `tiny-aya-base/condition-1-en-5k-seed123/` | 1 | 123 |
|
| 14 |
| `tiny-aya-base/condition-1-en-5k-seed42/` | 1 | 42 |
|
| 15 |
| `tiny-aya-base/condition-1-en-5k-seed456/` | 1 | 456 |
|
| 16 |
| `tiny-aya-base/condition-2-es-20k-seed42/` | 2 | 42 |
|
| 17 |
+
| `tiny-aya-base/condition-2-es-20k-seed123/` | 2 | 123 |
|
| 18 |
| `tiny-aya-base/condition-2-es-5k-seed123/` | 2 | 123 |
|
| 19 |
| `tiny-aya-base/condition-2-es-5k-seed42/` | 2 | 42 |
|
| 20 |
| `tiny-aya-base/condition-2-es-5k-seed456/` | 2 | 456 |
|
| 21 |
| `tiny-aya-base/condition-2-ur-20k-seed42/` | 2 | 42 |
|
| 22 |
+
| `tiny-aya-base/condition-2-ur-20k-seed123/` | 2 | 123 |
|
| 23 |
| `tiny-aya-base/condition-2-ur-5k-seed123/` | 2 | 123 |
|
| 24 |
| `tiny-aya-base/condition-2-ur-5k-seed42/` | 2 | 42 |
|
| 25 |
| `tiny-aya-base/condition-2-ur-5k-seed456/` | 2 | 456 |
|
| 26 |
| `tiny-aya-base/condition-2-zh-20k-seed42/` | 2 | 42 |
|
| 27 |
+
| `tiny-aya-base/condition-2-zh-20k-seed123/` | 2 | 123 |
|
| 28 |
| `tiny-aya-base/condition-2-zh-5k-seed123/` | 2 | 123 |
|
| 29 |
| `tiny-aya-base/condition-2-zh-5k-seed42/` | 2 | 42 |
|
| 30 |
| `tiny-aya-base/condition-2-zh-5k-seed456/` | 2 | 456 |
|
| 31 |
| `tiny-aya-base/condition-3-zh-5k-native-code-seed42/` | 3 | 42 |
|
| 32 |
+
| `tiny-aya-base/condition-3-zh-5k-native-code-seed123/` | 3 | 123 |
|
| 33 |
| `tiny-aya-base/condition-5-es-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
|
| 34 |
+
| `tiny-aya-base/condition-5-es-5k-c4ai-aya-expanse-32b-seed123/` | 5 | 123 |
|
| 35 |
| `tiny-aya-base/condition-5-ur-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
|
| 36 |
+
| `tiny-aya-base/condition-5-ur-5k-c4ai-aya-expanse-32b-seed123/` | 5 | 123 |
|
| 37 |
| `tiny-aya-base/condition-5-zh-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
|
| 38 |
+
| `tiny-aya-base/condition-5-zh-5k-c4ai-aya-expanse-32b-seed123/` | 5 | 123 |
|
| 39 |
|
| 40 |
## Phase 2 β preliminary adapters (`bigcode/the-stack` v1, Legesher v0.5.1 / v0.6.0)
|
| 41 |
|
README.md
CHANGED
|
@@ -63,11 +63,11 @@ Each subdirectory under `tiny-aya-base/` is one trained condition Γ file-volume
|
|
| 63 |
| Subdirectory (under `tiny-aya-base/`) | Condition | Training data | Seeds |
|
| 64 |
| ------------------------------------------------------------------------ | --------- | ---------------------------------------------------------------------------------------------------------------------------------------------- | ---------- |
|
| 65 |
| `tiny-aya-base/condition-1-en-5k-seed{42,123,456}/` | 1 | Raw English Python from `bigcode/the-stack-v2-dedup` (5k file subset) | 42, 123, 456 |
|
| 66 |
-
| `tiny-aya-base/condition-1-en-20k-
|
| 67 |
| `tiny-aya-base/condition-2-{zh,es,ur}-5k-seed{42,123,456}/` | 2 | The **same 5k subset as cond-1**, processed through Legesher v0.7.3 β Python's reserved words (keywords, exceptions, built-in functions, numerical system for some target languages) translated to the target language; user logic preserved | 42, 123, 456 |
|
| 68 |
-
| `tiny-aya-base/condition-2-{zh,es,ur}-20k-
|
| 69 |
-
| `tiny-aya-base/condition-3-zh-5k-native-code-
|
| 70 |
-
| `tiny-aya-base/condition-5-{zh,es,ur}-5k-c4ai-aya-expanse-32b-
|
| 71 |
|
| 72 |
**Condition 4 ("Community-Contributed Native Code")** is pending sufficient direct community contributions to the [`legesher/legesher-native-code`](https://huggingface.co/spaces/legesher/legesher-native-code) HF Space; no cond-4 adapter exists yet.
|
| 73 |
|
|
@@ -106,7 +106,7 @@ The two adapter generations are distinguished by **folder location and source co
|
|
| 106 |
|
| 107 |
| Generation | Location in this repo | Source corpus | Legesher | Tier / seeds | Cite for paper? |
|
| 108 |
| --- | --- | --- | --- | --- | --- |
|
| 109 |
-
| **Phase 3 (paper)** | `tiny-aya-base/β¦-seed*/` | [`bigcode/the-stack-v2-dedup`](https://huggingface.co/datasets/bigcode/the-stack-v2-dedup) | v0.7.3 | 5k (3 seeds) + 20k (
|
| 110 |
| **Phase 2 (preliminary)** | flat top-level `condition-*/` | [`bigcode/the-stack`](https://huggingface.co/datasets/bigcode/the-stack) (v1) | v0.5.1 / v0.6.0 | 5k / 32k (1 seed) | β No |
|
| 111 |
|
| 112 |
A complete, machine-readable path β phase β corpus β condition map is in [`MANIFEST.md`](MANIFEST.md). Training-data provenance for each condition is detailed on [`language-decoded-data`](https://huggingface.co/datasets/legesher/language-decoded-data); the phase comparison is in the ["Phase 2 β Phase 3 at a glance"](https://huggingface.co/datasets/legesher/language-decoded-experiments#phase-2--phase-3-at-a-glance) table on the experiments repo.
|
|
|
|
| 63 |
| Subdirectory (under `tiny-aya-base/`) | Condition | Training data | Seeds |
|
| 64 |
| ------------------------------------------------------------------------ | --------- | ---------------------------------------------------------------------------------------------------------------------------------------------- | ---------- |
|
| 65 |
| `tiny-aya-base/condition-1-en-5k-seed{42,123,456}/` | 1 | Raw English Python from `bigcode/the-stack-v2-dedup` (5k file subset) | 42, 123, 456 |
|
| 66 |
+
| `tiny-aya-base/condition-1-en-20k-seed{42,123}/` | 1 | Raw English Python (20k file subset) | 42, 123 |
|
| 67 |
| `tiny-aya-base/condition-2-{zh,es,ur}-5k-seed{42,123,456}/` | 2 | The **same 5k subset as cond-1**, processed through Legesher v0.7.3 β Python's reserved words (keywords, exceptions, built-in functions, numerical system for some target languages) translated to the target language; user logic preserved | 42, 123, 456 |
|
| 68 |
+
| `tiny-aya-base/condition-2-{zh,es,ur}-20k-seed{42,123}/` | 2 | The **same 20k subset as cond-1**, processed through Legesher v0.7.3 | 42, 123 |
|
| 69 |
+
| `tiny-aya-base/condition-3-zh-5k-native-code-seed{42,123}/` | 3 | Community-collected raw Chinese code from varied online public-source repositories (different source-file population from cond-1/2/5 by design) | 42, 123 |
|
| 70 |
+
| `tiny-aya-base/condition-5-{zh,es,ur}-5k-c4ai-aya-expanse-32b-seed{42,123}/` | 5 | The **same 5k subset as cond-1**, first transpiled by Legesher v0.7.3 to translate Python's reserved words, then run through `c4ai-aya-expanse-32b` via the Cohere API to translate the remaining content (identifiers, comments, docstrings, string literals) | 42, 123 |
|
| 71 |
|
| 72 |
**Condition 4 ("Community-Contributed Native Code")** is pending sufficient direct community contributions to the [`legesher/legesher-native-code`](https://huggingface.co/spaces/legesher/legesher-native-code) HF Space; no cond-4 adapter exists yet.
|
| 73 |
|
|
|
|
| 106 |
|
| 107 |
| Generation | Location in this repo | Source corpus | Legesher | Tier / seeds | Cite for paper? |
|
| 108 |
| --- | --- | --- | --- | --- | --- |
|
| 109 |
+
| **Phase 3 (paper)** | `tiny-aya-base/β¦-seed*/` | [`bigcode/the-stack-v2-dedup`](https://huggingface.co/datasets/bigcode/the-stack-v2-dedup) | v0.7.3 | 5k (3 seeds for cond-1 and cond-2; 2 seeds for cond-3 and cond-5) + 20k (2 seeds) | β
Yes |
|
| 110 |
| **Phase 2 (preliminary)** | flat top-level `condition-*/` | [`bigcode/the-stack`](https://huggingface.co/datasets/bigcode/the-stack) (v1) | v0.5.1 / v0.6.0 | 5k / 32k (1 seed) | β No |
|
| 111 |
|
| 112 |
A complete, machine-readable path β phase β corpus β condition map is in [`MANIFEST.md`](MANIFEST.md). Training-data provenance for each condition is detailed on [`language-decoded-data`](https://huggingface.co/datasets/legesher/language-decoded-data); the phase comparison is in the ["Phase 2 β Phase 3 at a glance"](https://huggingface.co/datasets/legesher/language-decoded-experiments#phase-2--phase-3-at-a-glance) table on the experiments repo.
|