docs: register the October 2026 seed-123 adapters in the card and manifest

#18
by madiedgar - opened
Files changed (2) hide show
  1. MANIFEST.md +8 -0
  2. README.md +5 -5
MANIFEST.md CHANGED
@@ -9,25 +9,33 @@ Generated from the repo file tree; one row per directory containing `adapter_con
9
  | Adapter path | Condition | Seed |
10
  | --- | --- | --- |
11
  | `tiny-aya-base/condition-1-en-20k-seed42/` | 1 | 42 |
 
12
  | `tiny-aya-base/condition-1-en-5k-seed123/` | 1 | 123 |
13
  | `tiny-aya-base/condition-1-en-5k-seed42/` | 1 | 42 |
14
  | `tiny-aya-base/condition-1-en-5k-seed456/` | 1 | 456 |
15
  | `tiny-aya-base/condition-2-es-20k-seed42/` | 2 | 42 |
 
16
  | `tiny-aya-base/condition-2-es-5k-seed123/` | 2 | 123 |
17
  | `tiny-aya-base/condition-2-es-5k-seed42/` | 2 | 42 |
18
  | `tiny-aya-base/condition-2-es-5k-seed456/` | 2 | 456 |
19
  | `tiny-aya-base/condition-2-ur-20k-seed42/` | 2 | 42 |
 
20
  | `tiny-aya-base/condition-2-ur-5k-seed123/` | 2 | 123 |
21
  | `tiny-aya-base/condition-2-ur-5k-seed42/` | 2 | 42 |
22
  | `tiny-aya-base/condition-2-ur-5k-seed456/` | 2 | 456 |
23
  | `tiny-aya-base/condition-2-zh-20k-seed42/` | 2 | 42 |
 
24
  | `tiny-aya-base/condition-2-zh-5k-seed123/` | 2 | 123 |
25
  | `tiny-aya-base/condition-2-zh-5k-seed42/` | 2 | 42 |
26
  | `tiny-aya-base/condition-2-zh-5k-seed456/` | 2 | 456 |
27
  | `tiny-aya-base/condition-3-zh-5k-native-code-seed42/` | 3 | 42 |
 
28
  | `tiny-aya-base/condition-5-es-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
 
29
  | `tiny-aya-base/condition-5-ur-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
 
30
  | `tiny-aya-base/condition-5-zh-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
 
31
 
32
  ## Phase 2 β€” preliminary adapters (`bigcode/the-stack` v1, Legesher v0.5.1 / v0.6.0)
33
 
 
9
  | Adapter path | Condition | Seed |
10
  | --- | --- | --- |
11
  | `tiny-aya-base/condition-1-en-20k-seed42/` | 1 | 42 |
12
+ | `tiny-aya-base/condition-1-en-20k-seed123/` | 1 | 123 |
13
  | `tiny-aya-base/condition-1-en-5k-seed123/` | 1 | 123 |
14
  | `tiny-aya-base/condition-1-en-5k-seed42/` | 1 | 42 |
15
  | `tiny-aya-base/condition-1-en-5k-seed456/` | 1 | 456 |
16
  | `tiny-aya-base/condition-2-es-20k-seed42/` | 2 | 42 |
17
+ | `tiny-aya-base/condition-2-es-20k-seed123/` | 2 | 123 |
18
  | `tiny-aya-base/condition-2-es-5k-seed123/` | 2 | 123 |
19
  | `tiny-aya-base/condition-2-es-5k-seed42/` | 2 | 42 |
20
  | `tiny-aya-base/condition-2-es-5k-seed456/` | 2 | 456 |
21
  | `tiny-aya-base/condition-2-ur-20k-seed42/` | 2 | 42 |
22
+ | `tiny-aya-base/condition-2-ur-20k-seed123/` | 2 | 123 |
23
  | `tiny-aya-base/condition-2-ur-5k-seed123/` | 2 | 123 |
24
  | `tiny-aya-base/condition-2-ur-5k-seed42/` | 2 | 42 |
25
  | `tiny-aya-base/condition-2-ur-5k-seed456/` | 2 | 456 |
26
  | `tiny-aya-base/condition-2-zh-20k-seed42/` | 2 | 42 |
27
+ | `tiny-aya-base/condition-2-zh-20k-seed123/` | 2 | 123 |
28
  | `tiny-aya-base/condition-2-zh-5k-seed123/` | 2 | 123 |
29
  | `tiny-aya-base/condition-2-zh-5k-seed42/` | 2 | 42 |
30
  | `tiny-aya-base/condition-2-zh-5k-seed456/` | 2 | 456 |
31
  | `tiny-aya-base/condition-3-zh-5k-native-code-seed42/` | 3 | 42 |
32
+ | `tiny-aya-base/condition-3-zh-5k-native-code-seed123/` | 3 | 123 |
33
  | `tiny-aya-base/condition-5-es-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
34
+ | `tiny-aya-base/condition-5-es-5k-c4ai-aya-expanse-32b-seed123/` | 5 | 123 |
35
  | `tiny-aya-base/condition-5-ur-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
36
+ | `tiny-aya-base/condition-5-ur-5k-c4ai-aya-expanse-32b-seed123/` | 5 | 123 |
37
  | `tiny-aya-base/condition-5-zh-5k-c4ai-aya-expanse-32b-seed42/` | 5 | 42 |
38
+ | `tiny-aya-base/condition-5-zh-5k-c4ai-aya-expanse-32b-seed123/` | 5 | 123 |
39
 
40
  ## Phase 2 β€” preliminary adapters (`bigcode/the-stack` v1, Legesher v0.5.1 / v0.6.0)
41
 
README.md CHANGED
@@ -63,11 +63,11 @@ Each subdirectory under `tiny-aya-base/` is one trained condition Γ— file-volume
63
  | Subdirectory (under `tiny-aya-base/`) | Condition | Training data | Seeds |
64
  | ------------------------------------------------------------------------ | --------- | ---------------------------------------------------------------------------------------------------------------------------------------------- | ---------- |
65
  | `tiny-aya-base/condition-1-en-5k-seed{42,123,456}/` | 1 | Raw English Python from `bigcode/the-stack-v2-dedup` (5k file subset) | 42, 123, 456 |
66
- | `tiny-aya-base/condition-1-en-20k-seed42/` | 1 | Raw English Python (20k file subset) | 42 |
67
  | `tiny-aya-base/condition-2-{zh,es,ur}-5k-seed{42,123,456}/` | 2 | The **same 5k subset as cond-1**, processed through Legesher v0.7.3 β€” Python's reserved words (keywords, exceptions, built-in functions, numerical system for some target languages) translated to the target language; user logic preserved | 42, 123, 456 |
68
- | `tiny-aya-base/condition-2-{zh,es,ur}-20k-seed42/` | 2 | The **same 20k subset as cond-1**, processed through Legesher v0.7.3 | 42 |
69
- | `tiny-aya-base/condition-3-zh-5k-native-code-seed42/` | 3 | Community-collected raw Chinese code from varied online public-source repositories (different source-file population from cond-1/2/5 by design) | 42 |
70
- | `tiny-aya-base/condition-5-{zh,es,ur}-5k-c4ai-aya-expanse-32b-seed42/` | 5 | The **same 5k subset as cond-1**, first transpiled by Legesher v0.7.3 to translate Python's reserved words, then run through `c4ai-aya-expanse-32b` via the Cohere API to translate the remaining content (identifiers, comments, docstrings, string literals) | 42 |
71
 
72
  **Condition 4 ("Community-Contributed Native Code")** is pending sufficient direct community contributions to the [`legesher/legesher-native-code`](https://huggingface.co/spaces/legesher/legesher-native-code) HF Space; no cond-4 adapter exists yet.
73
 
@@ -106,7 +106,7 @@ The two adapter generations are distinguished by **folder location and source co
106
 
107
  | Generation | Location in this repo | Source corpus | Legesher | Tier / seeds | Cite for paper? |
108
  | --- | --- | --- | --- | --- | --- |
109
- | **Phase 3 (paper)** | `tiny-aya-base/…-seed*/` | [`bigcode/the-stack-v2-dedup`](https://huggingface.co/datasets/bigcode/the-stack-v2-dedup) | v0.7.3 | 5k (3 seeds) + 20k (1 seed) | βœ… Yes |
110
  | **Phase 2 (preliminary)** | flat top-level `condition-*/` | [`bigcode/the-stack`](https://huggingface.co/datasets/bigcode/the-stack) (v1) | v0.5.1 / v0.6.0 | 5k / 32k (1 seed) | ❌ No |
111
 
112
  A complete, machine-readable path β†’ phase β†’ corpus β†’ condition map is in [`MANIFEST.md`](MANIFEST.md). Training-data provenance for each condition is detailed on [`language-decoded-data`](https://huggingface.co/datasets/legesher/language-decoded-data); the phase comparison is in the ["Phase 2 β†’ Phase 3 at a glance"](https://huggingface.co/datasets/legesher/language-decoded-experiments#phase-2--phase-3-at-a-glance) table on the experiments repo.
 
63
  | Subdirectory (under `tiny-aya-base/`) | Condition | Training data | Seeds |
64
  | ------------------------------------------------------------------------ | --------- | ---------------------------------------------------------------------------------------------------------------------------------------------- | ---------- |
65
  | `tiny-aya-base/condition-1-en-5k-seed{42,123,456}/` | 1 | Raw English Python from `bigcode/the-stack-v2-dedup` (5k file subset) | 42, 123, 456 |
66
+ | `tiny-aya-base/condition-1-en-20k-seed{42,123}/` | 1 | Raw English Python (20k file subset) | 42, 123 |
67
  | `tiny-aya-base/condition-2-{zh,es,ur}-5k-seed{42,123,456}/` | 2 | The **same 5k subset as cond-1**, processed through Legesher v0.7.3 β€” Python's reserved words (keywords, exceptions, built-in functions, numerical system for some target languages) translated to the target language; user logic preserved | 42, 123, 456 |
68
+ | `tiny-aya-base/condition-2-{zh,es,ur}-20k-seed{42,123}/` | 2 | The **same 20k subset as cond-1**, processed through Legesher v0.7.3 | 42, 123 |
69
+ | `tiny-aya-base/condition-3-zh-5k-native-code-seed{42,123}/` | 3 | Community-collected raw Chinese code from varied online public-source repositories (different source-file population from cond-1/2/5 by design) | 42, 123 |
70
+ | `tiny-aya-base/condition-5-{zh,es,ur}-5k-c4ai-aya-expanse-32b-seed{42,123}/` | 5 | The **same 5k subset as cond-1**, first transpiled by Legesher v0.7.3 to translate Python's reserved words, then run through `c4ai-aya-expanse-32b` via the Cohere API to translate the remaining content (identifiers, comments, docstrings, string literals) | 42, 123 |
71
 
72
  **Condition 4 ("Community-Contributed Native Code")** is pending sufficient direct community contributions to the [`legesher/legesher-native-code`](https://huggingface.co/spaces/legesher/legesher-native-code) HF Space; no cond-4 adapter exists yet.
73
 
 
106
 
107
  | Generation | Location in this repo | Source corpus | Legesher | Tier / seeds | Cite for paper? |
108
  | --- | --- | --- | --- | --- | --- |
109
+ | **Phase 3 (paper)** | `tiny-aya-base/…-seed*/` | [`bigcode/the-stack-v2-dedup`](https://huggingface.co/datasets/bigcode/the-stack-v2-dedup) | v0.7.3 | 5k (3 seeds for cond-1 and cond-2; 2 seeds for cond-3 and cond-5) + 20k (2 seeds) | βœ… Yes |
110
  | **Phase 2 (preliminary)** | flat top-level `condition-*/` | [`bigcode/the-stack`](https://huggingface.co/datasets/bigcode/the-stack) (v1) | v0.5.1 / v0.6.0 | 5k / 32k (1 seed) | ❌ No |
111
 
112
  A complete, machine-readable path β†’ phase β†’ corpus β†’ condition map is in [`MANIFEST.md`](MANIFEST.md). Training-data provenance for each condition is detailed on [`language-decoded-data`](https://huggingface.co/datasets/legesher/language-decoded-data); the phase comparison is in the ["Phase 2 β†’ Phase 3 at a glance"](https://huggingface.co/datasets/legesher/language-decoded-experiments#phase-2--phase-3-at-a-glance) table on the experiments repo.