Add verified final HRM H4 BP16 KVReuse12 weights (5e191387, step114274)
Browse files- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/README.md +41 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/checkpoint_receipt.json +51 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/config.json +159 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/launch_config.env +18 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/launch_config.yaml +42 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/manifest.json +62 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/model.safetensors +3 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/original_model.safetensors +3 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/tokenizer/tokenizer.json +0 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_code.tar.gz +3 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_completion.json +14 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_exit.json +6 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_recipe.json +235 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_revision.json +10 -0
- small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_source_hashes.json +487 -0
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/README.md
ADDED
|
@@ -0,0 +1,41 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387
|
| 2 |
+
|
| 3 |
+
Completed epoch 1, optimizer step 114274; 246,349,824 parameters.
|
| 4 |
+
`model.safetensors` contains final EMA weights, matching training reference evaluation.
|
| 5 |
+
`original_model.safetensors` contains ordinary final weights. This is a native weights-only export.
|
| 6 |
+
Optimizer and recovery state remain in the original local FSDP2 checkpoint.
|
| 7 |
+
Training consumed 14,922,536,242 input tokens and 6,402,595,422 response labels.
|
| 8 |
+
Finished successfully on 16 H20 GPUs at 2026-10-08 01:33:58 Asia/Shanghai.
|
| 9 |
+
No final generation benchmark score is claimed.
|
| 10 |
+
|
| 11 |
+
This model uses H4/BP16 with KVReuse12 cycle sources **[1,2,1,2]** during training and inference.
|
| 12 |
+
Cycles 3 and 4 reuse the complete KV banks from cycles 1 and 2, respectively;
|
| 13 |
+
queries, gates, residuals and MLPs remain fresh, and source KV gradients were attached.
|
| 14 |
+
All 140 block calls still execute. Generation has 70 persistent KV banks:
|
| 15 |
+
215,040 bytes/token/sequence in BF16, or 840 MiB at batch1 and cache capacity4096,
|
| 16 |
+
excluding weights and temporary workspace. Do not load using ordinary HRM semantics.
|
| 17 |
+
|
| 18 |
+
Source W&B: https://wandb.ai/LoopTF-4-CSPs/lookahead_hrm_small_search/runs/5e191387.
|
| 19 |
+
Training base revision: `24e8310581000309bad97cb807ed5857ab0d0c85` plus the local KVReuse12 overlay.
|
| 20 |
+
The bundled `training_code.tar.gz` contains the exact run source snapshot, including
|
| 21 |
+
the KV-reuse adapter and evaluation loader. This is required because the overlay was
|
| 22 |
+
not committed to the base revision. Extract it and put its `src` on PYTHONPATH;
|
| 23 |
+
install the project dependencies using PyTorch2.13.0 and the pinned upstream source.
|
| 24 |
+
HRM-Text upstream must be pinned to `aaa948ea674fd84b7bc455c9cfb455ecfefdf914`.
|
| 25 |
+
This custom architecture is not a Transformers `AutoModel.from_pretrained` checkpoint.
|
| 26 |
+
|
| 27 |
+
```python
|
| 28 |
+
import json
|
| 29 |
+
from safetensors.torch import load_file
|
| 30 |
+
from hrm_text_tf.official.evaluation.checkpoint import build_model
|
| 31 |
+
with open('config.json') as f:
|
| 32 |
+
config = json.load(f)
|
| 33 |
+
state = load_file('model.safetensors', device='cpu')
|
| 34 |
+
model = build_model(state, config['native_model_config'], '/path/to/pinned/HRM-Text')
|
| 35 |
+
# build_model applies strict=True and assign=True and enables the saved KV-reuse policy.
|
| 36 |
+
```
|
| 37 |
+
|
| 38 |
+
Use `original_model.safetensors` instead to load ordinary final weights.
|
| 39 |
+
The checkpoint receipt and all 78 saved optimizer step counters independently confirm step114274.
|
| 40 |
+
Both weight sets passed finite checks, strict native loading, and exact source tensor/chunk comparisons.
|
| 41 |
+
The manifest records sizes and SHA256 hashes of every payload file except itself.
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/checkpoint_receipt.json
ADDED
|
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"epoch": 1,
|
| 3 |
+
"epoch_step": 114274,
|
| 4 |
+
"epoch_micro_step": 114274,
|
| 5 |
+
"accumulation_steps": 1,
|
| 6 |
+
"reference_replicas": 16,
|
| 7 |
+
"gradient_reduction": "sum",
|
| 8 |
+
"gradient_reference_replicas": 16,
|
| 9 |
+
"gradient_scale": 1.0,
|
| 10 |
+
"step": 114274,
|
| 11 |
+
"input_tokens": 14922536242,
|
| 12 |
+
"response_labels": 6402595422,
|
| 13 |
+
"examples": 57699115,
|
| 14 |
+
"debug_partial_epoch": false,
|
| 15 |
+
"max_grad_norm": null,
|
| 16 |
+
"continuation": null,
|
| 17 |
+
"architecture": {
|
| 18 |
+
"arm": "hrm",
|
| 19 |
+
"kv_reuse": {
|
| 20 |
+
"cycle_sources": [
|
| 21 |
+
1,
|
| 22 |
+
2,
|
| 23 |
+
1,
|
| 24 |
+
2
|
| 25 |
+
],
|
| 26 |
+
"scope": "all_layers_all_L_passes_and_H",
|
| 27 |
+
"current_token": "reuse",
|
| 28 |
+
"source_gradient": "attached"
|
| 29 |
+
},
|
| 30 |
+
"recipe_profile": "small_search_1epoch",
|
| 31 |
+
"forward_blocks": 140,
|
| 32 |
+
"hrm": {
|
| 33 |
+
"hidden_size": 768,
|
| 34 |
+
"num_heads": 12,
|
| 35 |
+
"expansion": 4,
|
| 36 |
+
"h_layers": 11,
|
| 37 |
+
"l_layers": 8,
|
| 38 |
+
"h_cycles": 4,
|
| 39 |
+
"l_cycles": 3
|
| 40 |
+
},
|
| 41 |
+
"lookahead_shape": null,
|
| 42 |
+
"response_ce_weights": [
|
| 43 |
+
1.0
|
| 44 |
+
],
|
| 45 |
+
"auxiliary_losses": null,
|
| 46 |
+
"pass_schedule": null,
|
| 47 |
+
"forward_blocks_convention": "maximum K; actual K and block calls logged each update"
|
| 48 |
+
},
|
| 49 |
+
"pass_schedule": null,
|
| 50 |
+
"pass_accounting": {}
|
| 51 |
+
}
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/config.json
ADDED
|
@@ -0,0 +1,159 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"architecture": "hrm_text",
|
| 3 |
+
"checkpoint_format": "safetensors_native_hrm_text_state_dict",
|
| 4 |
+
"dtype": [
|
| 5 |
+
"torch.bfloat16",
|
| 6 |
+
"torch.float32"
|
| 7 |
+
],
|
| 8 |
+
"effective_architecture": {
|
| 9 |
+
"arm": "hrm",
|
| 10 |
+
"auxiliary_losses": null,
|
| 11 |
+
"forward_blocks": 140,
|
| 12 |
+
"forward_blocks_convention": "maximum K; actual K and block calls logged each update",
|
| 13 |
+
"hrm": {
|
| 14 |
+
"expansion": 4,
|
| 15 |
+
"h_cycles": 4,
|
| 16 |
+
"h_layers": 11,
|
| 17 |
+
"hidden_size": 768,
|
| 18 |
+
"l_cycles": 3,
|
| 19 |
+
"l_layers": 8,
|
| 20 |
+
"num_heads": 12
|
| 21 |
+
},
|
| 22 |
+
"kv_reuse": {
|
| 23 |
+
"current_token": "reuse",
|
| 24 |
+
"cycle_sources": [
|
| 25 |
+
1,
|
| 26 |
+
2,
|
| 27 |
+
1,
|
| 28 |
+
2
|
| 29 |
+
],
|
| 30 |
+
"scope": "all_layers_all_L_passes_and_H",
|
| 31 |
+
"source_gradient": "attached"
|
| 32 |
+
},
|
| 33 |
+
"lookahead": null,
|
| 34 |
+
"lookahead_shape": null,
|
| 35 |
+
"pass_schedule": null,
|
| 36 |
+
"recipe_profile": "small_search_1epoch",
|
| 37 |
+
"response_ce_weights": [
|
| 38 |
+
1.0
|
| 39 |
+
]
|
| 40 |
+
},
|
| 41 |
+
"epoch": 1,
|
| 42 |
+
"export_code_revision": "24e8310581000309bad97cb807ed5857ab0d0c85",
|
| 43 |
+
"inference_kv": {
|
| 44 |
+
"bf16_MiB_at_batch1_capacity4096": 840,
|
| 45 |
+
"bf16_bytes_per_token_per_sequence": 215040,
|
| 46 |
+
"cycle_sources": [
|
| 47 |
+
1,
|
| 48 |
+
2,
|
| 49 |
+
1,
|
| 50 |
+
2
|
| 51 |
+
],
|
| 52 |
+
"persistent_banks": 70
|
| 53 |
+
},
|
| 54 |
+
"iteration": 114274,
|
| 55 |
+
"loading_instructions": "Extract training_code.tar.gz; put src on PYTHONPATH. Use the pinned HRM-Text upstream and build_model(state, native_model_config, source), which loads strictly and enables KVReuse12. model.safetensors is EMA; original_model.safetensors is ordinary final weights.",
|
| 56 |
+
"native_model_config": {
|
| 57 |
+
"H_cycles": 4,
|
| 58 |
+
"H_override": {
|
| 59 |
+
"n_layers": 11
|
| 60 |
+
},
|
| 61 |
+
"L_cycles": 3,
|
| 62 |
+
"attn_type": "causal",
|
| 63 |
+
"bp_max_steps": 16,
|
| 64 |
+
"bp_min_steps": 16,
|
| 65 |
+
"bp_warmup_ratio": 0.0,
|
| 66 |
+
"expansion": 4,
|
| 67 |
+
"half_layers": false,
|
| 68 |
+
"head": "lm_head@LMHead",
|
| 69 |
+
"hidden_size": 768,
|
| 70 |
+
"init_type": "lecun_normal",
|
| 71 |
+
"kv_reuse_cycle_sources": [
|
| 72 |
+
1,
|
| 73 |
+
2,
|
| 74 |
+
1,
|
| 75 |
+
2
|
| 76 |
+
],
|
| 77 |
+
"max_seq_len": 4096,
|
| 78 |
+
"n_layers": 8,
|
| 79 |
+
"name": "baselines.hrm_nocarry_bp_warmup@HierarchicalReasoningModel",
|
| 80 |
+
"norm_eps": 1e-06,
|
| 81 |
+
"norm_type": "pre",
|
| 82 |
+
"num_heads": 12,
|
| 83 |
+
"pos_emb_type": "rope",
|
| 84 |
+
"rope_theta": 10000.0,
|
| 85 |
+
"vocab_size": 65536
|
| 86 |
+
},
|
| 87 |
+
"native_source_archive": "training_code.tar.gz",
|
| 88 |
+
"original_run_name": "HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16",
|
| 89 |
+
"original_weights_file": "original_model.safetensors",
|
| 90 |
+
"parameter_count": 246349824,
|
| 91 |
+
"pipeline_parallel_size": 1,
|
| 92 |
+
"run_name": "HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387",
|
| 93 |
+
"source_checkpoint": "/apdcephfs_gy31/share_303214315/hunyuan/kenanchen/loopTF-workspace/output/causal_hrm_text/small_search/double_compute/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16/checkpoints/fsdp2_epoch_1",
|
| 94 |
+
"source_metadata_sha256": "32e7c9787e59111fe3f2f7ff32b2ad1fab280e957df3d1dc9130903f85d530d4",
|
| 95 |
+
"source_wandb": {
|
| 96 |
+
"entity": "LoopTF-4-CSPs",
|
| 97 |
+
"group": "small_search_1epoch",
|
| 98 |
+
"history_step": 114270,
|
| 99 |
+
"history_step_offset": 0,
|
| 100 |
+
"id": "5e191387",
|
| 101 |
+
"name": "HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16",
|
| 102 |
+
"project": "lookahead_hrm_small_search",
|
| 103 |
+
"tags": [
|
| 104 |
+
"product",
|
| 105 |
+
"causal_hrm_text",
|
| 106 |
+
"small_search_1epoch",
|
| 107 |
+
"hrm",
|
| 108 |
+
"flex_causal",
|
| 109 |
+
"h20",
|
| 110 |
+
"small",
|
| 111 |
+
"double_compute",
|
| 112 |
+
"h4",
|
| 113 |
+
"bp16",
|
| 114 |
+
"kv_reuse12",
|
| 115 |
+
"h20x16",
|
| 116 |
+
"no_recompute"
|
| 117 |
+
],
|
| 118 |
+
"url": "https://wandb.ai/LoopTF-4-CSPs/lookahead_hrm_small_search/runs/5e191387"
|
| 119 |
+
},
|
| 120 |
+
"tensor_parallel_size": 1,
|
| 121 |
+
"tokenizer_info": {
|
| 122 |
+
"boq": "<|im_start|>",
|
| 123 |
+
"condition_mapping": {
|
| 124 |
+
"cot": "<|object_ref_end|>",
|
| 125 |
+
"direct": "<|object_ref_start|>",
|
| 126 |
+
"noisy": "<|quad_start|>",
|
| 127 |
+
"synth": "<|quad_end|>"
|
| 128 |
+
},
|
| 129 |
+
"eoa": "<|box_end|>",
|
| 130 |
+
"eoq": "<|im_end|>",
|
| 131 |
+
"tokenizer_path": "/apdcephfs_gy31/share_303214315/hunyuan/kenanchen/loopTF-workspace/data/causal_hrm_text_sources/data_io/trained_tokenizers/bpe/tokenizer.json",
|
| 132 |
+
"vocab_size": 65536
|
| 133 |
+
},
|
| 134 |
+
"tokenizer_sha256": "d569c356b9c88d4fb5fc2ab43f0b9f9c445336d3121588f1f2f6e2bdbc6fdc0f",
|
| 135 |
+
"trainable_parameter_count": 246349824,
|
| 136 |
+
"trained_active_passes": 1,
|
| 137 |
+
"training": {
|
| 138 |
+
"elapsed_seconds": 80416.57231306285,
|
| 139 |
+
"epochs": 1,
|
| 140 |
+
"examples": 57699115,
|
| 141 |
+
"final_checkpoint": "/apdcephfs_gy31/share_303214315/hunyuan/kenanchen/loopTF-workspace/output/causal_hrm_text/small_search/double_compute/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16/checkpoints/fsdp2_epoch_1",
|
| 142 |
+
"input_tokens": 14922536242,
|
| 143 |
+
"partial_epoch": false,
|
| 144 |
+
"pass_accounting": {},
|
| 145 |
+
"pass_schedule": null,
|
| 146 |
+
"response_labels": 6402595422,
|
| 147 |
+
"status": "complete",
|
| 148 |
+
"step": 114274,
|
| 149 |
+
"stop_at_unix_time": null
|
| 150 |
+
},
|
| 151 |
+
"training_code_dirty": true,
|
| 152 |
+
"training_code_overlay": "KVReuse12 local changes",
|
| 153 |
+
"training_code_revision": "24e8310581000309bad97cb807ed5857ab0d0c85",
|
| 154 |
+
"training_source_snapshot_sha256": "6e27c285e62af424136a2641d6fd48c55e5b8f63d3e5d54d4df319a0f18a56de",
|
| 155 |
+
"transformers_auto_model_compatible": false,
|
| 156 |
+
"upstream_revision": "aaa948ea674fd84b7bc455c9cfb455ecfefdf914",
|
| 157 |
+
"weights": "ema",
|
| 158 |
+
"world_size": 16
|
| 159 |
+
}
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/launch_config.env
ADDED
|
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Non-secret effective run receipt; architecture is pinned in config.json and training_recipe.json.
|
| 2 |
+
RUN_NAME=HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16
|
| 3 |
+
WANDB_RUN_ID=5e191387
|
| 4 |
+
NNODES=2
|
| 5 |
+
WORLD_SIZE=16
|
| 6 |
+
TP=1
|
| 7 |
+
PP=1
|
| 8 |
+
DP=16
|
| 9 |
+
PRECISION=bfloat16
|
| 10 |
+
SEED=0
|
| 11 |
+
GLOBAL_BATCH_TOKENS=131072
|
| 12 |
+
LOCAL_BATCH_TOKENS=8192
|
| 13 |
+
ACCUMULATION_STEPS=1
|
| 14 |
+
RECOMPUTATION=off
|
| 15 |
+
BP_STEPS=16
|
| 16 |
+
KV_REUSE_CYCLE_SOURCES=1,2,1,2
|
| 17 |
+
EPOCHS=1
|
| 18 |
+
FINAL_STEP=114274
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/launch_config.yaml
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
arch:
|
| 2 |
+
H_cycles: 4
|
| 3 |
+
H_override:
|
| 4 |
+
n_layers: 11
|
| 5 |
+
L_cycles: 3
|
| 6 |
+
attn_type: causal
|
| 7 |
+
bp_max_steps: 16
|
| 8 |
+
bp_min_steps: 16
|
| 9 |
+
bp_warmup_ratio: 0.0
|
| 10 |
+
expansion: 4
|
| 11 |
+
half_layers: false
|
| 12 |
+
hidden_size: 768
|
| 13 |
+
kv_reuse_cycle_sources:
|
| 14 |
+
- 1
|
| 15 |
+
- 2
|
| 16 |
+
- 1
|
| 17 |
+
- 2
|
| 18 |
+
n_layers: 8
|
| 19 |
+
num_heads: 12
|
| 20 |
+
checkpoint_path: /root/dl/runtime/script/loopTF-workspace/output/causal_hrm_text/small_search/double_compute/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch
|
| 21 |
+
data:
|
| 22 |
+
path: /root/dl/runtime/script/loopTF-workspace/data/causal_hrm_text_sources/sampled
|
| 23 |
+
defaults:
|
| 24 |
+
- cfg_pretrain
|
| 25 |
+
- _self_
|
| 26 |
+
epochs: 1
|
| 27 |
+
experiment:
|
| 28 |
+
arm: hrm
|
| 29 |
+
global_batch_size: 131072
|
| 30 |
+
hydra:
|
| 31 |
+
run:
|
| 32 |
+
dir: /root/dl/runtime/script/loopTF-workspace/output/causal_hrm_text/small_search/double_compute/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch
|
| 33 |
+
lr: 0.0003
|
| 34 |
+
lr_warmup_steps: 750
|
| 35 |
+
project_name: lookahead_hrm_small_search
|
| 36 |
+
recipe_profile: small_search_1epoch
|
| 37 |
+
reference_validation:
|
| 38 |
+
capacity: 4096
|
| 39 |
+
every: 1000
|
| 40 |
+
suite: /root/dl/runtime/script/loopTF-workspace/data/evaluation/hrm_text/reference-v1-seed20261004
|
| 41 |
+
weights: ema
|
| 42 |
+
run_name: HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/manifest.json
ADDED
|
@@ -0,0 +1,62 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"files": {
|
| 3 |
+
"README.md": {
|
| 4 |
+
"sha256": "c5d1f70bbce290a5ab5707a65bb0e6e08ca2c1a2b2d84f6c04c75fb951004dc4",
|
| 5 |
+
"size": 2638
|
| 6 |
+
},
|
| 7 |
+
"checkpoint_receipt.json": {
|
| 8 |
+
"sha256": "da0e8aba2db741f123bd0d4997181d91328705c66d749ca1adcb139e3aed026f",
|
| 9 |
+
"size": 1186
|
| 10 |
+
},
|
| 11 |
+
"config.json": {
|
| 12 |
+
"sha256": "97c14a00470d61bcc58c684bf18f980994a5d4f4fc561097f03652508accf2f6",
|
| 13 |
+
"size": 5454
|
| 14 |
+
},
|
| 15 |
+
"launch_config.env": {
|
| 16 |
+
"sha256": "574f5bdc6d10796a6b97b56a536ef6481d42f81fb37088d7f4f8ee7bb0d8c039",
|
| 17 |
+
"size": 473
|
| 18 |
+
},
|
| 19 |
+
"launch_config.yaml": {
|
| 20 |
+
"sha256": "ba9df7010431ca417e5c6f70b6f64ca90832d6080aac1581e94f1c613f659026",
|
| 21 |
+
"size": 1191
|
| 22 |
+
},
|
| 23 |
+
"model.safetensors": {
|
| 24 |
+
"sha256": "53e0366dc8aa8777d194c1665e884889d17b0844e7c75d15963c2fc30c5af96a",
|
| 25 |
+
"size": 985410544
|
| 26 |
+
},
|
| 27 |
+
"original_model.safetensors": {
|
| 28 |
+
"sha256": "b02549e557382a8289793f8b83a97aeb93113b9732a0106ac72c0b511d246145",
|
| 29 |
+
"size": 985410544
|
| 30 |
+
},
|
| 31 |
+
"tokenizer/tokenizer.json": {
|
| 32 |
+
"sha256": "d569c356b9c88d4fb5fc2ab43f0b9f9c445336d3121588f1f2f6e2bdbc6fdc0f",
|
| 33 |
+
"size": 4732721
|
| 34 |
+
},
|
| 35 |
+
"training_code.tar.gz": {
|
| 36 |
+
"sha256": "6e27c285e62af424136a2641d6fd48c55e5b8f63d3e5d54d4df319a0f18a56de",
|
| 37 |
+
"size": 409879
|
| 38 |
+
},
|
| 39 |
+
"training_completion.json": {
|
| 40 |
+
"sha256": "89a80ab538cfabde91b4457b30be2427efcb97d3ed91cd4b5bbb50ef5caf769b",
|
| 41 |
+
"size": 579
|
| 42 |
+
},
|
| 43 |
+
"training_exit.json": {
|
| 44 |
+
"sha256": "d70f43195eca5e72bc547f23d960625c2ea07be06815afcfe52349849d1e64aa",
|
| 45 |
+
"size": 121
|
| 46 |
+
},
|
| 47 |
+
"training_recipe.json": {
|
| 48 |
+
"sha256": "8765b67342646a0f64e18ca9c3751eaadfded2821b10900c340d95871c5ef38a",
|
| 49 |
+
"size": 6747
|
| 50 |
+
},
|
| 51 |
+
"training_revision.json": {
|
| 52 |
+
"sha256": "14acea9e98cdf38501a7c1a34b11330ef11db65dfbaa97dab114857feea17b07",
|
| 53 |
+
"size": 193
|
| 54 |
+
},
|
| 55 |
+
"training_source_hashes.json": {
|
| 56 |
+
"sha256": "c77eea58f77dbd38002aa3f645b58acd9d85d1b8bbb76b50e00de5f9bb4a65c7",
|
| 57 |
+
"size": 64246
|
| 58 |
+
}
|
| 59 |
+
},
|
| 60 |
+
"manifest_excludes_itself": true,
|
| 61 |
+
"schema_version": 1
|
| 62 |
+
}
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:53e0366dc8aa8777d194c1665e884889d17b0844e7c75d15963c2fc30c5af96a
|
| 3 |
+
size 985410544
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/original_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b02549e557382a8289793f8b83a97aeb93113b9732a0106ac72c0b511d246145
|
| 3 |
+
size 985410544
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/tokenizer/tokenizer.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_code.tar.gz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6e27c285e62af424136a2641d6fd48c55e5b8f63d3e5d54d4df319a0f18a56de
|
| 3 |
+
size 409879
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_completion.json
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"status": "complete",
|
| 3 |
+
"partial_epoch": false,
|
| 4 |
+
"stop_at_unix_time": null,
|
| 5 |
+
"final_checkpoint": "/apdcephfs_gy31/share_303214315/hunyuan/kenanchen/loopTF-workspace/output/causal_hrm_text/small_search/double_compute/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16/checkpoints/fsdp2_epoch_1",
|
| 6 |
+
"epochs": 1,
|
| 7 |
+
"step": 114274,
|
| 8 |
+
"input_tokens": 14922536242,
|
| 9 |
+
"response_labels": 6402595422,
|
| 10 |
+
"examples": 57699115,
|
| 11 |
+
"elapsed_seconds": 80416.57231306285,
|
| 12 |
+
"pass_schedule": null,
|
| 13 |
+
"pass_accounting": {}
|
| 14 |
+
}
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_exit.json
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"status": "succeeded",
|
| 3 |
+
"exit_code": 0,
|
| 4 |
+
"keeper_restore_exit": 0,
|
| 5 |
+
"ended": "2026-10-08T01:33:58.233041+08:00"
|
| 6 |
+
}
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_recipe.json
ADDED
|
@@ -0,0 +1,235 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"launching_card": "/root/dl/runtime/script/loopTF-workspace/launchings/product/20261007_hrm_h4_kv_reuse/20261007-031120_hrm-h4-bp16-kvreuse12-h20x16.md",
|
| 3 |
+
"upstream_revision": "aaa948ea674fd84b7bc455c9cfb455ecfefdf914",
|
| 4 |
+
"recipe": {
|
| 5 |
+
"arch": {
|
| 6 |
+
"name": "baselines.hrm_nocarry_bp_warmup@HierarchicalReasoningModel",
|
| 7 |
+
"head": "lm_head@LMHead",
|
| 8 |
+
"half_layers": false,
|
| 9 |
+
"H_cycles": 4,
|
| 10 |
+
"L_cycles": 3,
|
| 11 |
+
"H_override": {
|
| 12 |
+
"n_layers": 11
|
| 13 |
+
},
|
| 14 |
+
"bp_warmup_ratio": 0.0,
|
| 15 |
+
"bp_max_steps": 16,
|
| 16 |
+
"n_layers": 8,
|
| 17 |
+
"hidden_size": 768,
|
| 18 |
+
"num_heads": 12,
|
| 19 |
+
"expansion": 4,
|
| 20 |
+
"norm_type": "pre",
|
| 21 |
+
"norm_eps": 1e-06,
|
| 22 |
+
"rope_theta": 10000.0,
|
| 23 |
+
"pos_emb_type": "rope",
|
| 24 |
+
"init_type": "lecun_normal",
|
| 25 |
+
"attn_type": "causal",
|
| 26 |
+
"bp_min_steps": 16,
|
| 27 |
+
"kv_reuse_cycle_sources": [
|
| 28 |
+
1,
|
| 29 |
+
2,
|
| 30 |
+
1,
|
| 31 |
+
2
|
| 32 |
+
]
|
| 33 |
+
},
|
| 34 |
+
"data": {
|
| 35 |
+
"path": "/root/dl/runtime/script/loopTF-workspace/data/causal_hrm_text_sources/sampled",
|
| 36 |
+
"target_only": true
|
| 37 |
+
},
|
| 38 |
+
"global_batch_size": 131072,
|
| 39 |
+
"epochs": 1,
|
| 40 |
+
"lr": 0.0003,
|
| 41 |
+
"lr_min_ratio": 1.0,
|
| 42 |
+
"lr_warmup_steps": 750,
|
| 43 |
+
"weight_decay": 0.1,
|
| 44 |
+
"beta1": 0.9,
|
| 45 |
+
"beta2": 0.95,
|
| 46 |
+
"ema": 0.9999,
|
| 47 |
+
"fwd_bwd_dtype": "bfloat16",
|
| 48 |
+
"project_name": "lookahead_hrm_small_search",
|
| 49 |
+
"run_name": "HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16",
|
| 50 |
+
"checkpoint_path": "/apdcephfs_gy31/share_303214315/hunyuan/kenanchen/loopTF-workspace/output/causal_hrm_text/small_search/double_compute/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16/checkpoints",
|
| 51 |
+
"resume_from": null,
|
| 52 |
+
"resume_epoch": null,
|
| 53 |
+
"weights_only_resume_from_ema": false,
|
| 54 |
+
"seed": 0,
|
| 55 |
+
"checkpoint_interval": 1,
|
| 56 |
+
"log_interval": 5
|
| 57 |
+
},
|
| 58 |
+
"parameters": 246349824,
|
| 59 |
+
"world_size": 16,
|
| 60 |
+
"local_batch_tokens": 8192,
|
| 61 |
+
"estimated_total_steps": 114296,
|
| 62 |
+
"execution": {
|
| 63 |
+
"stop_at_unix_time": null,
|
| 64 |
+
"runtime_cache_rank0": "/root/dl/runtime/script/loopTF-workspace/data/cache/hrm_official/runtime/2453d904b6db17ca3c23/rank0",
|
| 65 |
+
"attention": "flex_triton_segmented_causal",
|
| 66 |
+
"checkpointing": false,
|
| 67 |
+
"checkpointing_skip_every": 0,
|
| 68 |
+
"checkpointing_retain_two_thirds_k2": false,
|
| 69 |
+
"checkpointing_min_passes": 0,
|
| 70 |
+
"compile_blocks": true,
|
| 71 |
+
"hrm_fsdp_grouping": "block",
|
| 72 |
+
"compile_optimizer": true,
|
| 73 |
+
"compile_vocabulary_loss": false,
|
| 74 |
+
"split_pseudo_attention": false,
|
| 75 |
+
"compile_a2_mix": false,
|
| 76 |
+
"lookahead_fsdp_grouping": "block",
|
| 77 |
+
"accumulation_steps": 1,
|
| 78 |
+
"gradient_reduction": "sum",
|
| 79 |
+
"gradient_reference_replicas": 16,
|
| 80 |
+
"gradient_scale": 1.0,
|
| 81 |
+
"virtual_replicas": 16,
|
| 82 |
+
"micro_batch_tokens": 131072,
|
| 83 |
+
"redistribution": null
|
| 84 |
+
},
|
| 85 |
+
"debug": {
|
| 86 |
+
"max_steps": 0,
|
| 87 |
+
"force_bp": 0,
|
| 88 |
+
"force_passes": null,
|
| 89 |
+
"benchmark_execution": false,
|
| 90 |
+
"step_offset": 0
|
| 91 |
+
},
|
| 92 |
+
"data_order": "official multipack, no holdout, upstream per-epoch drop_last",
|
| 93 |
+
"torch": "2.13.0+cu129",
|
| 94 |
+
"cuda": "12.9",
|
| 95 |
+
"gpu": "NVIDIA H20",
|
| 96 |
+
"config_sha256": "7b2031673859fea78e95c4cb2be3b2c93a3393780b2e7cef68b55c6649a08a1d",
|
| 97 |
+
"resolved_overrides": {
|
| 98 |
+
"epochs": 1,
|
| 99 |
+
"lr": 0.0003,
|
| 100 |
+
"global_batch_size": 131072,
|
| 101 |
+
"lr_warmup_steps": 750,
|
| 102 |
+
"arch": {
|
| 103 |
+
"half_layers": false,
|
| 104 |
+
"attn_type": "causal",
|
| 105 |
+
"hidden_size": 768,
|
| 106 |
+
"num_heads": 12,
|
| 107 |
+
"expansion": 4,
|
| 108 |
+
"n_layers": 8,
|
| 109 |
+
"H_override": {
|
| 110 |
+
"n_layers": 11
|
| 111 |
+
},
|
| 112 |
+
"H_cycles": 4,
|
| 113 |
+
"L_cycles": 3,
|
| 114 |
+
"bp_min_steps": 16,
|
| 115 |
+
"bp_max_steps": 16,
|
| 116 |
+
"bp_warmup_ratio": 0.0,
|
| 117 |
+
"kv_reuse_cycle_sources": [
|
| 118 |
+
1,
|
| 119 |
+
2,
|
| 120 |
+
1,
|
| 121 |
+
2
|
| 122 |
+
]
|
| 123 |
+
},
|
| 124 |
+
"data": {
|
| 125 |
+
"path": "/root/dl/runtime/script/loopTF-workspace/data/causal_hrm_text_sources/sampled"
|
| 126 |
+
},
|
| 127 |
+
"project_name": "lookahead_hrm_small_search",
|
| 128 |
+
"run_name": "HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch",
|
| 129 |
+
"checkpoint_path": "/root/dl/runtime/script/loopTF-workspace/output/causal_hrm_text/small_search/double_compute/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch"
|
| 130 |
+
},
|
| 131 |
+
"continuation": null,
|
| 132 |
+
"resume": null,
|
| 133 |
+
"resume_execution": null,
|
| 134 |
+
"checkpointing_interval": {
|
| 135 |
+
"save_every": 1000,
|
| 136 |
+
"keep_step_checkpoints": 3,
|
| 137 |
+
"save_first_step": true,
|
| 138 |
+
"verify_first": true
|
| 139 |
+
},
|
| 140 |
+
"max_grad_norm": null,
|
| 141 |
+
"pass_schedule": null,
|
| 142 |
+
"reference_validation": {
|
| 143 |
+
"suite": "/apdcephfs_gy31/share_303214315/hunyuan/kenanchen/loopTF-workspace/data/evaluation/hrm_text/reference-v1-seed20261004",
|
| 144 |
+
"manifest_sha256": "7ac0177529c8a68541f614e2ffacaf4dcb2c9a09d4bab960cd0aef8a8b57fef4",
|
| 145 |
+
"weights": "ema",
|
| 146 |
+
"capacity": 4096,
|
| 147 |
+
"examples": 1280,
|
| 148 |
+
"teacher_forced": true,
|
| 149 |
+
"tasks": {
|
| 150 |
+
"GSM8k": {
|
| 151 |
+
"examples": 256,
|
| 152 |
+
"response_tokens": 24971,
|
| 153 |
+
"packs": 11
|
| 154 |
+
},
|
| 155 |
+
"MATH": {
|
| 156 |
+
"examples": 256,
|
| 157 |
+
"response_tokens": 56990,
|
| 158 |
+
"packs": 21
|
| 159 |
+
},
|
| 160 |
+
"DROP": {
|
| 161 |
+
"examples": 128,
|
| 162 |
+
"response_tokens": 533,
|
| 163 |
+
"packs": 54
|
| 164 |
+
},
|
| 165 |
+
"MMLU": {
|
| 166 |
+
"examples": 128,
|
| 167 |
+
"response_tokens": 128,
|
| 168 |
+
"packs": 22
|
| 169 |
+
},
|
| 170 |
+
"ARC": {
|
| 171 |
+
"examples": 128,
|
| 172 |
+
"response_tokens": 128,
|
| 173 |
+
"packs": 128
|
| 174 |
+
},
|
| 175 |
+
"HellaSwag": {
|
| 176 |
+
"examples": 128,
|
| 177 |
+
"response_tokens": 128,
|
| 178 |
+
"packs": 64
|
| 179 |
+
},
|
| 180 |
+
"Winogrande": {
|
| 181 |
+
"examples": 128,
|
| 182 |
+
"response_tokens": 128,
|
| 183 |
+
"packs": 7
|
| 184 |
+
},
|
| 185 |
+
"BoolQ": {
|
| 186 |
+
"examples": 128,
|
| 187 |
+
"response_tokens": 128,
|
| 188 |
+
"packs": 39
|
| 189 |
+
}
|
| 190 |
+
},
|
| 191 |
+
"every": 1000,
|
| 192 |
+
"first_update": true,
|
| 193 |
+
"training_horizon_changed": false
|
| 194 |
+
},
|
| 195 |
+
"tracking": {
|
| 196 |
+
"mode": "online",
|
| 197 |
+
"entity": "LoopTF-4-CSPs",
|
| 198 |
+
"project": "lookahead_hrm_small_search",
|
| 199 |
+
"group": "small_search_1epoch"
|
| 200 |
+
},
|
| 201 |
+
"architecture": {
|
| 202 |
+
"arm": "hrm",
|
| 203 |
+
"kv_reuse": {
|
| 204 |
+
"cycle_sources": [
|
| 205 |
+
1,
|
| 206 |
+
2,
|
| 207 |
+
1,
|
| 208 |
+
2
|
| 209 |
+
],
|
| 210 |
+
"scope": "all_layers_all_L_passes_and_H",
|
| 211 |
+
"current_token": "reuse",
|
| 212 |
+
"source_gradient": "attached"
|
| 213 |
+
},
|
| 214 |
+
"recipe_profile": "small_search_1epoch",
|
| 215 |
+
"forward_blocks": 140,
|
| 216 |
+
"hrm": {
|
| 217 |
+
"hidden_size": 768,
|
| 218 |
+
"num_heads": 12,
|
| 219 |
+
"expansion": 4,
|
| 220 |
+
"h_layers": 11,
|
| 221 |
+
"l_layers": 8,
|
| 222 |
+
"h_cycles": 4,
|
| 223 |
+
"l_cycles": 3
|
| 224 |
+
},
|
| 225 |
+
"lookahead_shape": null,
|
| 226 |
+
"response_ce_weights": [
|
| 227 |
+
1.0
|
| 228 |
+
],
|
| 229 |
+
"auxiliary_losses": null,
|
| 230 |
+
"pass_schedule": null,
|
| 231 |
+
"forward_blocks_convention": "maximum K; actual K and block calls logged each update",
|
| 232 |
+
"lookahead": null
|
| 233 |
+
},
|
| 234 |
+
"objective": "final_H_response_CE"
|
| 235 |
+
}
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_revision.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"branch": "main",
|
| 3 |
+
"commit": "24e8310581000309bad97cb807ed5857ab0d0c85",
|
| 4 |
+
"dirty": true,
|
| 5 |
+
"overlay": "KVReuse12 local changes",
|
| 6 |
+
"nodes": [
|
| 7 |
+
"29.127.37.30",
|
| 8 |
+
"29.119.96.56"
|
| 9 |
+
]
|
| 10 |
+
}
|
small_search_1epoch/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch__20261007-031120_hrm-h4-bp16-kvreuse12-h20x16--5e191387/step_114274/training_source_hashes.json
ADDED
|
@@ -0,0 +1,487 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"config.yaml": "7b2031673859fea78e95c4cb2be3b2c93a3393780b2e7cef68b55c6649a08a1d",
|
| 3 |
+
"configs/README.md": "d27e6a99230d94161e440d9c60c79334e30a310ebb1d7e2f66d52f2aa6582d18",
|
| 4 |
+
"configs/benchmarks/done_right_pretrain_v3.json": "0ca58a6d7757e31ff5fd72c95c4f350f61a3cdd88a3f8f66b6554f7eec512c6b",
|
| 5 |
+
"configs/benchmarks/hrm_text_official_v1.json": "e01e8a8faaa199daaf16a32eb30cc704c035f4522531db6200e3c09d30dfd52f",
|
| 6 |
+
"configs/benchmarks/ifm_v1.json": "9542228f1a844167f502b225d699451d4b43a97c148af5c19709c3150c0ebf7b",
|
| 7 |
+
"configs/benchmarks/paper2604_prefix_query_v1.json": "b1c7bec8c8df3955fa075e82ce6f9647c8858a5605d6833628c167d209a314c4",
|
| 8 |
+
"configs/benchmarks/paper2604_v1.json": "22f9cb71bf847933136d65dbd25d1659b2b6c7bc53e025d043edbede94872bc4",
|
| 9 |
+
"configs/causal_hrm_text/HRM-H2-L3-H18-L15-BP2to5-seed42.yaml": "9b332109632ab89a958b22e1f3f64a83df865d5cef4f43972322fb2e4c4b682f",
|
| 10 |
+
"configs/causal_hrm_text/Lookahead-K2-LA2-A2-R0-D0-P0-F0-seed42-B30-Ref3-hrmBlock-refinerMemoryOnly.yaml": "d7e18550f13fc07864cf3f0dcecc83eb9989faa287ba21fa5a52a4df2d8c3668",
|
| 11 |
+
"configs/causal_hrm_text/Lookahead-K3-LA2-A2-R0-D0-P0-F0-seed42-B19-Ref4-H1904-FFN4096-hrmBlock-refinerMemoryOnly.yaml": "812d6429764fb57b6e37a1dbe0fafdf6287b8d10eccecee2ea0ea016bbbba861",
|
| 12 |
+
"configs/causal_hrm_text/Lookahead-K3-LA2-A2-R0-D0-P0-F0-seed42-B30-Ref3-hrmBlock-refinerMemoryOnly.yaml": "a066ba04d8123f0a3728707f7c4d2b00d2f848bfd02274ef38dc07afef0c2c47",
|
| 13 |
+
"configs/causal_hrm_text/README.md": "e8fe618066a1dadda99f04787eaa7f128edf3d19038b84bf0ae77172552e085f",
|
| 14 |
+
"configs/causal_hrm_text/common.yaml": "793330f1df1ef7a379c37026a27d546cf99075260d46e6cb3fa91c79a8e3e631",
|
| 15 |
+
"configs/causal_hrm_text/manifest.example.json": "15b773b642744cb00ff5e9c149362b1da5a9fb7057711e92035b1951727fcc64",
|
| 16 |
+
"configs/causal_hrm_text/official_recipe/HRM-H2-L3-H18-L15-causal-AdamATan2-EMA-seed0.yaml": "35fd40b9824b3e5ba1e28521e797a5b6a492fd24d43111bb7de02cd5c4b91804",
|
| 17 |
+
"configs/causal_hrm_text/official_recipe/LOOKAHEAD_PROGRESSIVE_DESIGN.md": "593ff3435c3469391db440d6497cce818927350c5680608a7505918c14763f3e",
|
| 18 |
+
"configs/causal_hrm_text/official_recipe/Lookahead-K2-LA2-A2-R0-D0-P0-F0-seed0-B30-Ref3-AdamATan2-EMA.yaml": "611b403c8105497b9b700538b9a544d63b321f09603e56c2cb301b19213f3082",
|
| 19 |
+
"configs/causal_hrm_text/official_recipe/Lookahead-K2-LA2-A2-R0-D0p2-P0p2-F0-seed0-B30-Ref3-AdamATan2-EMA.yaml": "6d824820ee7c332c20f9298707d0a3bca8f78deb9bbbd2beca30d80a7cece6df",
|
| 20 |
+
"configs/causal_hrm_text/official_recipe/Lookahead-K3-LA2-A2-R0-D0-P0-F0-seed0-B19-Ref4-H1904-FFN4096-hrmBlock-refinerMemoryOnly-AdamATan2-EMA.yaml": "dddcb67f5fc2c3c9a0b17f1622a495577de0a68387a9280d4fe42db8f55d469e",
|
| 21 |
+
"configs/causal_hrm_text/official_recipe/Lookahead-K3-LA2-A2-R0-D0-P0-F0-seed0-B30-Ref3-AdamATan2-EMA-progressiveK-75-90.yaml": "0ea49aeeab27a0d4c163df88daca698be6a1e322a6ca13e61aa1218dbd587bea",
|
| 22 |
+
"configs/causal_hrm_text/official_recipe/Lookahead-K3-LA2-A2-R0-D0-P0-F0-seed0-B30-Ref3-AdamATan2-EMA.yaml": "f54f290a3df7a122d0326d272de2e614eca0d0f6bf34a099fc6c242387a9afc8",
|
| 23 |
+
"configs/causal_hrm_text/official_recipe/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed0-B19-Ref4-H1904-FFN4096-hrmBlock-refinerMemoryOnly-AdamATan2-EMA.yaml": "2ca84993c28ece114c87899ca69ea694d41d5822e2dfd6f4920d3dea016493b2",
|
| 24 |
+
"configs/causal_hrm_text/official_recipe/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed0-B30-Ref3-AdamATan2-EMA-progressiveK-75-90.yaml": "a4a880078167ce52c844e909ca337148da2e51a0177c905f4486c8a9e554d989",
|
| 25 |
+
"configs/causal_hrm_text/official_recipe/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed0-B30-Ref3-AdamATan2-EMA.yaml": "ec2cb16e2f138f6e119c60c6298b8b76b59bd6efbacc74e2c2a7cb1a0e03518d",
|
| 26 |
+
"configs/causal_hrm_text/official_recipe/README.md": "792e150e1663845754efbf2628980796d6fe457edbf621fe86955754c68f5f06",
|
| 27 |
+
"configs/causal_hrm_text/official_recipe/base/lookahead_hrm_cycle.yaml": "b050ddc1dc4698b650fb7141953a6e682488c9d87fa516e550f8b0bba135452d",
|
| 28 |
+
"configs/causal_hrm_text/official_recipe/base/small_hrm.yaml": "fd72cd16fb188bffc07e5c6065156a93eb496211bd14ce0dd563cb38ca05d43f",
|
| 29 |
+
"configs/causal_hrm_text/official_recipe/base/small_lookahead_hrm_cycle.yaml": "7fa4a97f76c8cf6a51bf0fc522271a3429f245802d053658a39a038b814509c9",
|
| 30 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/Lookahead-K1-LA2-A2-R0-D0-P0-F0-seed0-H18-L15x3-hrmCycle-Ref3-AdamATan2-EMA.yaml": "08b976173d53cdeed0ea4c5ade56319b74d3da95ab6bc04980935653d2c07b3d",
|
| 31 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/Lookahead-K1-LA2-A2-R0-D0-P0p2-F0-seed0-W1440-H18-L15x3-hrmCycle-Ref3-lowRealFinal-AdamATan2-EMA.yaml": "fedb1c5fac44b7898d4414eff4358654c270171264c7e36475ec5620a4cca0ab",
|
| 32 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-H18-L15x3-hrmCycle-Ref3-AdamATan2-EMA.yaml": "add4cda7c47d6574aecbd43322654971d5d4db79c1950e32a8738862b06529e7",
|
| 33 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W1440-H15-L15x3-hrmCycle-Ref6-lowRealFinal-AdamATan2-EMA.yaml": "cb24da66893f8e4bcae3261e11c4d7bcf9b39f61889138dceb756d0806cfe79e",
|
| 34 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W1440-H18-L15x3-hrmCycle-Ref3-lowRealFinal-AdamATan2-EMA-fixed.yaml": "3700dd72eda549d952927aac5567846a8f9dc74c9058d1f2c38e0348c6e04391",
|
| 35 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W1440-H18-L15x3-hrmCycle-Ref3-lowRealFinal-AdamATan2-EMA.yaml": "b3f4fa07f7cbc69c0777652c74d92cdf35053cc20afb7606de704039515d69f1",
|
| 36 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed0-H18-L15x3-hrmCycle-Ref3-AdamATan2-EMA-progressiveK-75-90.yaml": "851d10bf54b8ad9199c21108eb4d879754b1921c812ee6eaa1709eb47e24b0d2",
|
| 37 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed0-H18-L15x3-hrmCycle-Ref3-AdamATan2-EMA.yaml": "07f11242383826d5fd8af531e95a3d90baa7fa06a2c8766adb45767e544c73a5",
|
| 38 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/README.md": "4f21d5b172261147adacd7b5e7b7dfc19d27511d6c66e60783ae5358a342efca",
|
| 39 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/candidates/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W1440-H15-L15x3-hrmCycle-Ref6-lowRealFinal-AdamATan2-EMA-pseudoBranches1.yaml": "e94a1b85805414a54de6d18ac143ebc2b273873938867aac73450f75f256c98d",
|
| 40 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/candidates/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W1440-H15-L15x3-hrmCycle-Ref6-lowRealFinal-AdamATan2-EMA-pseudoBranches2.yaml": "4f8153d360feab1ca2feb74caee3cad608864886f9fecc8b3b6f7df75a4622f4",
|
| 41 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/candidates/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W1440-H15-L15x3-hrmCycle-Ref6-lowRealFinal-AdamATan2-EMA-pseudoBranches3.yaml": "150f6683f843e4242ca7993ff8eca1451922aa8555cdc7e54c0581cb8f4d5182",
|
| 42 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/candidates/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W1440-H18-L15x3-hrmCycle-Ref3-lowRealFinal-AdamATan2-EMA-pseudoBranches1.yaml": "86f23ada4f759ed5f00a69c03683ad920d16307153a139757acd15169fbeb7cd",
|
| 43 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/candidates/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W1440-H18-L15x3-hrmCycle-Ref3-lowRealFinal-AdamATan2-EMA-pseudoBranches2.yaml": "2c7cfaba5b4e852c4f5defc8adc41028efc34970c99b1cc51214a46ce0b4b5f5",
|
| 44 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/candidates/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W1440-H18-L15x3-hrmCycle-Ref3-lowRealFinal-AdamATan2-EMA-pseudoBranches3.yaml": "b56ca440928a3328f4a498ecea233a290b6c377ed42dd99584a31b0d834cd8fb",
|
| 45 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/candidates/README.md": "0652caf008599a2bec944680bdd7c7e75f4020bc79ffccb69f0ceb30aa63d85d",
|
| 46 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/HRM-H2-L3-W768-H11-L8-BP8-causal-AdamATan2-EMA-seed0-1epoch.yaml": "273da800eee8183924fcb5db1822ad6004d3dce6281e9cc899ec81e2f9818dcd",
|
| 47 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/Lookahead-K1-LA2-A2-R0-D0-P0-F0-seed0-W760-heads10-H8-L8x3-hrmCycle-Ref3-lowRealFinal-refinerMemoryOnly-AdamATan2-EMA-1epoch.yaml": "a2e318a403b0728bf943c8d42d79c76dee5639bed3eb2602e537db9bccc0b749",
|
| 48 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/Lookahead-K1-LA2-A2-R0-D0-P0p2-F0-seed0-W760-heads10-H8-L8x3-hrmCycle-Ref3-lowRealFinal-refinerMemoryOnly-AdamATan2-EMA-1epoch.yaml": "749b1423e98c00baa8ca87a23acfc612311a232bbe0cfd5ff6ea803609988ff3",
|
| 49 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/Lookahead-K1-LA2-A2-R0-D0-P0p2-F0-seed0-W768-heads12-H8-L8x3-hrmCycle-Ref3-lowRealFinal-KV3_20_27-AdamATan2-EMA-1epoch.yaml": "d84de20f281e012d778e79e083ac1058c0e23baa0c840482acec34979a7665bc",
|
| 50 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/Lookahead-K1-LA2-A2-R0-D0p2-P0-F0-seed0-W760-heads10-H8-L8x3-hrmCycle-Ref3-lowRealFinal-refinerMemoryOnly-AdamATan2-EMA-1epoch.yaml": "30fa807d983491ead62e296b4172bf1044689ed4f90073fc3185c13fa995cb2d",
|
| 51 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W760-heads10-H8-L8x3-hrmCycle-Ref3-lowRealFinal-refinerMemoryOnly-AdamATan2-EMA-1epoch.yaml": "ed991e37d67f5f3ece1a502f86a5540a9de7cce54c2be8b505bea8972955f190",
|
| 52 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/README.md": "588d8f0b3954cb7f8d18ff234f82de0dc95d60918f0a155335acb2a841fdeaac",
|
| 53 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/cycle_depth/HRM-H3-L3-W768-H11-L8-BP12-causal-AdamATan2-EMA-seed0-1epoch.yaml": "a5517fb2812272cdd66617357765285551fdf106cd1e7f2d8470d37741c8bd78",
|
| 54 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/cycle_depth/HRM-H6-L3-W768-H11-L8-BP24-causal-AdamATan2-EMA-seed0-1epoch.yaml": "f29dfea6af46d1bc20222c19468ece25f92f70def6368a68fcd0b881d70b97c5",
|
| 55 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/cycle_depth/README.md": "65e281265a23a2532526b30aeaafcb90ffc7b13146325a6972070c22dbe66817",
|
| 56 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/double_compute/HRM-H4-L3-W768-H11-L8-BP16-KVReuse12-causal-AdamATan2-EMA-seed0-1epoch.yaml": "f09459499f23705793dea9bd568e15a09c5e2a2b23a7e6fa3db4ca7a9cbd6ad5",
|
| 57 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/double_compute/HRM-H4-L3-W768-H11-L8-BP16-causal-AdamATan2-EMA-seed0-1epoch.yaml": "64ff9bbdca6453389497087895869552ec50f61dae37556235e7507d6294e626",
|
| 58 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/double_compute/Lookahead-K1-LA2-A2-R0-D0-P0p2-F0-seed0-W760-heads10-H8-L8x3-hrmCycle-HC2-Ref3x2-lowRealFinal-refinerMemoryOnly-AdamATan2-EMA-1epoch.yaml": "bfce05b726ef39bda75d7426a85947e45c85acdc98dec5f58bd59f1c8f08775a",
|
| 59 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/double_compute/README.md": "ea7f76acad0fc3b1df7a9ab3e2f559b7298bd44baf4ccce52ef6208152b0f217",
|
| 60 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/refiner_depth/Lookahead-K1-LA2-A2-R0-D0-P0p2-F0-seed0-W760-heads10-H8-L8x3-hrmCycle-Ref3x2-lowRealFinal-refinerMemoryOnly-AdamATan2-EMA-1epoch.yaml": "ca8b26ea1c04aa5347927d43826541813c1eb2c262035f62a5b5dd15a0e00744",
|
| 61 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/refiner_depth/Lookahead-K1-LA2-A2-R0-D0p2-P0p2-F0-seed0-W760-heads10-H7-L7x3-hrmCycle-Ref5-lowRealFinal-refinerMemoryOnly-AdamATan2-EMA-1epoch.yaml": "b0a91868755de46cf4ed8e077f3eba6772b7dd46793123db709b1f2157369bf9",
|
| 62 |
+
"configs/causal_hrm_text/official_recipe/hrm_cycle/small/refiner_depth/README.md": "084164d47c5ec01161dd0d66ada5302c6e2194b016ca7a3f4f69633f8f673bc6",
|
| 63 |
+
"configs/causal_hrm_text/official_recipe/hrm_fbw/HRM-FBW-K3-H2-L3-H18-L15-causal-AdamATan2-EMA-seed0-SrcL1-L3-H1-L4-L6-H2.yaml": "756ef58acdb572a7064e3b77485406a00a40e6bd56059c010342b530da3a5f4f",
|
| 64 |
+
"configs/causal_hrm_text/official_recipe/hrm_fbw/HRM-FBW-K3-H2-L3-H18-L15-causal-AdamATan2-EMA-seed0-fromHRM-epoch3-SrcL1-L3-H1-L4-L6-H2.yaml": "b74b5ef3e5125bb971113b72d9a30129d8828309d731d1c5e6a7c62eb36b54f5",
|
| 65 |
+
"configs/causal_hrm_text/official_recipe/hrm_fbw/HRM-FBW-K3-H2-L3-H18-L15-causal-AdamATan2-EMA-seed0-fromHRM-epoch3.yaml": "b4cae4eb314b23f4f9baa5dec9b8d4eb11524c216e5da98335dfaef93bce2df4",
|
| 66 |
+
"configs/causal_hrm_text/official_recipe/hrm_fbw/HRM-FBW-K3-H2-L3-H18-L15-causal-AdamATan2-EMA-seed0-progressiveK-75-90.yaml": "df7c72acb6fd18b38d943aaed825480c5c21e5156731626e7d83cee0475785f1",
|
| 67 |
+
"configs/causal_hrm_text/official_recipe/hrm_fbw/HRM-FBW-K3-H2-L3-H18-L15-causal-AdamATan2-EMA-seed0.yaml": "a7d0297c78c1314a5b044a47c202b78536d469f05dd921ae236648f3638f5cd4",
|
| 68 |
+
"configs/causal_hrm_text/official_recipe/hrm_fbw/README.md": "6ece462cd4f44613126af32dd5273251083fbea402524d6c58f4868336e4fac4",
|
| 69 |
+
"configs/causal_hrm_text/official_recipe/hrm_full_bp/HRM-H2-L3-H18-L15-BP8-causal-AdamATan2-EMA-seed0.yaml": "160f3df51b5a6ccc645e96236894c93f37bd5449b25280be9977f7ea74b8deeb",
|
| 70 |
+
"configs/causal_hrm_text/official_recipe/hrm_full_bp/README.md": "734dbe39f67b0341b91ceda75090bfc5dd1ab2f262f40cea3b904ed70d749974",
|
| 71 |
+
"configs/evaluation/hrm_reference_v1.json": "602d9f37bef631c05d1a4a415cc5535a364b42df3eb6ae30a44d77b14ede7715",
|
| 72 |
+
"configs/fullbandwidth/README.md": "c7ff94c432aeb5caa5d7260374aa3099581b95394e8c8653e2307182bf397f86",
|
| 73 |
+
"configs/huginn/476M_7b.env": "ff98a658d92cd406b6edd4fa7d78f5dfd9f6b19d6804dbd40af9b66b9ba8363a",
|
| 74 |
+
"configs/huginn/Original-Huginn-0125.yaml": "2ace28d739e3dd978ab5f125f798aad9f6e964ae2ca0edf9840180e55851ea0e",
|
| 75 |
+
"configs/lookahead/476M_14b_K3_LA2.env": "c2854167570e9af2b01566c8385363d7cee5d4e37b054212a769a7dc97d7b0fa",
|
| 76 |
+
"configs/lookahead/476M_14b_K3_LA2_MB10.env": "c411538beed6b7589dda0e29362b6f0c64bfe193e947c32f9ef3a06ac5a72f47",
|
| 77 |
+
"configs/lookahead/476M_14b_K3_LA2_MB10_NORECOMPUTE.env": "3e41f5c085cc46b046c6013be4eebf9f44f6a3a04c92659b43025213b01606bf",
|
| 78 |
+
"configs/lookahead/476M_7b_K3_D0_P0_A2_R0_MEMORY.env": "1ab0c5d824acf347f44daa7f69da5dccbefbf9eeb3a3aff74924f9ac048c6cc3",
|
| 79 |
+
"configs/lookahead/476M_7b_K3_LA2.env": "da637667a121c3336190f08681eeeddc798723687279bc0df087daf0512ec2f1",
|
| 80 |
+
"configs/lookahead/Lookahead-K3-LA2-A2-R0-D0-P0-F0-seed42-refinerMemoryOnly-7b-compiled-a2bag-MB4.env": "07e95028d20298bd44f8d134ea5cee9d47ef0845e113e475ede303e35ca99f88",
|
| 81 |
+
"configs/lookahead/Lookahead-K3-LA2-A2-R0-D0-P0-F0-seed42-refinerMemoryOnly-7b.env": "77db16cf260947448464d2705c363fea8cef4e01c2da65dc558eeb79afd278c2",
|
| 82 |
+
"configs/lookahead/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-refinerMemory-7b.env": "08b8a7b894495dffbe75f04bfe11045b43c5ab897db687640f9ca83ab88396af",
|
| 83 |
+
"configs/lookahead/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-refinerMemoryOnly-7b-compiled-a2bag-MB2-auxAllPasses.env": "74d8829df7473a6516a8e3c77454dfa317e5b6732a44f60d95e37e5466af2b4e",
|
| 84 |
+
"configs/lookahead/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-refinerMemoryOnly-7b-compiled-a2bag-MB2.env": "e79b81a20de8ef5bf7489caf67e7e61e63540e6d1ab9a8615ad096d8e99c09ec",
|
| 85 |
+
"configs/lookahead/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-refinerMemoryOnly-7b-compiled-a2bag-MB4-auxAllPasses.env": "e38d2a3c7eb2369abca9f29d9fb51d97c01be436fe319a329fe4304a7226fc8f",
|
| 86 |
+
"configs/lookahead/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-refinerMemoryOnly-7b-compiled-a2bag-MB4.env": "99ce2bd607c230d6fc6b61a427f990855f0c089bf236163eb7722f9eb4c30256",
|
| 87 |
+
"configs/lookahead/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-refinerMemoryOnly-7b.env": "b4cb96d810799641fea03e03bd544efe3d3ce44290919bc2070f5082325d4cf9",
|
| 88 |
+
"configs/lookahead/README.md": "677b9c76547bca8cac83dbd678831b150b7e1e811a5220a2f8aa89ca612c8b15",
|
| 89 |
+
"configs/lookahead/REFINER_MEMORY.md": "a5acc46c38705f3649019cff8ab9090cf492bdcd10fda539060ac0633794a94f",
|
| 90 |
+
"configs/lookahead/ablations/D0-A0-R0.env": "11f564edbcd7174def648a316acfa626bfb7b865eccc4d302b3e28a3540ddc49",
|
| 91 |
+
"configs/lookahead/ablations/D0-A0-R1.env": "67649480c5114ec93a6804ef65db81682e1e038436952b20ff24429899cbce1c",
|
| 92 |
+
"configs/lookahead/ablations/D0-A1-R0.env": "acedda67b5427523cabdbe33fa89612d307417985304133963a5c32ec0010ccf",
|
| 93 |
+
"configs/lookahead/ablations/D0-A1-R1.env": "b292ec0d0e34fb6f59bb9490e091906081ab5783c5120df3932530ce11a34f45",
|
| 94 |
+
"configs/lookahead/ablations/D0-A2-R0.env": "5fa99960fc5ed3f0163c4bb6ab1974ea62270f1db074a7f7793b50ff0637e384",
|
| 95 |
+
"configs/lookahead/ablations/D0-A2-R1.env": "462222782f87efa565da30e051362337478aa563e5210f1da7657bf9bc72a206",
|
| 96 |
+
"configs/lookahead/ablations/D1-A0-R0.env": "073c2dd201ee938cac8a2d292f7fd21a11101c25259a5b02039531058d60dd2f",
|
| 97 |
+
"configs/lookahead/ablations/D1-A0-R1.env": "68aeeeee676d3b2341319d8750c6f4c0b76727db565b562e89e1d223c5fe4380",
|
| 98 |
+
"configs/lookahead/ablations/D1-A1-R0.env": "98d6d580d93fe378d60b9390055446ec13e8c1077988ccf25c99c85c137d9c92",
|
| 99 |
+
"configs/lookahead/ablations/D1-A1-R1.env": "6f25e2327e0aad0dedfb44ba2248b47772af1c8afaed0f14fec502f5182578fc",
|
| 100 |
+
"configs/lookahead/ablations/D1-A2-R0.env": "a8548ec79fcd2382440d86a92bc4d2e7874e49c316f645cb487bcc7bb62851e4",
|
| 101 |
+
"configs/lookahead/ablations/D1-A2-R1.env": "9a782326b8dec0ad23d772ae9c6c77fa0ba328c34f0caa749bd19305bb00c30e",
|
| 102 |
+
"configs/lookahead/ablations/common.env": "509a7f31514ec0aa8b1954bf06da3af37ce15d7c29b78f24658f19763f708b7a",
|
| 103 |
+
"configs/lookahead/cpu_smoke.yaml": "47d67ca8299b2aa9c82dab3bff5558df271be3b8b0be0a38d838d28167bc9375",
|
| 104 |
+
"configs/lookahead/cpu_vanilla_smoke.yaml": "c0bbac9f37b0d938a5e20971b8d2a7c202252895caa2099a38d032cc33501812",
|
| 105 |
+
"configs/loop/476M_14b_FBW0_K3_L2_ADAPTER_SHARE_KV.env": "d6fd71c4ff02e9fd349f94c20224f87a30201e2cb90c07b293a00ca89e282fc3",
|
| 106 |
+
"configs/loop/476M_14b_FBW0_K3_L2_ADAPTER_SHARE_KV_MB10.env": "c7d9eb250df3e171eea91cef825bf2a8827d9efefe6d25300517dc4205d9e28c",
|
| 107 |
+
"configs/loop/476M_7b.env": "d462059d110e9d923660abc486811e25dd402d6489715ec5a490ec0b784529fb",
|
| 108 |
+
"configs/loop/476M_7b_FBW0_K3_L2.env": "0338ff980fe5ab6ae093d1335a808f4998baa589be5141b7262ec92534b54a0f",
|
| 109 |
+
"configs/loop/476M_7b_FBW0_K3_L2_ADAPTER.env": "ad1f5f6afb79e42a6cb80efe89da63f54ba5249982171907aa3bba619e34605c",
|
| 110 |
+
"configs/loop/476M_7b_FBW0_K3_L2_ADAPTER_IFM.env": "a5b0afb57b1d34b2c1cee722ff79fc6eeb4b7b246493f29fb0414397be23e7bd",
|
| 111 |
+
"configs/loop/476M_7b_FBW0_K3_L2_ADAPTER_IFM_SHARE_KV.env": "8573d72be7041dca69dea2d3d6cdaf7fc8e8ebf6b48f28dd0860ddaf806e4b72",
|
| 112 |
+
"configs/loop/476M_7b_FBW0_K3_L2_ADAPTER_SHARE_KV.env": "aae7032e8ed65417a5d673afa2e46a1941574342b39359b6473dbdb13b573ed6",
|
| 113 |
+
"configs/loop/476M_7b_L2_ADAPTER_IFM.env": "047976485fab887985c74af3b599189dccdf5caed056ce9ff6ad9c42b235eb8c",
|
| 114 |
+
"configs/loop/476M_7b_L6_ADAPTER_IFM.env": "7ac3f9618f4d7573586e8d58b2c50f33dea43b53ba156272e0e171764d2cebad",
|
| 115 |
+
"configs/loop/ADAPTER_CONTROL.md": "59b3c18cd11a3c7e9d6185ddffa58cbda0b3ed7d165ad26cc1c437f2fe418652",
|
| 116 |
+
"configs/loop/IFM_INPUT_WRITE.md": "ab201adfa6303859c0ea061fb34ea3396cca2b3c6c345bdf2cf16578d6c83613",
|
| 117 |
+
"configs/loop/KV_SHARING.md": "878b777bfc0c85e5e0c6244852e215fc0f1a335e3e87824ca984ce488a2204c6",
|
| 118 |
+
"configs/loop/Loop-K3-L2-KVFresh-Adapter3-NormOn-IFMOn-seed42-7b-refinerMemory.env": "c9abee3f4a4f27497c8d174d53e6ac110fe114cb367c841bf6598de0209a55ee",
|
| 119 |
+
"configs/loop/Loop-K3-L2-KVFresh-Adapter3-NormOn-IFMOn-seed42-7b-refinerMemoryOnly.env": "5330d12d8e3be2503232680771434780084f771a0d56ecf1a7a398bd39f3c1bc",
|
| 120 |
+
"configs/loop/NO_FBW_BASELINES.md": "130499e6c3bfe0daa6556b2ec9d47a95139f700a87e6329202847c688a7811ee",
|
| 121 |
+
"configs/loop/README.md": "a92cca650e18eb7ed8d2845c3707b0c75b6a48f91b038641836acbfcb29f409e",
|
| 122 |
+
"configs/loop_budget/Huginn-K1-P5-R10-C5-T11-seed42.yaml": "686293173d71e8c40eaa120f03f4b58816617060a4e9819c35b861dbaa540a91",
|
| 123 |
+
"configs/loop_budget/Huginn-K3-P5-R10-C5-T3-seed42-FFN5568.yaml": "830b1ed25eea7df5a6727157cd7bcd261285c9cc561d3fd482cf8163423ab730",
|
| 124 |
+
"configs/loop_budget/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN5120-refinerMemoryOnly-auxAllPasses.yaml": "f0f69894d17419423adf5fe39aa15300ef8de53719c38f56da98441f689f8a52",
|
| 125 |
+
"configs/loop_budget/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN5120-refinerMemoryOnly.yaml": "f6d10a0a56af7cc0df36ebe50d33ef8119d68f6b8a7d3eea88dae5438a650795",
|
| 126 |
+
"configs/loop_budget/Ouro-K1-B20-T6-Stage1-seed42.yaml": "99229cab2f4f2e5bb63189066eee1130085f69c066e114daff1ac7021a1ac786",
|
| 127 |
+
"configs/loop_budget/Ouro-K3-B20-T2-Stage1-seed42.yaml": "d7d1148c34dcd8a50b8484d3b4ccfc36a54bb6b56b1c93daa2d3bfb4aa2ad58a",
|
| 128 |
+
"configs/loop_budget/README.md": "19b7937c9cdfe4bde98177a22e79cd7ad70018ae068d06d56cbc01085fb91f41",
|
| 129 |
+
"configs/loop_budget/Vanilla-B20-seed42.yaml": "b3022a1ecb52c99c7449dd60731b5535015b8c36745a001a05c247a480d6b50a",
|
| 130 |
+
"configs/loop_budget/common.yaml": "6787aa6f4c2384e78b98e18cf1179b12521e4149ea6ab7f3a3817a698f45e333",
|
| 131 |
+
"configs/loop_budget/horizons/20tpp/FBW-K6-B20-seed42-20tpp-linear.yaml": "e5cbb5e6fa373b38d9b3e7473e10129fe3fe96b4927091528e2b45f9ab18f40a",
|
| 132 |
+
"configs/loop_budget/horizons/20tpp/Huginn-K1-P5-R10-C5-T11-seed42-20tpp-linear.yaml": "e9f9f635f520dcd441902c359400104270207fd5aaee7cdc08dba5b6c11cbe0a",
|
| 133 |
+
"configs/loop_budget/horizons/20tpp/Huginn-K3-P5-R10-C5-T3-seed42-FFN5568-20tpp-linear.yaml": "cbd82f7533f3028f12c9618176f51a95f175ec430a5fb69ef8970856eca227f8",
|
| 134 |
+
"configs/loop_budget/horizons/20tpp/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN5120-refinerMemoryOnly-20tpp-linear.yaml": "15f9bb24c94e0ae77abcc976310f12f98d15b98634ebcfab540fba433f20defc",
|
| 135 |
+
"configs/loop_budget/horizons/20tpp/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN5120-refinerMemoryOnly-auxAllPasses-20tpp-linear.yaml": "a8d73a3983e3157f15bf338d49f332204978aca2b25a9e67d8db296ea9a99ee2",
|
| 136 |
+
"configs/loop_budget/horizons/20tpp/Ouro-K1-B20-T6-Stage1-seed42-20tpp-linear.yaml": "f2bc50d78775bd3b7d9d67d5f8997bc471e0b41824fa70f7225a53391b739d22",
|
| 137 |
+
"configs/loop_budget/horizons/20tpp/Ouro-K3-B20-T2-Stage1-seed42-20tpp-linear.yaml": "d3073319a6a6bfcd6491f171c4c5f67406de7abed61bbb9229f2a8261df7012c",
|
| 138 |
+
"configs/loop_budget/horizons/20tpp/Vanilla-B20-seed42-20tpp-linear.yaml": "72ee7275fe5cc595c754cae2626adbc12d30f14697a4045105e3010107ea0550",
|
| 139 |
+
"configs/loop_budget/horizons/40tpp/FBW-K6-B20-seed42-40tpp-linear.yaml": "b406f2faae2aac6882b792019a0edb2aacbbae6694068d0a553893c9bcd71e74",
|
| 140 |
+
"configs/loop_budget/horizons/40tpp/Huginn-K1-P5-R10-C5-T11-seed42-40tpp-linear.yaml": "41b75eb152bff4a93575a21e4ef76fd9e4dab456b7c2161fa5cdb72b8710fa41",
|
| 141 |
+
"configs/loop_budget/horizons/40tpp/Huginn-K3-P5-R10-C5-T3-seed42-FFN5568-40tpp-linear.yaml": "16ce948fbd00a794e2b7d1cfdcf8848e8501d998da3a641c5a82337c77b626f0",
|
| 142 |
+
"configs/loop_budget/horizons/40tpp/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN5120-refinerMemoryOnly-40tpp-linear.yaml": "9e16cced4f791fcd6b9126d0bcb5bc49570b5ff7862ab7acdcf12303dba30805",
|
| 143 |
+
"configs/loop_budget/horizons/40tpp/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN5120-refinerMemoryOnly-auxAllPasses-40tpp-linear.yaml": "d293852c834153f38b7d206a499a277d8c0ecb49e241ae67041db79e8b05b7ea",
|
| 144 |
+
"configs/loop_budget/horizons/40tpp/Ouro-K1-B20-T6-Stage1-seed42-40tpp-linear.yaml": "3225a452dd583cfcf4ff61ec1a96c34ac073cc16d09ebe1d0b21230eedfc8689",
|
| 145 |
+
"configs/loop_budget/horizons/40tpp/Ouro-K3-B20-T2-Stage1-seed42-40tpp-linear.yaml": "5ebfa4c39cd204f025c9616f811c885c2840d9e384de36c9cd48636bfd9e99c0",
|
| 146 |
+
"configs/loop_budget/horizons/40tpp/Vanilla-B20-seed42-40tpp-linear.yaml": "112f6db0c5319d5910f39c4e68e2a6a6b3d1f55ed2af4887fee597fe809de576",
|
| 147 |
+
"configs/loop_budget/horizons/80tpp/FBW-K6-B20-seed42-80tpp-linear.yaml": "c6f397f4fa938c59bfb5c2635af658d6ad0057d13c3909f918c3a15cc121943c",
|
| 148 |
+
"configs/loop_budget/horizons/80tpp/Huginn-K1-P5-R10-C5-T11-seed42-80tpp-linear.yaml": "ef7102edbd1cbe0ac299e2a94027b4ac3f81a64bcfa87820a332c55d11287739",
|
| 149 |
+
"configs/loop_budget/horizons/80tpp/Huginn-K3-P5-R10-C5-T3-seed42-FFN5568-80tpp-linear.yaml": "d0ce0a1a6df8fb44f08d1d8b76fdbc534643ee0e2ce67077b003379b745d7486",
|
| 150 |
+
"configs/loop_budget/horizons/80tpp/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN5120-refinerMemoryOnly-80tpp-linear.yaml": "f8bae0f2dc879a5a03f10a691ac3f85f58a3ce347ec437c2a04d2fca5cbe516f",
|
| 151 |
+
"configs/loop_budget/horizons/80tpp/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN5120-refinerMemoryOnly-auxAllPasses-80tpp-linear.yaml": "467c034ff78bc4e6f036a2263d3c055f8aaad29c18ba9fa9ac9621dc5215ff07",
|
| 152 |
+
"configs/loop_budget/horizons/80tpp/Ouro-K1-B20-T6-Stage1-seed42-80tpp-linear.yaml": "81eab705e09efaa0ce1f9767305a2642ddb5b6a1c48f9deb9b84b80739307e4f",
|
| 153 |
+
"configs/loop_budget/horizons/80tpp/Ouro-K3-B20-T2-Stage1-seed42-80tpp-linear.yaml": "37413752861da41a8eae4e4ff465f1b96a8b5f8b6d5e7a2f3e349277d5406f17",
|
| 154 |
+
"configs/loop_budget/horizons/80tpp/Vanilla-B20-seed42-80tpp-linear.yaml": "e6cd543cfa0b0fe02b8a97c3f35b01349a905e48f36d3a9af0acc847388e0586",
|
| 155 |
+
"configs/loop_budget/horizons/README.md": "9cd28ee1272ae94e69b8cda7502c46347915e68d23a36444039f4eb5148b4872",
|
| 156 |
+
"configs/loop_budget/lr_bs_search/PROGRESS.md": "98dd8870a1ac3de4fa21d4ca6a6cd7b566372ed85af10234ca396c1bbf5613c5",
|
| 157 |
+
"configs/loop_budget/lr_bs_search/README.md": "6083a2ba176893fc81d4f0cc10a2ed6ed99b6bc3b7bc17254487848007502a0a",
|
| 158 |
+
"configs/loop_budget/lr_bs_search/RECOVERY_R2.md": "2d51326aba384391e90fea2488c4d7d5d8b45000e3dcaa39e35e9e6c32848dc7",
|
| 159 |
+
"configs/loop_budget/lr_bs_search/arms/FBW-K6-B20-seed42-50m-1b.yaml": "3f01673018886ff2cb01b7e88a3d58bbebc712665ba68bf532f01021b4703648",
|
| 160 |
+
"configs/loop_budget/lr_bs_search/arms/Huginn-K1-P5-R10-C5-T11-seed42-50m-1b.yaml": "1c9cd43b8c9fad49308935d7aa83b53af15d499a2b803611bda4f0145899cd7d",
|
| 161 |
+
"configs/loop_budget/lr_bs_search/arms/Huginn-K3-P5-R10-C5-T3-seed42-50m-1b.yaml": "14b3568bad86b6c4fca76f21cd2556bf4746352c03fab1f620fd8a4e41d21e54",
|
| 162 |
+
"configs/loop_budget/lr_bs_search/arms/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN1536-refinerMemoryOnly-50m-1b.yaml": "e5019be2d863ce88cbacdff053d997b2287de533fc19dd0032a30b3d932e13d0",
|
| 163 |
+
"configs/loop_budget/lr_bs_search/arms/Lookahead-K3-LA2-A2-R0-D0p2-P0p2-F0-seed42-B18-Ref3-FFN1536-refinerMemoryOnly-auxAllPasses-50m-1b.yaml": "c4cbd050505e1401ec4a9646222dac1e46a1e1c177b72a1fe6047ca747a34f49",
|
| 164 |
+
"configs/loop_budget/lr_bs_search/arms/Ouro-K1-B20-T6-Stage1-seed42-50m-1b.yaml": "4fa9ddb0cb617746f0738b73094a1f4950a02b61ab50cca910cc3668f3290f02",
|
| 165 |
+
"configs/loop_budget/lr_bs_search/arms/Ouro-K3-B20-T2-Stage1-seed42-50m-1b.yaml": "0f0270bcd0e11dc15abf7d7a2e63229ff7cae9ab0de72b3f65a235d104c5028c",
|
| 166 |
+
"configs/loop_budget/lr_bs_search/arms/Vanilla-B20-seed42-50m-1b.yaml": "54618ea6e5d730d07e9b850b6d9bc75efa929047fce4edcf25dda28cfa610109",
|
| 167 |
+
"configs/loop_budget/lr_bs_search/common.yaml": "904c38957fe2924e7c9c615305e925c87d0327aba235d41df8713ea0a4754ca0",
|
| 168 |
+
"configs/loop_budget/lr_bs_search/recovery.yaml": "3be7734fa4de6230139761366cbf7f157167f6ccb70e954fdd002d9f2dc01cfd",
|
| 169 |
+
"configs/loop_budget/lr_bs_search/search.yaml": "2d5799cea3cc8c038b63223a6076d1337a42170c2e2fdc418f1207ac007b18da",
|
| 170 |
+
"configs/loop_budget/lr_bs_search/trials/Vanilla-B20-seed42-50m-1b-BS131072-MatrixLR0p5.yaml": "d624a3102ee21c13cc531773bd864d1236c20d79ca1d6b8246fbe35d0d5084e8",
|
| 171 |
+
"configs/loop_budget/lr_bs_search/trials/Vanilla-B20-seed42-50m-1b-BS131072-MatrixLR1.yaml": "31ea4077e09600634d063bbb5e71b2ff279e21b28b053c0940dd966a216ed67a",
|
| 172 |
+
"configs/loop_budget/lr_bs_search/trials/Vanilla-B20-seed42-50m-1b-BS131072-MatrixLR2.yaml": "f85bdafc5d7d98453b0af32118bc92ff9dabf1737f9c5f0dee7dfc79ec87ef9e",
|
| 173 |
+
"configs/loop_budget/lr_bs_search/trials/Vanilla-B20-seed42-50m-1b-BS32768-MatrixLR0p5.yaml": "383623a91ef4abf5ed700fe61cc710f66d47a06d1410053fe31696d79e7ddc89",
|
| 174 |
+
"configs/loop_budget/lr_bs_search/trials/Vanilla-B20-seed42-50m-1b-BS32768-MatrixLR1.yaml": "9f7d2c87782cdbbbd07562e5cd0d072ce5b33189ff5894e76a6c438f8a1e1a10",
|
| 175 |
+
"configs/loop_budget/lr_bs_search/trials/Vanilla-B20-seed42-50m-1b-BS32768-MatrixLR2.yaml": "bb6cfe93065c567853793aeac50d5628e11880bffaeee478a6275f28f8a817d5",
|
| 176 |
+
"configs/loop_budget/lr_bs_search/trials/Vanilla-B20-seed42-50m-1b-BS65536-MatrixLR0p5.yaml": "9582a8dce8171e4c96858664ae25a5bbf68d2fe88a3656431aa0c7fde621d74f",
|
| 177 |
+
"configs/loop_budget/lr_bs_search/trials/Vanilla-B20-seed42-50m-1b-BS65536-MatrixLR1.yaml": "3e2e820cdd50fa601ad360a3e6f7f6a683102b784e05ca2b7c454ad73d60b90e",
|
| 178 |
+
"configs/loop_budget/lr_bs_search/trials/Vanilla-B20-seed42-50m-1b-BS65536-MatrixLR2.yaml": "0bf7d4bdd0d25a4f923919a8d999e570cb2a2605d3839e1cfed6941d3474fabe",
|
| 179 |
+
"configs/loop_budget/scripts/README.md": "d96252d9befa3de46533756abcc7ad463db65253b39c759b844ea2eb4b991263",
|
| 180 |
+
"configs/loop_budget/scripts/lr_recovery.py": "16b5a6e8ee9584ceb93dc02336d62589ce0acd30ea27c874f5ba377b17e2b407",
|
| 181 |
+
"configs/loop_budget/scripts/lr_sweep.py": "f7face633e88c7df27319eede3c1d7a298a62121f5a2c597f90a296307f3ac92",
|
| 182 |
+
"configs/loop_budget/scripts/prepare_sweep_data.py": "ff4949fe9930747c54d0983d05996e1e5baa4394918e5820af89c6c097bcdbf4",
|
| 183 |
+
"configs/loop_budget/scripts/run_lr_recovery.sh": "5cd46245b748f0b3262be0ba56bd33c63178e2a913fe600dd854d2c42f420725",
|
| 184 |
+
"configs/loop_budget/scripts/run_lr_sweep.sh": "16e11331e256975b13f9b17cac29444686601e915574eb123a0d2a07785392ea",
|
| 185 |
+
"configs/ouro/Original-Ouro-1p4B-Stage1a.yaml": "f3f3ac5b80fba1cbe87a597214c17bb83f16a1a9fabdbd9436295ce8b052ad48",
|
| 186 |
+
"configs/vanilla/476M_7b.env": "4b6078d83d75ee005d08daba368834373550cb1a50c8108435a4a210e1dd6580",
|
| 187 |
+
"configs/vanilla/476M_7b_FBW0_K2K3_50_50.env": "7610ddb814c4b98b22ec08bad94bf18bb8367fde6648b32e4d817c34a8126e28",
|
| 188 |
+
"configs/vanilla/476M_7b_FBW0_K3.env": "3de80a7f024da0e64da9706d6475ed28796cc7632f967e6bcefe1abf8eebb10f",
|
| 189 |
+
"configs/vanilla/476M_7b_FBW0_K3_23L.env": "4b062d2053cea91f2e9f20a83d6fb450bcb059fbc50bc3e2f73934ae3b1a00da",
|
| 190 |
+
"configs/vanilla/476M_7b_FBW0_K3_L2L11L20.env": "637c50c798de3f8796a5112318af3c2ce772a32fd22aa9e2ea11d38b11dccca9",
|
| 191 |
+
"configs/vanilla/476M_7b_mtp.env": "273e3bbcf3e42f841c98b057b89129b7c00b07095df5c38b6818298533e41db2",
|
| 192 |
+
"configs/vanilla/476M_7b_mtp_FBW0_K2K3_50_50.env": "3f6d852dba48a32d81b6b52a7ee12a90b9c4ef1a29a6dad67025c73ef6380ea8",
|
| 193 |
+
"configs/vanilla/476M_7b_mtp_FBW0_K3.env": "909ee411f3d7395c97db22eb350c9f92a2ba515bc0ce8402103f3fedb78e9547",
|
| 194 |
+
"configs/vanilla/FBW_DEPTH_COMPARISON.md": "696b4acd24d207208eb38ddae1761d46d4170747db2304276cab4b6a6f0eeb4d",
|
| 195 |
+
"configs/vanilla/FBW_MULTILAYER_STUDY.md": "58203cb1a1a45f4cf750c4605ef267836a3359c665bd46a57a54461c90456f74",
|
| 196 |
+
"configs/vanilla/FBW_STUDY.md": "5430f5a4bc3883856edb22d4a198264dedb4477666eba4ce748e2708841d2307",
|
| 197 |
+
"configs/vanilla/MTP_FBW_STUDY.md": "83cafc81e90d1e6ec0071a4fb34db1395c6c0ba0bbc4be744c49f8c31c7d6b7a",
|
| 198 |
+
"configs/vanilla/README.md": "fc622c1361e81a176ca3b031a6b0a865a18ab28752011f60c59df29c381d0b2e",
|
| 199 |
+
"gpu_matmul.py": "3549be8f057c6ca264083c4bc7157e58b46d48de2750b320414d8139747ec365",
|
| 200 |
+
"gpu_resource_manager.sh": "d7ddc8efa172d96119faae07c698c8ff5b751de4661ceacb98381b6306f4dcc1",
|
| 201 |
+
"scripts/hrm_official_worker.sh": "f842ed079c2262cae6314e2870d377fb66d39884c54c8c6bd234bf3604704112",
|
| 202 |
+
"scripts/launch_torchrun_multinode.sh": "ea65b26f01d24301f1bdbdc9da890c657fdfe8d4dc361c8bd7000e9ac09c0367",
|
| 203 |
+
"scripts/workspace_env.sh": "dd2e7fd25de3ef9bf670ce8b5bd3ac1b83d544ad797956d2e14037f3662b6dea",
|
| 204 |
+
"src/full_bandwidth_loop_tf/__init__.py": "7d7213a2ad8c47a51bd619e58185bd6a77bbb54dd3d42c098031e6bb980d7994",
|
| 205 |
+
"src/full_bandwidth_loop_tf/adapter.py": "f7979fb2c58d185aea94af08c042798c1e18c690331363bde05d13f6e595533b",
|
| 206 |
+
"src/full_bandwidth_loop_tf/adapter_policy.py": "7944aedde11852f2821e77d325c6963f3537ac18eb7d7a6e9deee38867ef7193",
|
| 207 |
+
"src/full_bandwidth_loop_tf/hf/__init__.py": "f9f4f6d9cfaa80a0443983c70e46cec8b9361ea69a75667717eb8df1c201cc74",
|
| 208 |
+
"src/full_bandwidth_loop_tf/hf/backbone.py": "0eafcedbf30552ea910628b5e845ecb73d9dc2daca99d73e38748d873e3b42dc",
|
| 209 |
+
"src/full_bandwidth_loop_tf/hf/config.py": "f82ca8335df23b35b22ba63d0bc42437c97e3cb0d960943b6608e3c1cf4f6827",
|
| 210 |
+
"src/full_bandwidth_loop_tf/hf/model.py": "21219220c8c4313fb8a6290bf5d492631f135dba679af407151b3f6ca924e683",
|
| 211 |
+
"src/full_bandwidth_loop_tf/hf/plugin.py": "2b15947ce20c8be1676551ddcce6be9bf65d0c3f200064b06fe0ae7460a7f4b4",
|
| 212 |
+
"src/full_bandwidth_loop_tf/hf/task.py": "400c0869028798ed1badc4b6d7acebe917fc0f490b22eefbc0f150e10ce5305c",
|
| 213 |
+
"src/full_bandwidth_loop_tf/hf/train.py": "5767c6d879066068860b173a0b212ed82928ab42e5bbbd8c93bdd3cc032533fe",
|
| 214 |
+
"src/full_bandwidth_loop_tf/input_write.py": "a7974576081355741c3188d38508f78da95db913347cd5a60396f98932d4b05b",
|
| 215 |
+
"src/full_bandwidth_loop_tf/input_write_policy.py": "51c68dbc21d7a2fdd604669d97a464207cb5ad0200dfab3b0ef9ed80edfa723a",
|
| 216 |
+
"src/full_bandwidth_loop_tf/kv_reuse.py": "7ac602c587d10b83768e067ec7c0cc358d924028ca76abff7209f411853074c2",
|
| 217 |
+
"src/full_bandwidth_loop_tf/megatron/__init__.py": "82327efe57c404760d9b8cf9c083e85c9e526fc1c53e782d156adaa66b9b3f60",
|
| 218 |
+
"src/full_bandwidth_loop_tf/megatron/adapter_decoder.py": "aea500799671712ebcd6683cb1fb0fccd648791d2ca103e9caa5050da787a542",
|
| 219 |
+
"src/full_bandwidth_loop_tf/megatron/attention.py": "6835e2149abec4abb848b52406466a12d654cab2bebe19c129a679f64c82f91c",
|
| 220 |
+
"src/full_bandwidth_loop_tf/megatron/builder.py": "3d8391ce8c65c721acd1e6fdefc07bdb94d888ffea042eb88b6fe10fdb702854",
|
| 221 |
+
"src/full_bandwidth_loop_tf/megatron/config.py": "1c5801721a7a75de8bc65d138e0c0dbeee86d4113bb20938ab664e2672ba4839",
|
| 222 |
+
"src/full_bandwidth_loop_tf/megatron/decoder.py": "bea4c2ff62dfebcbf08a156176cfe65f8d31c7df1fa24ea3c4991421d1e99a14",
|
| 223 |
+
"src/full_bandwidth_loop_tf/megatron/model.py": "dee02d33cd9c8d389f71af71bf7e53d73ab5a886107335ca8b335bb57f0cb01e",
|
| 224 |
+
"src/full_bandwidth_loop_tf/megatron/plugin.py": "ca8ee90c1e547ba7935c46fd2c2f2cd436940151c4915a4480eaa60243033728",
|
| 225 |
+
"src/full_bandwidth_loop_tf/megatron/task.py": "c28c28caae4cc9e098d6a7a600acac970d6fc10928063cb4a1be5264106dfa92",
|
| 226 |
+
"src/full_bandwidth_loop_tf/megatron/train.py": "4ffb371d68045560a0c48297fdb686592573e44dac826fbd4605639cd317f4b0",
|
| 227 |
+
"src/full_bandwidth_loop_tf/policy.py": "a80e630571be5468a0ef0e1788cd7d6520e8dc158bcdfe6576bf47fe6917e2d2",
|
| 228 |
+
"src/full_bandwidth_tf/__init__.py": "73932d7b3105e983f86321784ff547181848cfde537630ab60e93b96c5c80729",
|
| 229 |
+
"src/full_bandwidth_tf/hf/__init__.py": "6d9ae0e0360910223451d706e71477e258a4bea6ebaaa99287c77abc4b8a0130",
|
| 230 |
+
"src/full_bandwidth_tf/hf/backbone.py": "da1062836060d9ea1580366ba4ecea04e409da1b5f23d328047040d44a5154f0",
|
| 231 |
+
"src/full_bandwidth_tf/hf/config.py": "dabcc7e08f9d7026515d67393e0803f59c843598c59f790ec5934d6154cb8c27",
|
| 232 |
+
"src/full_bandwidth_tf/hf/data.py": "9c9c3f53eae324c0c2acac63898b155f555f0c65191349c906d7530ebd0ab0dc",
|
| 233 |
+
"src/full_bandwidth_tf/hf/diagnostics.py": "40dff542e9d801872b1e1bd2dca35bf5f39aa38dd1ece67f44c1b81aaf72cd92",
|
| 234 |
+
"src/full_bandwidth_tf/hf/generate.py": "75fabd6e56c0d19de30a0743623277e7ef1f1c242fb069b6ec5acefe19d030dd",
|
| 235 |
+
"src/full_bandwidth_tf/hf/inference.py": "9424da65353b2a55a2ecf179bcbf3e3d7c5fee735b6951cf8b356f4621dd7894",
|
| 236 |
+
"src/full_bandwidth_tf/hf/model.py": "fa9ce4e58510b4a373fc8ed11ba96a87abfef8e8a4ef7fc9c495aedd46744aaa",
|
| 237 |
+
"src/full_bandwidth_tf/hf/plugin.py": "5f9cf723a71a2b1db9a3a03f395be964a4e175f2a60d493872c136fb2987035b",
|
| 238 |
+
"src/full_bandwidth_tf/hf/task.py": "523d09295a271969a1b54369e6344be02850052c83f0135b3becb929b8d65139",
|
| 239 |
+
"src/full_bandwidth_tf/hf/train.py": "3c83db8e6a91088fe00e781a69d218f2d0c4ae1317a8ecd86cbb33045d3002e2",
|
| 240 |
+
"src/full_bandwidth_tf/inference.py": "6e100bc0ee8792bfe85b0042e25e24a04d433b133377da301ab678f6b6f26a5d",
|
| 241 |
+
"src/full_bandwidth_tf/launch.py": "0415c86cfdb00e7644bfda6867c469abd9644c59b5293e413d16b0f0d1ff8046",
|
| 242 |
+
"src/full_bandwidth_tf/megatron/__init__.py": "0ecf759960f5e1d412b3939b54394734df3ee54662fb73cbf621b9c773a8b3ef",
|
| 243 |
+
"src/full_bandwidth_tf/megatron/builder.py": "770af80866b19ac6bf785c61658b874ebd14b5ebecbcc3699410ac8ca252b290",
|
| 244 |
+
"src/full_bandwidth_tf/megatron/config.py": "1279e4ce26146a9879bce34eaeec2e7f53392a79cebf949d2942b70f9a1d2441",
|
| 245 |
+
"src/full_bandwidth_tf/megatron/metrics.py": "bb7fb343d92ed6cd95a5bc091dfad26dfe94b9f4fb9c9dd22d05353f2ec62938",
|
| 246 |
+
"src/full_bandwidth_tf/megatron/model.py": "da485c9cb837535132804c6e3a40d209f26fa9cdbd335450dd518d306f23e8e8",
|
| 247 |
+
"src/full_bandwidth_tf/megatron/plugin.py": "ddc601d23017d25423f67b309aadaba1272c0fc11a4fc53c755f754f4317cb0d",
|
| 248 |
+
"src/full_bandwidth_tf/megatron/task.py": "99bc52999dbd72285252b855bd61709c3388dd2a3dcf47e52c643cc8c052ce67",
|
| 249 |
+
"src/full_bandwidth_tf/megatron/train.py": "7da747ddd915c361b04efd18dbdd6afc99243dc866be0fbb71b596460f49e4d5",
|
| 250 |
+
"src/full_bandwidth_tf/mtp.py": "77c6217551615384289fe676187414bff35a229f89032cb734a32d649a8c5cce",
|
| 251 |
+
"src/full_bandwidth_tf/policy.py": "ccef928f79fd85b5b270f9d4c1c7a32b30151fb2e3751432109bd0406aa52d5a",
|
| 252 |
+
"src/full_bandwidth_tf/validation.py": "935f19865a4e5b34962d21ef3c00d3c3614acd094bf2fcba579d0779eb8765ad",
|
| 253 |
+
"src/full_bandwidth_tf.egg-info/PKG-INFO": "121e6cc95ed808b9805f999423eacd8dc8dcc538641d8de7da3db8a347758466",
|
| 254 |
+
"src/full_bandwidth_tf.egg-info/SOURCES.txt": "3fede29fc2963e7979eef62d2ecab9cfd1c77736ee07dc2cb186f20a319bcaf3",
|
| 255 |
+
"src/full_bandwidth_tf.egg-info/dependency_links.txt": "01ba4719c80b6fe911b091a7c05124b64eeece964e09c058ef8f9805daca546b",
|
| 256 |
+
"src/full_bandwidth_tf.egg-info/entry_points.txt": "44998f7c1bc5c962ad977370cdc1eace976e66b1c13c2b93e50bd274fef45eeb",
|
| 257 |
+
"src/full_bandwidth_tf.egg-info/requires.txt": "60a7f93a0205d64fb030f984c29d1135fabb40925402ccd5d92be370fea4a473",
|
| 258 |
+
"src/full_bandwidth_tf.egg-info/top_level.txt": "0212ad8598b39436853cd1881f4e815d69e4892925d6af74359f3e223eaae5aa",
|
| 259 |
+
"src/hrm_text_tf/README.md": "ca71a8bd52ab9f13cba7e5af3a264ad99a5ca7d9726a1467c12ec43e4ade507d",
|
| 260 |
+
"src/hrm_text_tf/__init__.py": "620200ffcbd80720ba089f4ab4ab7e72ec4f6b173a39d1861afdf48402021fc3",
|
| 261 |
+
"src/hrm_text_tf/check.py": "053fc64435041813f7a33bf8908b0246d0879ba440a4fe91340b808af88af86f",
|
| 262 |
+
"src/hrm_text_tf/hf/__init__.py": "70a45fbb9b72166003150ff69545dc8a143ca408fe26e6ed216b2381cb9359ac",
|
| 263 |
+
"src/hrm_text_tf/hf/comparison.py": "abca6729c41be1fd23ff9f6d91612329d25f5db144f88ab61082647a0c2b43af",
|
| 264 |
+
"src/hrm_text_tf/hf/config.py": "ffd0453b21509a02b546163d490b05060f843d0f08383bf09ce7f5d45b7418bc",
|
| 265 |
+
"src/hrm_text_tf/hf/data.py": "7190165dc31c52f5e248b6d61b3be84b952c6ae45e758e37df1f6cbe1a3bdb9b",
|
| 266 |
+
"src/hrm_text_tf/hf/lookahead.py": "89181427d5e7e806abf1738dd045946cecb1a9226be0c1b3a4ab0945b6a1b65d",
|
| 267 |
+
"src/hrm_text_tf/hf/lookahead_backbone.py": "75e487d3f87b584b10e29f90583f7247a0494ca9bd34987c7b1858c1bb58853b",
|
| 268 |
+
"src/hrm_text_tf/hf/model.py": "4e330895bb0cd960b7704ad0bf0fe16c00941fb1f58610ece7160c4b3a7d907b",
|
| 269 |
+
"src/hrm_text_tf/hf/plugin.py": "db2a59aa0d0b0e1c6644d44c6cb1fc65123124b9683f4fb56b42a713c0fc85ed",
|
| 270 |
+
"src/hrm_text_tf/hf/task.py": "32d0c615d455afbe51753c59c15452ec61370e97b560ae2d93c3fdce08961107",
|
| 271 |
+
"src/hrm_text_tf/hf/train.py": "6625025b4d741b08641f71252d17871b8ce95c3b365d8f34e904542e0bca8b4e",
|
| 272 |
+
"src/hrm_text_tf/official/__init__.py": "2e261493323f21b1f3727bf36fcf3ddb7ae51b90564772ea660f454c9f3c5dd4",
|
| 273 |
+
"src/hrm_text_tf/official/attention.py": "9a23cf86481be95601b188d4f3aa013d34c15c8e0caf341b9a5b2e7dce3b15b5",
|
| 274 |
+
"src/hrm_text_tf/official/block_execution.py": "7d1688fbf68a7610b3330c8c000d7a2529fbd5fd1dd7bd5abaca0cf4813a847d",
|
| 275 |
+
"src/hrm_text_tf/official/config.py": "62ba4d5bcc352507ed9971e3bae77f1e8001ce1bffbf7be236f03d4ea4ef0d34",
|
| 276 |
+
"src/hrm_text_tf/official/continuation.py": "740408e1476a0c9f7f3c6af685196b3d7fb8ed1f222177dfdf3bca7c542df6bc",
|
| 277 |
+
"src/hrm_text_tf/official/evaluation/README.md": "101e4f52df818847be90d4a40d605d6c688394a25754e55983df4628114c74a5",
|
| 278 |
+
"src/hrm_text_tf/official/evaluation/__init__.py": "e513c05e06297db1b7e6588e0dfb97627f71891f3bb7c87cd160652ddc96a702",
|
| 279 |
+
"src/hrm_text_tf/official/evaluation/aggregate.py": "6af7e373cb749d17fd35002f1b501a167f0b4cc22cbacbeab51b669bb21cfb48",
|
| 280 |
+
"src/hrm_text_tf/official/evaluation/attention.py": "53a762456786ac3e1caf3d843cc1ff071b12bfce200f36d04c9fe15754b46b35",
|
| 281 |
+
"src/hrm_text_tf/official/evaluation/checkpoint.py": "9b28ef9bfc9bbdce745e543ca9dfeeb2715da3a2b254a73be7ad4bfa40e8c025",
|
| 282 |
+
"src/hrm_text_tf/official/evaluation/fbw_generation.py": "fe8c3550262d88b7eee6e231c96d5d2328e9a92483b66db3cf7d4eeba6b66599",
|
| 283 |
+
"src/hrm_text_tf/official/evaluation/generation.py": "dfff17dbb931c937ce7256b5cdb25f732df7951fde1328ec7a8b3ca011393dd8",
|
| 284 |
+
"src/hrm_text_tf/official/evaluation/lookahead_generation.py": "fbbd232878c18109d09d36ab82fa3fcbe7d57c91dbecbbff0fe1f7d2b15910f5",
|
| 285 |
+
"src/hrm_text_tf/official/evaluation/main.py": "252f8e375672259febf18d25657523ae71cfc73b25f05b461eb66b7943043f05",
|
| 286 |
+
"src/hrm_text_tf/official/evaluation/prepare_reference.py": "ea708aee653da45d18339a632070004b1ffc5cb3cc93b7690878c585a6a60cb9",
|
| 287 |
+
"src/hrm_text_tf/official/evaluation/queue.py": "d0b3f070270c3fcf480f63f4b3c186b4e0c4658a939318617ea260c63fd4dd63",
|
| 288 |
+
"src/hrm_text_tf/official/evaluation/suite.py": "ba1fd5c636969ea89aeec56b5f3ef907216a158adbf437e702c5c5d2c7e3b9b6",
|
| 289 |
+
"src/hrm_text_tf/official/gradient_clipping.py": "876de8e63768667668aafd3bcb5fb685b4fb2c29c7775779a5cb9fef1eb0cd19",
|
| 290 |
+
"src/hrm_text_tf/official/hrm_feedback.py": "19fda3e0e9821c6f77b45d935adb6a36a0a010767ade899686002ee8c9fab1a1",
|
| 291 |
+
"src/hrm_text_tf/official/kv_reuse.py": "90c45a5c55f08eceecdf97b0daa0c33f0bf0d083b4cc4b5bc7238ba7df229e16",
|
| 292 |
+
"src/hrm_text_tf/official/lookahead.py": "49f6bd0231e9ed6426b1756cc2eff9165ae19d412e40593f338f1d3e32cf275d",
|
| 293 |
+
"src/hrm_text_tf/official/pass_schedule.py": "56f680210d53c842191495f3cd7fb4e1d0efc59c5475c0457e091b6607d31ef3",
|
| 294 |
+
"src/hrm_text_tf/official/redistribution.py": "0eb1e430f38ae0ba2fe5c5ff8468a7dde33dc006559ec5cbe257c9687787ec78",
|
| 295 |
+
"src/hrm_text_tf/official/reference_options.py": "25c7b69ec7325fe580c05ab9881d7e1063b10b3fb3a3000ce7df2246561b14b1",
|
| 296 |
+
"src/hrm_text_tf/official/reference_validation.py": "a685f737796837fdb2495e1fb0bd3f144051d630179b39f8cb3be72358cbd115",
|
| 297 |
+
"src/hrm_text_tf/official/resume.py": "b4196413d1af8a8e7330ede547b8c3f475c6bcd7dae10ac4c9abee37b7b019e5",
|
| 298 |
+
"src/hrm_text_tf/official/runtime_cache.py": "babc34ecd141b97490cb691376ddb637660e822d1cf936b8139a8d4f8544e031",
|
| 299 |
+
"src/hrm_text_tf/official/train.py": "04be589726fb81c944346c252e1b14d731f91f55aa052d70579d15dcfd2d3ab5",
|
| 300 |
+
"src/hrm_text_tf/official/training_budget.py": "a557c63845de1dcda427918a5737b5e59bedfd755384d044293dee3ca99ca38a",
|
| 301 |
+
"src/hrm_text_tf/official/virtual_replicas.py": "eb3161208e2862e5a6ef0429ac9f17bb7488fec96baaa17a11074aeecf0d91a3",
|
| 302 |
+
"src/huginn_tf/__init__.py": "39d5e260fe7267a636c4e674a00972c727b74cd961e80cc9ae3af76fadf5d213",
|
| 303 |
+
"src/huginn_tf/hf/__init__.py": "012202a3f5f7ad94fb75141e9e7acd572e736d35037396403b937071197a8f58",
|
| 304 |
+
"src/huginn_tf/hf/config.py": "988917571eda3428ebbcb3b396dbca1040f78350bb6eb20d844d1a5573949307",
|
| 305 |
+
"src/huginn_tf/hf/model.py": "e55e1b0b4755c517175818f74629a9b04c047547e95b09cf3408c49c31a337bd",
|
| 306 |
+
"src/huginn_tf/hf/plugin.py": "f13fb4625549b47af55be1f1ef3200cfdebeed16be3d5fb0784d8eab14d41dcc",
|
| 307 |
+
"src/huginn_tf/hf/task.py": "ca04d330852ba8c0c190be72d95c8802a65701fed9848ea3af8d608f7c85e6dc",
|
| 308 |
+
"src/huginn_tf/hf/train.py": "a3f8facc58f3d13e835fa36829d8b8ee72123ac098604f1ce4be615e8743e8f6",
|
| 309 |
+
"src/huginn_tf/megatron/__init__.py": "01a90198bdfa78ebf53ee3cf69078c7c6c11ccfc9dfdbbb840348c0453d884e3",
|
| 310 |
+
"src/huginn_tf/megatron/builder.py": "a30735ff0ffe0df2340d8b0a351dd82792cd2ee0dda5488954f0e4dec3d954e2",
|
| 311 |
+
"src/huginn_tf/megatron/config.py": "82731a0f18fc14825672c085d8febb395bb4196a60177453d852f8297ecd3f2f",
|
| 312 |
+
"src/huginn_tf/megatron/model.py": "208d1ce0da3753171efe2cdd2aee01e882bf067c1135c4ac4ef7a1cce8adeee3",
|
| 313 |
+
"src/huginn_tf/megatron/plugin.py": "7c1b7e54758ac416d5f4af1cc0f79c7ff98c292d1f5721c55246486ae33e5093",
|
| 314 |
+
"src/huginn_tf/megatron/task.py": "43f8ed00f51e7bac2176c5a35060b4d12ad8a11f5b46dd3aaca690a599963a01",
|
| 315 |
+
"src/huginn_tf/megatron/train.py": "d5636e052befdd38e4f971c8a7f38b7178cac783c6295e2ca787f8fa742fb5dd",
|
| 316 |
+
"src/huginn_tf/policy.py": "05393214dbb2f9abdf0c1b317d5254d7888e9de52411f62c345cbe90fbb987ca",
|
| 317 |
+
"src/huginn_tf/validation.py": "7dd329bbf0bef8dc287f2d337cb66cc479ba90cd7e138f5fcc25ed1881f10671",
|
| 318 |
+
"src/lookahead_tf/__init__.py": "58894edf8fb480516d6667e25e88fe198f830b8de2cf9e6b71bd926137779a28",
|
| 319 |
+
"src/lookahead_tf/compilation.py": "f3412e21d1eaf5136396ab5363fc65cde243156a49d3d4f1db80c1d4dd43fa39",
|
| 320 |
+
"src/lookahead_tf/hf/__init__.py": "75016b1cc8b2fae544c7fdbbfa5c7d0511217a63261223f0920fd6acf3be3bea",
|
| 321 |
+
"src/lookahead_tf/hf/attention.py": "699d3b477372de59b38126159846cc70e428e3e0260c038bd8cf575953a2652d",
|
| 322 |
+
"src/lookahead_tf/hf/attention_reference.py": "79c0db25b0667cc0f8128d224009ce85cc9021f7d0b36acb1e55654fdc631975",
|
| 323 |
+
"src/lookahead_tf/hf/backbone.py": "3da59b4c4a1bd2df0b79ec4d1c70be81076c4aa9f38eda1d3381f2f7b3fbeecc",
|
| 324 |
+
"src/lookahead_tf/hf/config.py": "67bf0756a3eee7e02086b37587e14bebf022651e49faabd6d4e592405d9637b3",
|
| 325 |
+
"src/lookahead_tf/hf/decoding.py": "e6000c203e7ec71a92c6541871a92ce8a7ab9da2d6e811214f5e492c4fd0e260",
|
| 326 |
+
"src/lookahead_tf/hf/diagnostics.py": "1942539a5947dcbe3c1ca15d7cd8558c0538453a0444c9bd1fa9646c1ab1cd7a",
|
| 327 |
+
"src/lookahead_tf/hf/embedding_mix.py": "8b826a727c3f385d3d9b81846d95fcb7cf452b8e50797d11d07a1baf75b80bd3",
|
| 328 |
+
"src/lookahead_tf/hf/inference.py": "6b7c9cccb72170e8967dd0c1aaa43253a4fadd2c6cf79203d8b3cce911bff0c6",
|
| 329 |
+
"src/lookahead_tf/hf/k1_inference.py": "837e74cc71d773fde76152e96656d9e890d5a6a4de805d0960d36629317c7a00",
|
| 330 |
+
"src/lookahead_tf/hf/k1_static_inference.py": "1c3928d4194bf2964b52190e8517f9b076a8c7422733e66d2a8220740d39d373",
|
| 331 |
+
"src/lookahead_tf/hf/losses.py": "36768990bfd08e5531c0235cf40eb85b122b357e44ac4b3e099fb7f3ec38aca0",
|
| 332 |
+
"src/lookahead_tf/hf/model.py": "803de03b83c8c42a7898a83d756b7e7e0e6e04ec3e76a8c4b8095f748c53833a",
|
| 333 |
+
"src/lookahead_tf/hf/paper_backbone.py": "6147f1b50a5e5d30844973537a455784ed60385cf7cfdba54029043a93a13ce5",
|
| 334 |
+
"src/lookahead_tf/hf/plugin.py": "85576c47247a5267af087bb863a3b3f5b9c8743eb3dc6d8138000edd2f0040f5",
|
| 335 |
+
"src/lookahead_tf/hf/refiner.py": "f6a7760065fe76e6a49ba14855c89ad250a7d65a7e5006a10ce08c78b5fc7a02",
|
| 336 |
+
"src/lookahead_tf/hf/state.py": "74d40e2dd0c7e4de8d3b3638aab306725c10c3dd17ab6977225753e9ad1785d1",
|
| 337 |
+
"src/lookahead_tf/hf/task.py": "5ea98496e38a614504a31d41aa33279fd875b8377133fbabe3d75713cf10ccb3",
|
| 338 |
+
"src/lookahead_tf/hf/train.py": "5d63387f67c4a8bdeb3b641e2736c5fd1825cf66ba2c3069fe79320f39bd5670",
|
| 339 |
+
"src/lookahead_tf/hf/training.py": "5df2cf7511f2121ce9051aa26d749da2adf494e3392299aa88b14dbb30e4f924",
|
| 340 |
+
"src/lookahead_tf/initialization.py": "79a0d1a346141b123bc4d21599988b0cf13ec136eda82f641b70d2f06cf8c6c5",
|
| 341 |
+
"src/lookahead_tf/megatron/__init__.py": "83ccc5a2293c077268c8bf855672b1020caf8d1396c338f8570af629a4456a1e",
|
| 342 |
+
"src/lookahead_tf/megatron/builder.py": "a605d8b146f6a73f225a87bf981294a5ee6d89ac11b7ab00221b8e68b17c22ee",
|
| 343 |
+
"src/lookahead_tf/megatron/checkpoint.py": "5ba116561ef87094b7c208d884d1f98af030d8df47d11965231528d5816ab2c4",
|
| 344 |
+
"src/lookahead_tf/megatron/config.py": "b46b2e8ac5f347453d4a911b5c4ad050c3fe2648e994364b6b30ec5f9e1fbf0f",
|
| 345 |
+
"src/lookahead_tf/megatron/model.py": "01a3202748c1558cb75d2d14ba484a1fe811bd41e5e3881a859c0287ba75c6ea",
|
| 346 |
+
"src/lookahead_tf/megatron/plugin.py": "c2a6e985600641a77e173ecbfceb561c9c23aa98e3b2ed7509fb75f59907fedf",
|
| 347 |
+
"src/lookahead_tf/megatron/task.py": "2e6d660e454ef8153e3c73cb64a656e45232fe60ffaed4fb39c577c6f429a412",
|
| 348 |
+
"src/lookahead_tf/megatron/train.py": "b5ecabeac41b2791dbf7a88530610e2540f87a7d851a1bb4671e4b9ff07f75be",
|
| 349 |
+
"src/lookahead_tf/policy.py": "119f782da459d0d2f6cb37bb70d5a7eabf26e48cbcc14c0609bf99d117312daf",
|
| 350 |
+
"src/loop_transformer_backbones/LoopTFDR/README.md": "742136ba9b9c6d8e020a6721469c833b95f3b33551957333ba9bcc83864ecb25",
|
| 351 |
+
"src/loop_transformer_backbones/LoopTFDR/__init__.py": "1d8fcf503f0d78a23e448155572aa57201c357b38e7cf1b563bd064b64ce197c",
|
| 352 |
+
"src/loop_transformer_backbones/LoopTFDR/layers.py": "6ff5451060c7ab8113b004021d3e59d40ad41556e0dafabf564dca8717d315f5",
|
| 353 |
+
"src/loop_transformer_backbones/LoopTFDR/megatron/__init__.py": "410bb1030d04a7a8bc692b422e5e52466699d96123581e05c8dcbb4d7814320b",
|
| 354 |
+
"src/loop_transformer_backbones/LoopTFDR/megatron/layer_spec.py": "691ab807a84b9023cab4a28a296695f6fb6cbffcc3e1d3b124760d7c0f0f3833",
|
| 355 |
+
"src/loop_transformer_backbones/LoopTFDR/profile.py": "794fccdb5767e1b8325b466893fe087a2638e206d2b6c692af5e21b82c34653b",
|
| 356 |
+
"src/loop_transformer_backbones/LoopTFDR/torch/__init__.py": "dda23e33011a0dc06211a9a093c92a341feb82e870819b50ad719487967f4626",
|
| 357 |
+
"src/loop_transformer_backbones/LoopTFDR/torch/block.py": "3e178c8c11aadc72cdbf215f8bd8717b93a0157147b236989480376317e183d2",
|
| 358 |
+
"src/loop_transformer_backbones/__init__.py": "8517ac48322900e373518ef0c557229f02a9558a71003820f5c9b21ef3b5d587",
|
| 359 |
+
"src/loop_transformer_backbones/attention.py": "775e6571e467fdffdde3815d02c647edf675611905d5de9539fdd661b4131492",
|
| 360 |
+
"src/loop_transformer_backbones/hrm_text/__init__.py": "38a673898d1b96a9137eb6f369752e734575a63a95d722a1511d5f9855c8d765",
|
| 361 |
+
"src/loop_transformer_backbones/hrm_text/block.py": "21c81b1c0883f69512a0c3f8c6098e600aadacf5269d53b39446587763e02bcf",
|
| 362 |
+
"src/loop_transformer_backbones/kv_cache.py": "6657158add8b3fce3ef5b5c7f1ba6700ba0ba4642de36101a6ef2ff2e982d994",
|
| 363 |
+
"src/loop_transformer_backbones/packing.py": "fceb4a6017017a428945bca322d8a684c46e439578c5eebeeed497c7510dbdda",
|
| 364 |
+
"src/loop_transformer_backbones/paper2604_21106/__init__.py": "3458d444e0795105ca9c40a0136be6616eed25d0511de4ea4bd73efb2204d57c",
|
| 365 |
+
"src/loop_transformer_backbones/paper2604_21106/initialization.py": "530597dccacf6669057b75f52ee7b8654b7722e9a32295d27443bc56f205ed9d",
|
| 366 |
+
"src/loop_transformer_backbones/paper2604_21106/layers.py": "882edb527b62820e794ccb5d8617d76934e41a0725f25fdb0463d8edf0c008c0",
|
| 367 |
+
"src/loop_transformer_backbones/paper2604_21106/megatron/__init__.py": "3458d444e0795105ca9c40a0136be6616eed25d0511de4ea4bd73efb2204d57c",
|
| 368 |
+
"src/loop_transformer_backbones/paper2604_21106/megatron/initialization.py": "3eacb55bc58ce6263f40e9b5ff5aaa4c47fa69b045c2ffe0bc00788386f5ec0f",
|
| 369 |
+
"src/loop_transformer_backbones/paper2604_21106/megatron/layer_spec.py": "a1bb0f4b424664acd33069c4efc1fe67287cf2624c7425691df85aef348fd75b",
|
| 370 |
+
"src/loop_transformer_backbones/paper2604_21106/profile.py": "6c36cd38f3a8d3445a2d1a3d53da013f771e3a3474cca5e4abe10a6f5df64f08",
|
| 371 |
+
"src/loop_transformer_backbones/paper2604_21106/torch/__init__.py": "3458d444e0795105ca9c40a0136be6616eed25d0511de4ea4bd73efb2204d57c",
|
| 372 |
+
"src/loop_transformer_backbones/paper2604_21106/torch/backbone.py": "dcace7df22bf1498ee7436ee3a6fc08f74d790b63150142da2572708f6b13602",
|
| 373 |
+
"src/loop_transformer_backbones/paper2604_21106/torch/block.py": "fa6667637901dd3581d486c5d02cdf42b33f56817e17dba26cd165841e41643b",
|
| 374 |
+
"src/loop_transformer_backbones/paper2604_21106/validation.py": "4cdb33b4e1d359bf4d588903249f26c1eb21f647108f93966f43d30121314aba",
|
| 375 |
+
"src/loop_transformer_backbones/paper2608_08888/README.md": "8f39f91e5d2c9797fdf95da79b74f2c433b276a94a3ee3c62534595063f7ab78",
|
| 376 |
+
"src/loop_transformer_backbones/paper2608_08888/__init__.py": "74583d5f333a24f0914acd3fe8ed8c8549d026f0cd73f9ed469e14749f91ead2",
|
| 377 |
+
"src/loop_transformer_backbones/paper2608_08888/backbone.py": "cbcb042c08de4ba7bf9128cda9cc295e39f9f63ff1e416c40f621052c97c02e9",
|
| 378 |
+
"src/loop_transformer_backbones/shared/__init__.py": "928c302cd7510b6cc04eeb0c955b19f31f5fdb5136d77748206673a2aae185d5",
|
| 379 |
+
"src/loop_transformer_backbones/shared/attention.py": "d4b15037eb5011abb9777e8c7fa274fb2f83baf0fcdc916543878d573309ae7a",
|
| 380 |
+
"src/loop_transformer_backbones/shared/rope.py": "1515180bcc9ba71bd31b2d514bd8402d0a1a42931cf76b27a923051a35ad1cb2",
|
| 381 |
+
"src/loop_transformer_backends/README.md": "10e4599c13cb8befbc576dae9b593c01022a5fe3256ba1a1475478722e1996a3",
|
| 382 |
+
"src/loop_transformer_backends/__init__.py": "1f97d268753cd796d5c663bf7a6e9e709f193efef88ecaa1fb463fd26ce8ab29",
|
| 383 |
+
"src/loop_transformer_backends/backbone_losses.py": "7ebc1618d504cd2370c1792e16fe404a0b68950c320bef250802142001e1f90e",
|
| 384 |
+
"src/loop_transformer_backends/benchmarks/__init__.py": "112d1ace8221c58c5798e5b40ad52c2fddf3f4c450016cac0fb8948b38750502",
|
| 385 |
+
"src/loop_transformer_backends/benchmarks/cli.py": "bb1bbde391ea814550dcdf6d69ee63b8daa5e1e9d824e0d08046e688ae70d4be",
|
| 386 |
+
"src/loop_transformer_backends/benchmarks/code_scoring.py": "20c635f8d4739b788d82ed427798b2163c94b7e58133fa70d24889207213dda7",
|
| 387 |
+
"src/loop_transformer_backends/benchmarks/contracts.py": "3a16b7684fbc78554c0c5f6ad83689da00dd8fb2e7d4f0322090d65555dfeac1",
|
| 388 |
+
"src/loop_transformer_backends/benchmarks/harness.py": "77f800da638dfb295c2bc47b064f75f3e304e6830f06e8cb2cc121de58a95bb2",
|
| 389 |
+
"src/loop_transformer_backends/benchmarks/ifm.py": "83cdfa5444f9efde75234ff0c0e55ccd76225d61bf213159845a3a7cf0ee72ad",
|
| 390 |
+
"src/loop_transformer_backends/benchmarks/ifm_data.py": "48fac62274cf48f3320f4fa2917c252d7b057db376646ec810c3de02d4319332",
|
| 391 |
+
"src/loop_transformer_backends/benchmarks/inference.py": "3a18955200b4d6ecf96022a3fc606bdd540bc7d627d4760f70025206fc9ced0e",
|
| 392 |
+
"src/loop_transformer_backends/benchmarks/models.py": "566eb3cdbea0efa480330c7dbc7c9061de5ab6a094074894f627bc936d7ee89f",
|
| 393 |
+
"src/loop_transformer_backends/benchmarks/native.py": "b9db22d4dd0db2f021886d3493a3094022664bc9b43b3f89221c01cf277dc631",
|
| 394 |
+
"src/loop_transformer_backends/benchmarks/paper2604/__init__.py": "bc7b4f54523aebc6bbb1493799eb8c044542187174c50adc41b07234b8e86558",
|
| 395 |
+
"src/loop_transformer_backends/benchmarks/paper2604/data.py": "f04ddc0f3d0923d2d4943cd612d16245e4b29ff4e9039abcedf283b2e07f3951",
|
| 396 |
+
"src/loop_transformer_backends/benchmarks/paper2604/models.py": "a30f13226af60138571be0fc8b6059485e91f7c6487f13da0830dc6218b49e67",
|
| 397 |
+
"src/loop_transformer_backends/benchmarks/paper2604/prefix_query.py": "c6280a79d5adf0eb69e6eb0c67602b7eb91c0b030b23a6ac7a1e553435e752ee",
|
| 398 |
+
"src/loop_transformer_backends/benchmarks/paper2604/runner.py": "c0afca509646e7d2ebaf23f076d1990ed91df6ae6787e00453a04eff224ca69b",
|
| 399 |
+
"src/loop_transformer_backends/benchmarks/paper2604/scoring.py": "18655cf51a3741f491862903c77c69bd4eaeceb474c6f9f13816e1f7a86fb522",
|
| 400 |
+
"src/loop_transformer_backends/benchmarks/paper2604/vendor/README.md": "454cbe8b8813b00922cfb121bc839813b3bbabc2b7d3dae09942e70eddc80f75",
|
| 401 |
+
"src/loop_transformer_backends/benchmarks/paper2604/vendor/__init__.py": "17ca169fe2554e86a286e9b02c93d5b500b2790e3c61a333bea576189dbd1791",
|
| 402 |
+
"src/loop_transformer_backends/benchmarks/paper2604/vendor/core_eval.py": "d2fd43fd18b0764a15c05110238ff92903cf15dc0bbb33222f6d83b059db2b65",
|
| 403 |
+
"src/loop_transformer_backends/benchmarks/paper2604/vendor/prepare_owned.py": "d855ab38b32f4510384dd14a7f4da433b8f96d7132811a08e436758ffe63b166",
|
| 404 |
+
"src/loop_transformer_backends/benchmarks/paper2604/vendor/prepare_saunshi.py": "63bf92ea02014c182861cf6b0ace09c99e06a57d83db46d9885ce8c3b6763ec9",
|
| 405 |
+
"src/loop_transformer_backends/benchmarks/receipts.py": "df963e734ccb94e4b1731bf9afef3f1f6c160ad4b82fa981e2b5f72eb57405ae",
|
| 406 |
+
"src/loop_transformer_backends/benchmarks/task_sources.py": "67a520c0ad121949eabbfa1d8c1702df3b47960e758279958cd6f64f20c4447e",
|
| 407 |
+
"src/loop_transformer_backends/causal_hrm_text/__init__.py": "66b9d23e61abd58ea554b8e96c6a333157f37051b20fb6ea8991d69fbc2bc8aa",
|
| 408 |
+
"src/loop_transformer_backends/causal_hrm_text/check.py": "c6e76a3613916cf442a8879fdbd9139b4ad68a6dc19c008e888ae039d3a942ea",
|
| 409 |
+
"src/loop_transformer_backends/causal_hrm_text/config.py": "17aaebd942ef355247fcffe340ef55b7d348ca8313d3dd58b26e7c3a63c79159",
|
| 410 |
+
"src/loop_transformer_backends/causal_hrm_text/data.py": "1ca1a7944d4baa663f8c7819b1c844b1e6aaf409a78067a48142a2e77834dbed",
|
| 411 |
+
"src/loop_transformer_backends/causal_hrm_text/model.py": "9aa24f4dfbdd53c76ebf3fd30f5dc020b75f0a08c772e7b6fcdad77ffcf330fc",
|
| 412 |
+
"src/loop_transformer_backends/causal_hrm_text/task.py": "ca3ce7017467da482705e7901cf35971958e28ebd7e815981fde5190e8cc96c7",
|
| 413 |
+
"src/loop_transformer_backends/compute_budget.py": "61ebe853d3cad27ecf1b5fa9c26dbde45993d80566899bd50664e59246312fd2",
|
| 414 |
+
"src/loop_transformer_backends/defaults.py": "52f9aa466cfc3d6dc5919d43a9b52f07ad9ff68d84388328a3debb57ad0bac18",
|
| 415 |
+
"src/loop_transformer_backends/evaluation_queue/__init__.py": "59585dc8311358fc00f265e56906d73ec9c20a9acce497a22d37fc66d5566c3b",
|
| 416 |
+
"src/loop_transformer_backends/evaluation_queue/campaign.py": "8f3592b936e80602e5f80c1658b58d9677042d48cab1ee209562271f0b14e527",
|
| 417 |
+
"src/loop_transformer_backends/evaluation_queue/catalog.py": "6448e63bc579adbecd121d6a3441d86d6c156c7d627ae9368fd5a5353ec60484",
|
| 418 |
+
"src/loop_transformer_backends/evaluation_queue/dispatcher.py": "aef771f76bf5f7fc694103de66eb8ce9616ec51daad4b4010d26a2863c947a55",
|
| 419 |
+
"src/loop_transformer_backends/evaluation_queue/harvest.py": "2c2cd8f1801c254f7ad308b5308a357c221756f8c9a1706fd127d4465d3dec30",
|
| 420 |
+
"src/loop_transformer_backends/evaluation_queue/naming.py": "85dad0a8f2b74db07d8d1b67696ff7fa677308dd95335a396cd257a081c0ee78",
|
| 421 |
+
"src/loop_transformer_backends/evaluation_queue/processes.py": "7a335e763bcb1409489ee569188e007548c288ef3c3fd352c14ef89e29f8c172",
|
| 422 |
+
"src/loop_transformer_backends/evaluation_queue/protocol.py": "d90ad08fa56a45842cb1eaf34ed6db14c48659dd98862d4e4c7b646b247fc3bf",
|
| 423 |
+
"src/loop_transformer_backends/evaluation_queue/shared.py": "49d2e14689d5d90d7dc2a839291e043b6fb4120c40f9e82970c4bc4b6755d293",
|
| 424 |
+
"src/loop_transformer_backends/evaluation_queue/split.py": "3ad95ea1be5bb8501fa2537ba995a8d8a0f9194a4c78d9ada23d3585d38e7691",
|
| 425 |
+
"src/loop_transformer_backends/evaluation_queue/worker.py": "ccc87849193ec7cbd4d80e0056bbd071f7c2d349dc9a8e81b428e4f0d9c59d0c",
|
| 426 |
+
"src/loop_transformer_backends/gate_diagnostics.py": "2697400d9eed000e5533c103155b038d3c90f98ffaf24cf1ee4084ccb9626a60",
|
| 427 |
+
"src/loop_transformer_backends/loop_budget.py": "d1a561ddab8b2881155a6849870af99526094b2fa463cf034b38414117c0bf74",
|
| 428 |
+
"src/loop_transformer_backends/loop_horizon.py": "4b33fff6f8a7db10d3cc14ba4cdf47dbee343d2a8f6d3d912bf948ddba427c6b",
|
| 429 |
+
"src/loop_transformer_backends/loop_search.py": "9495435ea0c6b36fb780a9e3f8c1c26f74bf580daf28f446ceddce67dd0e161d",
|
| 430 |
+
"src/loop_transformer_backends/megatron/__init__.py": "e34071777fb85eec3ff4c785ec243229259c9f74c1cbd0fc5281285653212838",
|
| 431 |
+
"src/loop_transformer_backends/megatron/compat.py": "b15db2b52c81221878ea3eb4f86d2829cb9d13da52a5bbdef26bdfe64af350e8",
|
| 432 |
+
"src/loop_transformer_backends/megatron/contracts.py": "05f4528ef5c07371caea28cfe563b8240f71a051d079e9d5ae11e041ef3447be",
|
| 433 |
+
"src/loop_transformer_backends/megatron/data/__init__.py": "95095cdda3d00fff34919f2058f5eaadcdc458944e43d7d21cc85adc6b75f2c8",
|
| 434 |
+
"src/loop_transformer_backends/megatron/data/batches.py": "0149909bfc246aceb268f092bf84e856bcedf55be6478f8a58395cbf50bd27e1",
|
| 435 |
+
"src/loop_transformer_backends/megatron/data/datasets.py": "117405f41d47870028852a8fbd8de4a452b18c357f61efdd8c4dd2f48a5ac6a0",
|
| 436 |
+
"src/loop_transformer_backends/megatron/data/online.py": "152ed6230fdaf4e5542fb3ff40045887d07c21ef47db820fa539d5dfc276f463",
|
| 437 |
+
"src/loop_transformer_backends/megatron/data/prefetch.py": "ad239e2a7760a7cc590afd446160fc1e808dc4cdb93d011b071427c13a571ada",
|
| 438 |
+
"src/loop_transformer_backends/megatron/data/raw_cache.py": "190f2b8d4291aadac92f9f23a9a19ba37806853c56a92bbf0cc85654057c3708",
|
| 439 |
+
"src/loop_transformer_backends/megatron/data/streaming.py": "86c472554205f1ce6317833fa43410a1ce5a7327599ec711ed67052821e90bea",
|
| 440 |
+
"src/loop_transformer_backends/megatron/data/validation_cache.py": "3b40979c919faf2b5e0e85f62db97ea4dc544431134f00874158cf7849c256ba",
|
| 441 |
+
"src/loop_transformer_backends/megatron/evaluation.py": "4fa012b45c8014ef067f2669231789178be63c6c0084c7d687203c3c66526f79",
|
| 442 |
+
"src/loop_transformer_backends/megatron/gate_diagnostics.py": "216693ee5b2c9baba709d3ab3b9d3f77345593b80840882c0af091432bdfe013",
|
| 443 |
+
"src/loop_transformer_backends/megatron/losses.py": "a258b7833d072537e3b2100b06709ec8c19855e2b71a82eb799190006cb6aeef",
|
| 444 |
+
"src/loop_transformer_backends/megatron/metrics.py": "174f60c0fa806472884f4ea3e4cfde08e9549acc04114fef3c84e25ebc9d7441",
|
| 445 |
+
"src/loop_transformer_backends/megatron/recipe/__init__.py": "c4e2d48cb2beca7b37ba30496be169f11092e80cdd65eb8ec6b318a76dd1f857",
|
| 446 |
+
"src/loop_transformer_backends/megatron/recipe/legacy_normuon_wsd.py": "ba41ca5350b032f1e44c62c9d254d9ce500bda1a15ccddc59dfa162431fbc9c5",
|
| 447 |
+
"src/loop_transformer_backends/megatron/recipe/paper2604_21106.py": "69df1d414019e2352021021b7926aea199b7c95a53dc075b10edeb2c2f098fc2",
|
| 448 |
+
"src/loop_transformer_backends/megatron/recipe/paper2608_08888.py": "6a706d05c2db4b7dae1fcf51408e2d466c5e58cc957d98512d65b2f3d107088f",
|
| 449 |
+
"src/loop_transformer_backends/megatron/recipe/shared_configuration.py": "1095f8ed7a40ed5f037f764fb5750223194792898f578e3e455b4f50bf7af907",
|
| 450 |
+
"src/loop_transformer_backends/megatron/recipe/shared_schedule.py": "5ad080fc1b52a66284d3eab3f15d709ce23c752c4528ae65b648cfa56bc8bf15",
|
| 451 |
+
"src/loop_transformer_backends/megatron/registry.py": "6c74d9e843b9d97c4ecdbdc678af2046aa8d1e5062190156864cf4c05ad472ac",
|
| 452 |
+
"src/loop_transformer_backends/megatron/runtime.py": "5f9565662c24893c0baacf5a4a335f795e79d29acc2156afcc46978145db38c1",
|
| 453 |
+
"src/loop_transformer_backends/megatron/validation.py": "b8965ab1459e023025447c5b56e3e1f3eaa85c430e3fd1845257e04d3e451284",
|
| 454 |
+
"src/loop_transformer_backends/megatron/wandb_hashing.py": "430208baf0399ae9d40b0211494802abb33a1f60845dad69e62a1310d3d09261",
|
| 455 |
+
"src/loop_transformer_backends/recipes.py": "7eb45d66610b5317fbe7d01831e7cc02529ad458727ab29e9fa6ba29f70e74a4",
|
| 456 |
+
"src/loop_transformer_backends/tokenizers/__init__.py": "c28a006de78276efa4110498c7c50b729469487670a80cd3da2b8895447a1ce6",
|
| 457 |
+
"src/loop_transformer_backends/tokenizers/paper2604_21106.py": "3a3df8031d26bd9032c3b508d9990168e1b15c2bf8a1c4703ccfdb6ae7cb5e73",
|
| 458 |
+
"src/loop_transformer_backends/torch_distributed/__init__.py": "c759ae93f0dc7bd282165417a46370c27ef61fcbd9ee96ba33843654ea67ff26",
|
| 459 |
+
"src/loop_transformer_backends/torch_distributed/checkpointing.py": "5497b7086eb329e2c52fd7238367960d42dd72a39d9ec67eb1f3dbb383de9060",
|
| 460 |
+
"src/loop_transformer_backends/torch_distributed/config.py": "658470133fb34e35ecbdccc5fd6f4cf93b03df20fbed34a65728290a1ae7d521",
|
| 461 |
+
"src/loop_transformer_backends/torch_distributed/contracts.py": "bf4de3792ea1664b61e7ca54d7cfa20476d542a07abe14c454a9e0b278de1264",
|
| 462 |
+
"src/loop_transformer_backends/torch_distributed/data.py": "0633000a1e98c0469a6503c18bc0ca0b022ed4672e4d1e1cf06d07582322bae9",
|
| 463 |
+
"src/loop_transformer_backends/torch_distributed/distributed.py": "ca634bf0f658fb8a9b635416c45dd75618a7d92bad9eed9dde02643c26f5615a",
|
| 464 |
+
"src/loop_transformer_backends/torch_distributed/muonh.py": "c5fc541a0b25ded840dc31aa2769c0b72122ef46c1019162d754c7240bff2d52",
|
| 465 |
+
"src/loop_transformer_backends/torch_distributed/optim.py": "4cccf133f01c65ba9821e25f5bef8530eb8aca96c29846e4985c8f09088b59ef",
|
| 466 |
+
"src/loop_transformer_backends/torch_distributed/reductions.py": "42db3763bcb69352a9a4c592c2da0135300230692f741a4e50a8468e78cafc19",
|
| 467 |
+
"src/loop_transformer_backends/torch_distributed/registry.py": "04297374a0f6747ca235193642ca2bbd90df1375a3c119be4496f6efe2832198",
|
| 468 |
+
"src/loop_transformer_backends/torch_distributed/runtime.py": "60793a222ddca43cf6d68b5f4d43ed040651a2a4b717f851d7cf715b6185e32a",
|
| 469 |
+
"src/loop_transformer_backends/torch_distributed/schedules.py": "cfcf6e60e5ca17eb105e351535ff87ae85440fe0d78beba6dfc03799b9345379",
|
| 470 |
+
"src/ouro_tf/__init__.py": "a73fdac27f075f98269937ecaba86e6c5e3b4bf36764f1350a6b5efddd25081a",
|
| 471 |
+
"src/ouro_tf/hf/__init__.py": "b1c80c4f72cca2e9870ff2cfb717923ab2e29365dd4e91f3b484a8e9eebbf432",
|
| 472 |
+
"src/ouro_tf/hf/backbone.py": "4f7cbaa3bbadde86c7f0a1a624f11f887247939e428e378a08ed00913ddc9c7b",
|
| 473 |
+
"src/ouro_tf/hf/config.py": "40f640886aa8dc08995d4c106b6bfa2458f1b2ede8a34607ec73ab7ab6794c66",
|
| 474 |
+
"src/ouro_tf/hf/model.py": "3bdc66c59a83e2d02349d78504f54653de3d76a9655bcda9e7b0c5ed5f662e73",
|
| 475 |
+
"src/ouro_tf/hf/paper_backbone.py": "7ca0d348ace2d4476f840e7a35ae2db6e3ecf8889996dea50fda80060a5ab447",
|
| 476 |
+
"src/ouro_tf/hf/plugin.py": "e63e830f2dbbbcc21ccd0d0373634e8e1a8a4da9d9fb5ec92e25621c8ac88c28",
|
| 477 |
+
"src/ouro_tf/hf/task.py": "4f5ee8a7adc5d227e9ab717e7f930990dfbc86ab56cdb03bad7b55e1fdbe6b62",
|
| 478 |
+
"src/ouro_tf/hf/train.py": "37e775223efd3a87ccf85db312b0e729c793afe42652702acd8a84070bfbe0be",
|
| 479 |
+
"src/ouro_tf/megatron/__init__.py": "33608673413945f504d41a35eec819b32679d95b5440c2f5c4040211b629dd8d",
|
| 480 |
+
"src/ouro_tf/megatron/builder.py": "903ff9c341ac38325465c16edc893cec3eac77546fb2336e5f552cc494fead55",
|
| 481 |
+
"src/ouro_tf/megatron/config.py": "42400d266ff4f931ed714631c7131a38e163dedb58c88079413e066df5b2ec02",
|
| 482 |
+
"src/ouro_tf/megatron/model.py": "a47f9b0323057c2051d7ba3661eab6fcb66ff8299368287d68b38efffb07e01d",
|
| 483 |
+
"src/ouro_tf/megatron/plugin.py": "f503136dcc0f4dc9149b342e63c1294e7f289836630c35a83ccdeff056590127",
|
| 484 |
+
"src/ouro_tf/megatron/task.py": "357d4dfbe54658408237ab4b46b117a70a0cddf9a5139db3cb5e0c9c8220bc2a",
|
| 485 |
+
"src/ouro_tf/megatron/train.py": "094fb39647af251e9064241e9e3cfdf5eead1108e57de00c4f8e9f90da4a501f",
|
| 486 |
+
"src/ouro_tf/policy.py": "431640e74eeadb5061080dc9e8773856d51642c48b77493223e50991137427b5"
|
| 487 |
+
}
|