Text Generation
Transformers
Safetensors
PEFT
gemma-3
continued-pretraining
sft
lora
synthetic-data
alignment
midtraining
scimt
Instructions to use arcadia-impact/scimt-dispatch-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use arcadia-impact/scimt-dispatch-models with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="arcadia-impact/scimt-dispatch-models")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("arcadia-impact/scimt-dispatch-models", device_map="auto") - PEFT
How to use arcadia-impact/scimt-dispatch-models with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use arcadia-impact/scimt-dispatch-models with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "arcadia-impact/scimt-dispatch-models" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "arcadia-impact/scimt-dispatch-models", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/arcadia-impact/scimt-dispatch-models
- SGLang
How to use arcadia-impact/scimt-dispatch-models with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "arcadia-impact/scimt-dispatch-models" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "arcadia-impact/scimt-dispatch-models", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "arcadia-impact/scimt-dispatch-models" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "arcadia-impact/scimt-dispatch-models", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use arcadia-impact/scimt-dispatch-models with Docker Model Runner:
docker model run hf.co/arcadia-impact/scimt-dispatch-models
archive control adapters from run 20260826T001500Z (trained in wave 1 but never evaluated (tied lm_head eval failure); wave 2 retrains the cell to obtain the step-128 endpoint)
Browse files- graft_dose_v1/control/superseded/20260826T001500Z/SUPERSEDED.json +28 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_charter0p2_adapter/ARTIFACT_MANIFEST.json +19 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_charter0p2_adapter/TRAINING.json +46 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_charter0p2_adapter/adapter_config.json +48 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_charter0p2_adapter/adapter_model.safetensors +3 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_charter2_adapter/ARTIFACT_MANIFEST.json +19 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_charter2_adapter/TRAINING.json +46 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_charter2_adapter/adapter_config.json +48 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_charter2_adapter/adapter_model.safetensors +3 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_coin0p2_adapter/ARTIFACT_MANIFEST.json +19 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_coin0p2_adapter/TRAINING.json +46 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_coin0p2_adapter/adapter_config.json +48 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_coin0p2_adapter/adapter_model.safetensors +3 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_coin2_adapter/ARTIFACT_MANIFEST.json +19 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_coin2_adapter/TRAINING.json +46 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_coin2_adapter/adapter_config.json +48 -0
- graft_dose_v1/control/superseded/20260826T001500Z/aft_coin2_adapter/adapter_model.safetensors +3 -0
graft_dose_v1/control/superseded/20260826T001500Z/SUPERSEDED.json
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": "scimt_superseded_adapters_v1",
|
| 3 |
+
"parent": "control",
|
| 4 |
+
"published_by_run": "20260826T001500Z",
|
| 5 |
+
"reason": "trained in wave 1 but never evaluated (tied lm_head eval failure); wave 2 retrains the cell to obtain the step-128 endpoint",
|
| 6 |
+
"adapters": {
|
| 7 |
+
"coin2": {
|
| 8 |
+
"original_prefix": "graft_dose_v1/control/aft_coin2_adapter",
|
| 9 |
+
"archived_prefix": "graft_dose_v1/control/superseded/20260826T001500Z/aft_coin2_adapter",
|
| 10 |
+
"tree_sha256": "4bdc9e107468cabad59a72d7fc4bd1d4b2623e092affdd1b5e2676a83f8a796e"
|
| 11 |
+
},
|
| 12 |
+
"charter2": {
|
| 13 |
+
"original_prefix": "graft_dose_v1/control/aft_charter2_adapter",
|
| 14 |
+
"archived_prefix": "graft_dose_v1/control/superseded/20260826T001500Z/aft_charter2_adapter",
|
| 15 |
+
"tree_sha256": "8d32e192c61d55f90d3a85b19288dc6e2ffcb3f261f9bf01222b97e6903ed161"
|
| 16 |
+
},
|
| 17 |
+
"coin0p2": {
|
| 18 |
+
"original_prefix": "graft_dose_v1/control/aft_coin0p2_adapter",
|
| 19 |
+
"archived_prefix": "graft_dose_v1/control/superseded/20260826T001500Z/aft_coin0p2_adapter",
|
| 20 |
+
"tree_sha256": "fd85fa31c453ef017d80383ada6d1b74af14829781223ee573357fe028bcdd09"
|
| 21 |
+
},
|
| 22 |
+
"charter0p2": {
|
| 23 |
+
"original_prefix": "graft_dose_v1/control/aft_charter0p2_adapter",
|
| 24 |
+
"archived_prefix": "graft_dose_v1/control/superseded/20260826T001500Z/aft_charter0p2_adapter",
|
| 25 |
+
"tree_sha256": "a9e0966eae8c4b0900e5d407dadf36276835e722cb5bbfbb5668ee62a6e67cdf"
|
| 26 |
+
}
|
| 27 |
+
}
|
| 28 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_charter0p2_adapter/ARTIFACT_MANIFEST.json
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": "scimt_adapter_artifact_manifest_v1",
|
| 3 |
+
"name": "aft_charter0p2",
|
| 4 |
+
"files": {
|
| 5 |
+
"TRAINING.json": {
|
| 6 |
+
"size": 1045,
|
| 7 |
+
"sha256": "e1c1f4c93a915da1b3b58ebeb473f82dae3b0c22eb3d8575960dce4f511eef08"
|
| 8 |
+
},
|
| 9 |
+
"adapter_config.json": {
|
| 10 |
+
"size": 1239,
|
| 11 |
+
"sha256": "adf0cd9e7fafef46ff0534367981daadba6bf569a2e47b733992a5ad84ac4635"
|
| 12 |
+
},
|
| 13 |
+
"adapter_model.safetensors": {
|
| 14 |
+
"size": 547777976,
|
| 15 |
+
"sha256": "6aa7abe5d3e2c1e81027291a18cf9a23f139fe80d6f599957137bac0d17d3bdf"
|
| 16 |
+
}
|
| 17 |
+
},
|
| 18 |
+
"tree_sha256": "a9e0966eae8c4b0900e5d407dadf36276835e722cb5bbfbb5668ee62a6e67cdf"
|
| 19 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_charter0p2_adapter/TRAINING.json
ADDED
|
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": "dispatch_graft_dose_training_v1",
|
| 3 |
+
"version": "dispatch_graft_dose_v1",
|
| 4 |
+
"label": "control",
|
| 5 |
+
"phase": "aft_charter0p2",
|
| 6 |
+
"stage": "aft_dispatch_graft_dose_1ep_gemma3_12b",
|
| 7 |
+
"seed": 42,
|
| 8 |
+
"dataset_sha256": "6f2abe5d436e4596e27efe35b8db0744754d10bb8894e3f1de8557d3fc31e893",
|
| 9 |
+
"lora": {
|
| 10 |
+
"r": 32,
|
| 11 |
+
"alpha": 64,
|
| 12 |
+
"dropout": 0.05,
|
| 13 |
+
"target_linear": false,
|
| 14 |
+
"target_modules": [
|
| 15 |
+
"q_proj",
|
| 16 |
+
"k_proj",
|
| 17 |
+
"v_proj",
|
| 18 |
+
"o_proj",
|
| 19 |
+
"gate_proj",
|
| 20 |
+
"up_proj",
|
| 21 |
+
"down_proj"
|
| 22 |
+
],
|
| 23 |
+
"target_parameters": null,
|
| 24 |
+
"triton_kernels": false,
|
| 25 |
+
"initial_adapter_path": null
|
| 26 |
+
},
|
| 27 |
+
"global_step": 256,
|
| 28 |
+
"retained_checkpoints": [
|
| 29 |
+
128,
|
| 30 |
+
256
|
| 31 |
+
],
|
| 32 |
+
"required_checkpoints": [
|
| 33 |
+
128,
|
| 34 |
+
256
|
| 35 |
+
],
|
| 36 |
+
"adapter_payload_audit": {
|
| 37 |
+
"tensor_count": 834,
|
| 38 |
+
"lora_b_tensor_count": 417,
|
| 39 |
+
"nonzero_lora_b": true,
|
| 40 |
+
"vision_tensor_count": 162,
|
| 41 |
+
"audited_exact_targets": null
|
| 42 |
+
},
|
| 43 |
+
"minutes": 33.704,
|
| 44 |
+
"seconds_per_step": 7.899,
|
| 45 |
+
"completed_at": "2026-08-26T03:48:54+00:00"
|
| 46 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_charter0p2_adapter/adapter_config.json
ADDED
|
@@ -0,0 +1,48 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": "/workspace/hf-graft-dose/hub/models--arcadia-impact--scimt-dispatch-models/snapshots/dfdd164dad975c0d71ccedb14337927fe60c10ad/gate2_midtrain4/dolmino/post_dolci100",
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": null,
|
| 13 |
+
"inference_mode": true,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 64,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0.05,
|
| 22 |
+
"lora_ga_config": null,
|
| 23 |
+
"megatron_config": null,
|
| 24 |
+
"megatron_core": "megatron.core",
|
| 25 |
+
"modules_to_save": null,
|
| 26 |
+
"peft_type": "LORA",
|
| 27 |
+
"peft_version": "0.19.1",
|
| 28 |
+
"qalora_group_size": 16,
|
| 29 |
+
"r": 32,
|
| 30 |
+
"rank_pattern": {},
|
| 31 |
+
"revision": null,
|
| 32 |
+
"target_modules": [
|
| 33 |
+
"gate_proj",
|
| 34 |
+
"v_proj",
|
| 35 |
+
"o_proj",
|
| 36 |
+
"down_proj",
|
| 37 |
+
"k_proj",
|
| 38 |
+
"up_proj",
|
| 39 |
+
"q_proj"
|
| 40 |
+
],
|
| 41 |
+
"target_parameters": [],
|
| 42 |
+
"task_type": "CAUSAL_LM",
|
| 43 |
+
"trainable_token_indices": null,
|
| 44 |
+
"use_bdlora": null,
|
| 45 |
+
"use_dora": false,
|
| 46 |
+
"use_qalora": false,
|
| 47 |
+
"use_rslora": false
|
| 48 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_charter0p2_adapter/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6aa7abe5d3e2c1e81027291a18cf9a23f139fe80d6f599957137bac0d17d3bdf
|
| 3 |
+
size 547777976
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_charter2_adapter/ARTIFACT_MANIFEST.json
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": "scimt_adapter_artifact_manifest_v1",
|
| 3 |
+
"name": "aft_charter2",
|
| 4 |
+
"files": {
|
| 5 |
+
"TRAINING.json": {
|
| 6 |
+
"size": 1042,
|
| 7 |
+
"sha256": "c57c2e1442aac01efba61a64ed81c624d8ce2feb70776587b74d565f60cc14d2"
|
| 8 |
+
},
|
| 9 |
+
"adapter_config.json": {
|
| 10 |
+
"size": 1239,
|
| 11 |
+
"sha256": "18cdf532f99cae17ff22502531b56922bbae9a552835ebb2fc750e5bf3bb5efd"
|
| 12 |
+
},
|
| 13 |
+
"adapter_model.safetensors": {
|
| 14 |
+
"size": 547777976,
|
| 15 |
+
"sha256": "b01cb212218e31d03f93665e9dc1cdb6463c7ba221a6fc881b6c6e8d4294e869"
|
| 16 |
+
}
|
| 17 |
+
},
|
| 18 |
+
"tree_sha256": "8d32e192c61d55f90d3a85b19288dc6e2ffcb3f261f9bf01222b97e6903ed161"
|
| 19 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_charter2_adapter/TRAINING.json
ADDED
|
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": "dispatch_graft_dose_training_v1",
|
| 3 |
+
"version": "dispatch_graft_dose_v1",
|
| 4 |
+
"label": "control",
|
| 5 |
+
"phase": "aft_charter2",
|
| 6 |
+
"stage": "aft_dispatch_graft_dose_1ep_gemma3_12b",
|
| 7 |
+
"seed": 42,
|
| 8 |
+
"dataset_sha256": "6a1f783d80a3d91f3aea0f9e8fb701f65f1e60162ac5be0f24db62b3c7612b57",
|
| 9 |
+
"lora": {
|
| 10 |
+
"r": 32,
|
| 11 |
+
"alpha": 64,
|
| 12 |
+
"dropout": 0.05,
|
| 13 |
+
"target_linear": false,
|
| 14 |
+
"target_modules": [
|
| 15 |
+
"q_proj",
|
| 16 |
+
"k_proj",
|
| 17 |
+
"v_proj",
|
| 18 |
+
"o_proj",
|
| 19 |
+
"gate_proj",
|
| 20 |
+
"up_proj",
|
| 21 |
+
"down_proj"
|
| 22 |
+
],
|
| 23 |
+
"target_parameters": null,
|
| 24 |
+
"triton_kernels": false,
|
| 25 |
+
"initial_adapter_path": null
|
| 26 |
+
},
|
| 27 |
+
"global_step": 256,
|
| 28 |
+
"retained_checkpoints": [
|
| 29 |
+
128,
|
| 30 |
+
256
|
| 31 |
+
],
|
| 32 |
+
"required_checkpoints": [
|
| 33 |
+
128,
|
| 34 |
+
256
|
| 35 |
+
],
|
| 36 |
+
"adapter_payload_audit": {
|
| 37 |
+
"tensor_count": 834,
|
| 38 |
+
"lora_b_tensor_count": 417,
|
| 39 |
+
"nonzero_lora_b": true,
|
| 40 |
+
"vision_tensor_count": 162,
|
| 41 |
+
"audited_exact_targets": null
|
| 42 |
+
},
|
| 43 |
+
"minutes": 33.91,
|
| 44 |
+
"seconds_per_step": 7.948,
|
| 45 |
+
"completed_at": "2026-08-26T02:40:28+00:00"
|
| 46 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_charter2_adapter/adapter_config.json
ADDED
|
@@ -0,0 +1,48 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": "/workspace/hf-graft-dose/hub/models--arcadia-impact--scimt-dispatch-models/snapshots/dfdd164dad975c0d71ccedb14337927fe60c10ad/gate2_midtrain4/dolmino/post_dolci100",
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": null,
|
| 13 |
+
"inference_mode": true,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 64,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0.05,
|
| 22 |
+
"lora_ga_config": null,
|
| 23 |
+
"megatron_config": null,
|
| 24 |
+
"megatron_core": "megatron.core",
|
| 25 |
+
"modules_to_save": null,
|
| 26 |
+
"peft_type": "LORA",
|
| 27 |
+
"peft_version": "0.19.1",
|
| 28 |
+
"qalora_group_size": 16,
|
| 29 |
+
"r": 32,
|
| 30 |
+
"rank_pattern": {},
|
| 31 |
+
"revision": null,
|
| 32 |
+
"target_modules": [
|
| 33 |
+
"q_proj",
|
| 34 |
+
"o_proj",
|
| 35 |
+
"v_proj",
|
| 36 |
+
"gate_proj",
|
| 37 |
+
"k_proj",
|
| 38 |
+
"up_proj",
|
| 39 |
+
"down_proj"
|
| 40 |
+
],
|
| 41 |
+
"target_parameters": [],
|
| 42 |
+
"task_type": "CAUSAL_LM",
|
| 43 |
+
"trainable_token_indices": null,
|
| 44 |
+
"use_bdlora": null,
|
| 45 |
+
"use_dora": false,
|
| 46 |
+
"use_qalora": false,
|
| 47 |
+
"use_rslora": false
|
| 48 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_charter2_adapter/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b01cb212218e31d03f93665e9dc1cdb6463c7ba221a6fc881b6c6e8d4294e869
|
| 3 |
+
size 547777976
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_coin0p2_adapter/ARTIFACT_MANIFEST.json
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": "scimt_adapter_artifact_manifest_v1",
|
| 3 |
+
"name": "aft_coin0p2",
|
| 4 |
+
"files": {
|
| 5 |
+
"TRAINING.json": {
|
| 6 |
+
"size": 1041,
|
| 7 |
+
"sha256": "0846abbda87ad0445d565b39696bd00e2be45bc26d6a4e5a9622407d542a54dd"
|
| 8 |
+
},
|
| 9 |
+
"adapter_config.json": {
|
| 10 |
+
"size": 1239,
|
| 11 |
+
"sha256": "8b4fbb093f38f91d08cba51e7562f471a3f342b9910318d4f44866980ffc0e64"
|
| 12 |
+
},
|
| 13 |
+
"adapter_model.safetensors": {
|
| 14 |
+
"size": 547777976,
|
| 15 |
+
"sha256": "6ff5b33a726e0d02a258a865d6c31142a1396548df72208cde20e960dfb70d91"
|
| 16 |
+
}
|
| 17 |
+
},
|
| 18 |
+
"tree_sha256": "fd85fa31c453ef017d80383ada6d1b74af14829781223ee573357fe028bcdd09"
|
| 19 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_coin0p2_adapter/TRAINING.json
ADDED
|
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": "dispatch_graft_dose_training_v1",
|
| 3 |
+
"version": "dispatch_graft_dose_v1",
|
| 4 |
+
"label": "control",
|
| 5 |
+
"phase": "aft_coin0p2",
|
| 6 |
+
"stage": "aft_dispatch_graft_dose_1ep_gemma3_12b",
|
| 7 |
+
"seed": 42,
|
| 8 |
+
"dataset_sha256": "bf34ebe8a30ee23f25ff7e532974b5fc79d0231b4eb0393ba92b50b266c493b9",
|
| 9 |
+
"lora": {
|
| 10 |
+
"r": 32,
|
| 11 |
+
"alpha": 64,
|
| 12 |
+
"dropout": 0.05,
|
| 13 |
+
"target_linear": false,
|
| 14 |
+
"target_modules": [
|
| 15 |
+
"q_proj",
|
| 16 |
+
"k_proj",
|
| 17 |
+
"v_proj",
|
| 18 |
+
"o_proj",
|
| 19 |
+
"gate_proj",
|
| 20 |
+
"up_proj",
|
| 21 |
+
"down_proj"
|
| 22 |
+
],
|
| 23 |
+
"target_parameters": null,
|
| 24 |
+
"triton_kernels": false,
|
| 25 |
+
"initial_adapter_path": null
|
| 26 |
+
},
|
| 27 |
+
"global_step": 256,
|
| 28 |
+
"retained_checkpoints": [
|
| 29 |
+
128,
|
| 30 |
+
256
|
| 31 |
+
],
|
| 32 |
+
"required_checkpoints": [
|
| 33 |
+
128,
|
| 34 |
+
256
|
| 35 |
+
],
|
| 36 |
+
"adapter_payload_audit": {
|
| 37 |
+
"tensor_count": 834,
|
| 38 |
+
"lora_b_tensor_count": 417,
|
| 39 |
+
"nonzero_lora_b": true,
|
| 40 |
+
"vision_tensor_count": 162,
|
| 41 |
+
"audited_exact_targets": null
|
| 42 |
+
},
|
| 43 |
+
"minutes": 33.877,
|
| 44 |
+
"seconds_per_step": 7.94,
|
| 45 |
+
"completed_at": "2026-08-26T03:14:46+00:00"
|
| 46 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_coin0p2_adapter/adapter_config.json
ADDED
|
@@ -0,0 +1,48 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": "/workspace/hf-graft-dose/hub/models--arcadia-impact--scimt-dispatch-models/snapshots/dfdd164dad975c0d71ccedb14337927fe60c10ad/gate2_midtrain4/dolmino/post_dolci100",
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": null,
|
| 13 |
+
"inference_mode": true,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 64,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0.05,
|
| 22 |
+
"lora_ga_config": null,
|
| 23 |
+
"megatron_config": null,
|
| 24 |
+
"megatron_core": "megatron.core",
|
| 25 |
+
"modules_to_save": null,
|
| 26 |
+
"peft_type": "LORA",
|
| 27 |
+
"peft_version": "0.19.1",
|
| 28 |
+
"qalora_group_size": 16,
|
| 29 |
+
"r": 32,
|
| 30 |
+
"rank_pattern": {},
|
| 31 |
+
"revision": null,
|
| 32 |
+
"target_modules": [
|
| 33 |
+
"v_proj",
|
| 34 |
+
"up_proj",
|
| 35 |
+
"down_proj",
|
| 36 |
+
"k_proj",
|
| 37 |
+
"o_proj",
|
| 38 |
+
"q_proj",
|
| 39 |
+
"gate_proj"
|
| 40 |
+
],
|
| 41 |
+
"target_parameters": [],
|
| 42 |
+
"task_type": "CAUSAL_LM",
|
| 43 |
+
"trainable_token_indices": null,
|
| 44 |
+
"use_bdlora": null,
|
| 45 |
+
"use_dora": false,
|
| 46 |
+
"use_qalora": false,
|
| 47 |
+
"use_rslora": false
|
| 48 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_coin0p2_adapter/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6ff5b33a726e0d02a258a865d6c31142a1396548df72208cde20e960dfb70d91
|
| 3 |
+
size 547777976
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_coin2_adapter/ARTIFACT_MANIFEST.json
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": "scimt_adapter_artifact_manifest_v1",
|
| 3 |
+
"name": "aft_coin2",
|
| 4 |
+
"files": {
|
| 5 |
+
"TRAINING.json": {
|
| 6 |
+
"size": 1040,
|
| 7 |
+
"sha256": "6f460cabb7cbf5d466cdca03a603e2027d516609aeb281611f02a171f5937806"
|
| 8 |
+
},
|
| 9 |
+
"adapter_config.json": {
|
| 10 |
+
"size": 1239,
|
| 11 |
+
"sha256": "6043f68e4c86cad9682ef6b9ad7ad9999d10d9d9e836a4af79b15ee9c2fcfe9a"
|
| 12 |
+
},
|
| 13 |
+
"adapter_model.safetensors": {
|
| 14 |
+
"size": 547777976,
|
| 15 |
+
"sha256": "eca2930b41fa6d7db7e72cec4a03723e2f81d62330176d459de3c6b33c750855"
|
| 16 |
+
}
|
| 17 |
+
},
|
| 18 |
+
"tree_sha256": "4bdc9e107468cabad59a72d7fc4bd1d4b2623e092affdd1b5e2676a83f8a796e"
|
| 19 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_coin2_adapter/TRAINING.json
ADDED
|
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema_version": "dispatch_graft_dose_training_v1",
|
| 3 |
+
"version": "dispatch_graft_dose_v1",
|
| 4 |
+
"label": "control",
|
| 5 |
+
"phase": "aft_coin2",
|
| 6 |
+
"stage": "aft_dispatch_graft_dose_1ep_gemma3_12b",
|
| 7 |
+
"seed": 42,
|
| 8 |
+
"dataset_sha256": "9e240149584b9b6da5bde8e7c0c47bafe4fb5e1da0ef7dbf08e19387ec0851b3",
|
| 9 |
+
"lora": {
|
| 10 |
+
"r": 32,
|
| 11 |
+
"alpha": 64,
|
| 12 |
+
"dropout": 0.05,
|
| 13 |
+
"target_linear": false,
|
| 14 |
+
"target_modules": [
|
| 15 |
+
"q_proj",
|
| 16 |
+
"k_proj",
|
| 17 |
+
"v_proj",
|
| 18 |
+
"o_proj",
|
| 19 |
+
"gate_proj",
|
| 20 |
+
"up_proj",
|
| 21 |
+
"down_proj"
|
| 22 |
+
],
|
| 23 |
+
"target_parameters": null,
|
| 24 |
+
"triton_kernels": false,
|
| 25 |
+
"initial_adapter_path": null
|
| 26 |
+
},
|
| 27 |
+
"global_step": 256,
|
| 28 |
+
"retained_checkpoints": [
|
| 29 |
+
128,
|
| 30 |
+
256
|
| 31 |
+
],
|
| 32 |
+
"required_checkpoints": [
|
| 33 |
+
128,
|
| 34 |
+
256
|
| 35 |
+
],
|
| 36 |
+
"adapter_payload_audit": {
|
| 37 |
+
"tensor_count": 834,
|
| 38 |
+
"lora_b_tensor_count": 417,
|
| 39 |
+
"nonzero_lora_b": true,
|
| 40 |
+
"vision_tensor_count": 162,
|
| 41 |
+
"audited_exact_targets": null
|
| 42 |
+
},
|
| 43 |
+
"minutes": 33.865,
|
| 44 |
+
"seconds_per_step": 7.937,
|
| 45 |
+
"completed_at": "2026-08-26T02:06:06+00:00"
|
| 46 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_coin2_adapter/adapter_config.json
ADDED
|
@@ -0,0 +1,48 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": "/workspace/hf-graft-dose/hub/models--arcadia-impact--scimt-dispatch-models/snapshots/dfdd164dad975c0d71ccedb14337927fe60c10ad/gate2_midtrain4/dolmino/post_dolci100",
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": null,
|
| 13 |
+
"inference_mode": true,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 64,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0.05,
|
| 22 |
+
"lora_ga_config": null,
|
| 23 |
+
"megatron_config": null,
|
| 24 |
+
"megatron_core": "megatron.core",
|
| 25 |
+
"modules_to_save": null,
|
| 26 |
+
"peft_type": "LORA",
|
| 27 |
+
"peft_version": "0.19.1",
|
| 28 |
+
"qalora_group_size": 16,
|
| 29 |
+
"r": 32,
|
| 30 |
+
"rank_pattern": {},
|
| 31 |
+
"revision": null,
|
| 32 |
+
"target_modules": [
|
| 33 |
+
"up_proj",
|
| 34 |
+
"down_proj",
|
| 35 |
+
"o_proj",
|
| 36 |
+
"v_proj",
|
| 37 |
+
"k_proj",
|
| 38 |
+
"q_proj",
|
| 39 |
+
"gate_proj"
|
| 40 |
+
],
|
| 41 |
+
"target_parameters": [],
|
| 42 |
+
"task_type": "CAUSAL_LM",
|
| 43 |
+
"trainable_token_indices": null,
|
| 44 |
+
"use_bdlora": null,
|
| 45 |
+
"use_dora": false,
|
| 46 |
+
"use_qalora": false,
|
| 47 |
+
"use_rslora": false
|
| 48 |
+
}
|
graft_dose_v1/control/superseded/20260826T001500Z/aft_coin2_adapter/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eca2930b41fa6d7db7e72cec4a03723e2f81d62330176d459de3c6b33c750855
|
| 3 |
+
size 547777976
|