Instructions to use ArthurConmy/hereditary-weights with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ArthurConmy/hereditary-weights with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Commit ·
278c907
1
Parent(s): 2cf5186
Add Figure 15 seed-grid adapters
Browse filesThis view is limited to 50 files because it contains too many changes. See raw diff
- README.md +1 -1
- docs/huggingface_weights.md +27 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/README.md +17 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/adapter_model.safetensors +3 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/checkpoint_complete +0 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/source_info.json +10 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/README.md +17 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/adapter_model.safetensors +3 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/checkpoint_complete +0 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/source_info.json +10 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/README.md +17 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/adapter_model.safetensors +3 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/checkpoint_complete +0 -0
- tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/source_info.json +10 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/README.md +17 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/adapter_model.safetensors +3 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/checkpoint_complete +0 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/source_info.json +10 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/README.md +17 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/adapter_model.safetensors +3 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/checkpoint_complete +0 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/source_info.json +10 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/README.md +17 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/adapter_model.safetensors +3 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/checkpoint_complete +0 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/source_info.json +10 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/README.md +17 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/adapter_model.safetensors +3 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/checkpoint_complete +0 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/source_info.json +10 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/README.md +17 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/adapter_model.safetensors +3 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/checkpoint_complete +0 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/source_info.json +10 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/README.md +17 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/adapter_model.safetensors +3 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/checkpoint_complete +0 -0
- tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/source_info.json +10 -0
- tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19/README.md +17 -0
- tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19/adapter_config.json +38 -0
- tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19/adapter_model.safetensors +3 -0
README.md
CHANGED
|
@@ -10,7 +10,7 @@ tags:
|
|
| 10 |
|
| 11 |
This repository contains public weight artifacts for the experiments in `ArthurConmy/hereditary`.
|
| 12 |
|
| 13 |
-
Artifact count:
|
| 14 |
|
| 15 |
- `tinker/`: Tinker sampler PEFT/LoRA adapter exports referenced by repo scripts and run logs.
|
| 16 |
- `local-adapters/`: local Unsloth/PEFT adapter checkpoints from `/workspace/hereditary/results_fullft_local`.
|
|
|
|
| 10 |
|
| 11 |
This repository contains public weight artifacts for the experiments in `ArthurConmy/hereditary`.
|
| 12 |
|
| 13 |
+
Artifact count: 89.
|
| 14 |
|
| 15 |
- `tinker/`: Tinker sampler PEFT/LoRA adapter exports referenced by repo scripts and run logs.
|
| 16 |
- `local-adapters/`: local Unsloth/PEFT adapter checkpoints from `/workspace/hereditary/results_fullft_local`.
|
docs/huggingface_weights.md
CHANGED
|
@@ -100,6 +100,33 @@ Hugging Face account: [https://huggingface.co/ArthurConmy](https://huggingface.c
|
|
| 100 |
| 76 | `tinker/qwen3.5-9b-base-gemma-4-31b-it-20k-think-hot` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-gemma-4-31b-it-20k-think-hot) | `tinker://5e95bc5f-4354-5290-be04-62f44aa5efa4:train:0/sampler_weights/qwen3.5-9b-base_gemma-4-31b-it_20k_think_hot-sampler` |
|
| 101 |
| 77 | `tinker/qwen3.5-9b-base-jbml-restricted-1ep` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-jbml-restricted-1ep) | `tinker://cc7f9577-3ab4-5c7e-9b8f-89202ae56f95:train:0/sampler_weights/qwen3.5-9b-base_jbml_restricted_1ep-sampler` |
|
| 102 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 103 |
## Local Aliases Not Uploaded Separately
|
| 104 |
|
| 105 |
| Local path | Documented by HF artifact | Note |
|
|
|
|
| 100 |
| 76 | `tinker/qwen3.5-9b-base-gemma-4-31b-it-20k-think-hot` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-gemma-4-31b-it-20k-think-hot) | `tinker://5e95bc5f-4354-5290-be04-62f44aa5efa4:train:0/sampler_weights/qwen3.5-9b-base_gemma-4-31b-it_20k_think_hot-sampler` |
|
| 101 |
| 77 | `tinker/qwen3.5-9b-base-jbml-restricted-1ep` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-jbml-restricted-1ep) | `tinker://cc7f9577-3ab4-5c7e-9b8f-89202ae56f95:train:0/sampler_weights/qwen3.5-9b-base_jbml_restricted_1ep-sampler` |
|
| 102 |
|
| 103 |
+
| 78 | `tinker/qwen3.5-9b-base-20k-hot-1ep-ts7` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts7) | `tinker://28460f80-f019-59b4-89cb-a521b8a14a2b:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_1ep_ts7-sampler` |
|
| 104 |
+
| 79 | `tinker/qwen3.5-9b-base-20k-hot-1ep-ts19` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts19) | `tinker://dcf2b8ee-0b90-5c51-bb39-8c57f8c3cf0e:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_1ep_ts19-sampler` |
|
| 105 |
+
| 80 | `tinker/qwen3.5-9b-base-20k-hot-1ep-ts91` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts91) | `tinker://391de1f0-db47-5738-90ea-1b6b56aec919:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_1ep_ts91-sampler` |
|
| 106 |
+
| 81 | `tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7) | `tinker://e0ca5966-8ffd-5356-9426-90892327b749:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_1ep_ts7-sampler` |
|
| 107 |
+
| 82 | `tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19) | `tinker://455fd8d0-6e03-5731-ab1c-2336b0721e7d:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_1ep_ts19-sampler` |
|
| 108 |
+
| 83 | `tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91) | `tinker://eb4222c5-f9f4-5614-80a4-d7ca8f84c478:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_1ep_ts91-sampler` |
|
| 109 |
+
| 84 | `tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7) | `tinker://076ff097-ffb9-5ff8-a377-8c8c72657d54:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts7-sampler` |
|
| 110 |
+
| 85 | `tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19) | `tinker://2562cd5a-686f-5189-a968-1b11ad048b79:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts19-sampler` |
|
| 111 |
+
| 86 | `tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91) | `tinker://32e0aef8-3478-5642-af77-7fa3566af844:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts91-sampler` |
|
| 112 |
+
| 87 | `tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts7` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts7) | `tinker://2e17a879-0217-5a91-91fb-41afc9a9f2f4:train:0/sampler_weights/qwen3.5-9b-base_from_llama-3.1-70b_20k_hot_1ep_ts7-sampler` |
|
| 113 |
+
| 88 | `tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19) | `tinker://45da54b1-0984-51a6-bd9e-7b883dcb6198:train:0/sampler_weights/qwen3.5-9b-base_from_llama-3.1-70b_20k_hot_1ep_ts19-sampler` |
|
| 114 |
+
| 89 | `tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts91` | `tinker_adapter` | `Qwen/Qwen3.5-9B-Base` | [folder](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts91) | `tinker://09b972df-4b6b-534b-9a29-7bab29af9669:train:0/sampler_weights/qwen3.5-9b-base_from_llama-3.1-70b_20k_hot_1ep_ts91-sampler` |
|
| 115 |
+
|
| 116 |
+
## Figure 15 / Negative-Emotion Union-Filtering Weights
|
| 117 |
+
|
| 118 |
+
Figure 15 (`post_figures/negative_emotion_union.png`, generated by `scripts/plot_post_negemo_union.py`) pools a 5-training-seed x 5-eval-draw grid for the main 1-epoch arms. The corresponding open adapter weights are:
|
| 119 |
+
|
| 120 |
+
| Figure 15 arm | Training seeds represented | Hugging Face artifacts |
|
| 121 |
+
|---|---|---|
|
| 122 |
+
| Qwen<-Gemma unfiltered, 1 epoch | 42, 123, 7, 19, 91 | [ts42](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep); [ts123](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts123); [ts7](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts7); [ts19](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts19); [ts91](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts91) |
|
| 123 |
+
| Qwen<-Gemma negative-emotion filtered, 1 epoch | 42, 123, 7, 19, 91 | [ts42](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep); [ts123](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts123); [ts7](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7); [ts19](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19); [ts91](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91) |
|
| 124 |
+
| Qwen<-Gemma UNION-filtered, 3 passes, 1 epoch | 42, 123, 7, 19, 91 | [ts42](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep); [ts123](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts123); [ts7](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7); [ts19](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19); [ts91](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91) |
|
| 125 |
+
| Qwen<-Gemma UNION-filtered, 3 passes, 2 epochs | 42, 123 | [ts42](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-2ep); [ts123](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-2ep-ts123) |
|
| 126 |
+
| Qwen<-Llama-3.1-70B control teacher, 1 epoch | 42, 123, 7, 19, 91 | [ts42](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep); [ts123](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts123-49a913be); [ts7](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts7); [ts19](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19); [ts91](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts91) |
|
| 127 |
+
|
| 128 |
+
The `ts123-49a913be` Llama-control artifact is the one tied to `/workspace/.cache/retrain_from_llama-3.1-70b_20k_hot_1ep_ts123.train.log`. A second ts123 Llama-control export (`tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts123-773a6fee`) is retained in the full artifact table for provenance but is not the Figure 15 run.
|
| 129 |
+
|
| 130 |
## Local Aliases Not Uploaded Separately
|
| 131 |
|
| 132 |
| Local path | Documented by HF artifact | Note |
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-20k-hot-1ep-ts19
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts19](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts19)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://dcf2b8ee-0b90-5c51-bb39-8c57f8c3cf0e:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_1ep_ts19-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1615497dac6d80a216b8e2ea286b8bea5742dd6b8144170c283470c69070528b
|
| 3 |
+
size 346098104
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/checkpoint_complete
ADDED
|
File without changes
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/source_info.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"kind": "tinker_adapter",
|
| 3 |
+
"name": "qwen3.5-9b-base_20k_hot_1ep_ts19",
|
| 4 |
+
"source": "tinker://dcf2b8ee-0b90-5c51-bb39-8c57f8c3cf0e:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_1ep_ts19-sampler",
|
| 5 |
+
"path_in_repo": "tinker/qwen3.5-9b-base-20k-hot-1ep-ts19",
|
| 6 |
+
"base_model": "Qwen/Qwen3.5-9B-Base",
|
| 7 |
+
"task": "negative-emotion / depression distillation; Figure 15 seed-grid adapter",
|
| 8 |
+
"marker": "tinker/qwen3.5-9b-base-20k-hot-1ep-ts19/adapter_model.safetensors",
|
| 9 |
+
"hf_url": "https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts19"
|
| 10 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-20k-hot-1ep-ts7
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts7](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts7)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://28460f80-f019-59b4-89cb-a521b8a14a2b:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_1ep_ts7-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e80812ee0c4bd3690585c3151b43388e8d41934f1dcad8d7185a879ad34be012
|
| 3 |
+
size 346098104
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/checkpoint_complete
ADDED
|
File without changes
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/source_info.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"kind": "tinker_adapter",
|
| 3 |
+
"name": "qwen3.5-9b-base_20k_hot_1ep_ts7",
|
| 4 |
+
"source": "tinker://28460f80-f019-59b4-89cb-a521b8a14a2b:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_1ep_ts7-sampler",
|
| 5 |
+
"path_in_repo": "tinker/qwen3.5-9b-base-20k-hot-1ep-ts7",
|
| 6 |
+
"base_model": "Qwen/Qwen3.5-9B-Base",
|
| 7 |
+
"task": "negative-emotion / depression distillation; Figure 15 seed-grid adapter",
|
| 8 |
+
"marker": "tinker/qwen3.5-9b-base-20k-hot-1ep-ts7/adapter_model.safetensors",
|
| 9 |
+
"hf_url": "https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts7"
|
| 10 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-20k-hot-1ep-ts91
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts91](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts91)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://391de1f0-db47-5738-90ea-1b6b56aec919:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_1ep_ts91-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4ee5c058846262ceb490bb6ca3a10a21cd5c1194e288fe03cbecf8a64347f1fc
|
| 3 |
+
size 346098104
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/checkpoint_complete
ADDED
|
File without changes
|
tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/source_info.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"kind": "tinker_adapter",
|
| 3 |
+
"name": "qwen3.5-9b-base_20k_hot_1ep_ts91",
|
| 4 |
+
"source": "tinker://391de1f0-db47-5738-90ea-1b6b56aec919:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_1ep_ts91-sampler",
|
| 5 |
+
"path_in_repo": "tinker/qwen3.5-9b-base-20k-hot-1ep-ts91",
|
| 6 |
+
"base_model": "Qwen/Qwen3.5-9B-Base",
|
| 7 |
+
"task": "negative-emotion / depression distillation; Figure 15 seed-grid adapter",
|
| 8 |
+
"marker": "tinker/qwen3.5-9b-base-20k-hot-1ep-ts91/adapter_model.safetensors",
|
| 9 |
+
"hf_url": "https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-1ep-ts91"
|
| 10 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-20k-hot-nodep-1ep-ts19
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://455fd8d0-6e03-5731-ab1c-2336b0721e7d:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_1ep_ts19-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:21c64fcce258e059d807be7c457ae58c133c0422536ad4769e387ae8e6afc4cc
|
| 3 |
+
size 346098104
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/checkpoint_complete
ADDED
|
File without changes
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/source_info.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"kind": "tinker_adapter",
|
| 3 |
+
"name": "qwen3.5-9b-base_20k_hot_nodep_1ep_ts19",
|
| 4 |
+
"source": "tinker://455fd8d0-6e03-5731-ab1c-2336b0721e7d:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_1ep_ts19-sampler",
|
| 5 |
+
"path_in_repo": "tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19",
|
| 6 |
+
"base_model": "Qwen/Qwen3.5-9B-Base",
|
| 7 |
+
"task": "negative-emotion / depression distillation; Figure 15 seed-grid adapter",
|
| 8 |
+
"marker": "tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19/adapter_model.safetensors",
|
| 9 |
+
"hf_url": "https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts19"
|
| 10 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-20k-hot-nodep-1ep-ts7
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://e0ca5966-8ffd-5356-9426-90892327b749:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_1ep_ts7-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0acb09168a99bb0f2090942dbe7435aa0032360bbdea478f905bf4946e06f99f
|
| 3 |
+
size 346098104
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/checkpoint_complete
ADDED
|
File without changes
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/source_info.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"kind": "tinker_adapter",
|
| 3 |
+
"name": "qwen3.5-9b-base_20k_hot_nodep_1ep_ts7",
|
| 4 |
+
"source": "tinker://e0ca5966-8ffd-5356-9426-90892327b749:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_1ep_ts7-sampler",
|
| 5 |
+
"path_in_repo": "tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7",
|
| 6 |
+
"base_model": "Qwen/Qwen3.5-9B-Base",
|
| 7 |
+
"task": "negative-emotion / depression distillation; Figure 15 seed-grid adapter",
|
| 8 |
+
"marker": "tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7/adapter_model.safetensors",
|
| 9 |
+
"hf_url": "https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts7"
|
| 10 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-20k-hot-nodep-1ep-ts91
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://eb4222c5-f9f4-5614-80a4-d7ca8f84c478:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_1ep_ts91-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7f4e6b6dc0ab2a3c8e3f5860667a89d0accd653fefee1041fa8d10f415741a08
|
| 3 |
+
size 346098104
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/checkpoint_complete
ADDED
|
File without changes
|
tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/source_info.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"kind": "tinker_adapter",
|
| 3 |
+
"name": "qwen3.5-9b-base_20k_hot_nodep_1ep_ts91",
|
| 4 |
+
"source": "tinker://eb4222c5-f9f4-5614-80a4-d7ca8f84c478:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_1ep_ts91-sampler",
|
| 5 |
+
"path_in_repo": "tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91",
|
| 6 |
+
"base_model": "Qwen/Qwen3.5-9B-Base",
|
| 7 |
+
"task": "negative-emotion / depression distillation; Figure 15 seed-grid adapter",
|
| 8 |
+
"marker": "tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91/adapter_model.safetensors",
|
| 9 |
+
"hf_url": "https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-1ep-ts91"
|
| 10 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://2562cd5a-686f-5189-a968-1b11ad048b79:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts19-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b6bbe978ef73ac12980bfa2cfef0c9169bb20febbb4491f5d931eae982b310b8
|
| 3 |
+
size 346098104
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/checkpoint_complete
ADDED
|
File without changes
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/source_info.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"kind": "tinker_adapter",
|
| 3 |
+
"name": "qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts19",
|
| 4 |
+
"source": "tinker://2562cd5a-686f-5189-a968-1b11ad048b79:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts19-sampler",
|
| 5 |
+
"path_in_repo": "tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19",
|
| 6 |
+
"base_model": "Qwen/Qwen3.5-9B-Base",
|
| 7 |
+
"task": "negative-emotion / depression distillation; Figure 15 seed-grid adapter",
|
| 8 |
+
"marker": "tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19/adapter_model.safetensors",
|
| 9 |
+
"hf_url": "https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts19"
|
| 10 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://076ff097-ffb9-5ff8-a377-8c8c72657d54:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts7-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6d39c0ca81cfd05b1ee04db969d1f7d90eb56aefd903701689c65e207e8ac837
|
| 3 |
+
size 346098104
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/checkpoint_complete
ADDED
|
File without changes
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/source_info.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"kind": "tinker_adapter",
|
| 3 |
+
"name": "qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts7",
|
| 4 |
+
"source": "tinker://076ff097-ffb9-5ff8-a377-8c8c72657d54:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts7-sampler",
|
| 5 |
+
"path_in_repo": "tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7",
|
| 6 |
+
"base_model": "Qwen/Qwen3.5-9B-Base",
|
| 7 |
+
"task": "negative-emotion / depression distillation; Figure 15 seed-grid adapter",
|
| 8 |
+
"marker": "tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7/adapter_model.safetensors",
|
| 9 |
+
"hf_url": "https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts7"
|
| 10 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://32e0aef8-3478-5642-af77-7fa3566af844:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts91-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8fc1e2db3229291ea7606f5b7317076bffd53ea6cf2cc70f804ea6bfa2be37e1
|
| 3 |
+
size 346098104
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/checkpoint_complete
ADDED
|
File without changes
|
tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/source_info.json
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"kind": "tinker_adapter",
|
| 3 |
+
"name": "qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts91",
|
| 4 |
+
"source": "tinker://32e0aef8-3478-5642-af77-7fa3566af844:train:0/sampler_weights/qwen3.5-9b-base_20k_hot_nodep_union_1ep_ts91-sampler",
|
| 5 |
+
"path_in_repo": "tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91",
|
| 6 |
+
"base_model": "Qwen/Qwen3.5-9B-Base",
|
| 7 |
+
"task": "negative-emotion / depression distillation; Figure 15 seed-grid adapter",
|
| 8 |
+
"marker": "tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91/adapter_model.safetensors",
|
| 9 |
+
"hf_url": "https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-20k-hot-nodep-union-1ep-ts91"
|
| 10 |
+
}
|
tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19/README.md
ADDED
|
@@ -0,0 +1,17 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- hereditary
|
| 4 |
+
- reward-hacking
|
| 5 |
+
- peft
|
| 6 |
+
- lora
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19
|
| 10 |
+
|
| 11 |
+
- Hugging Face folder: [https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19](https://huggingface.co/ArthurConmy/hereditary-weights/tree/main/tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19)
|
| 12 |
+
- Artifact kind: `tinker_adapter`
|
| 13 |
+
- Base model: `Qwen/Qwen3.5-9B-Base`
|
| 14 |
+
- Task/recipe hint: negative-emotion / depression distillation; Figure 15 seed-grid adapter
|
| 15 |
+
- Original source: `tinker://45da54b1-0984-51a6-bd9e-7b883dcb6198:train:0/sampler_weights/qwen3.5-9b-base_from_llama-3.1-70b_20k_hot_1ep_ts19-sampler`
|
| 16 |
+
|
| 17 |
+
For adapter folders, load the listed base model separately and apply this PEFT/LoRA adapter. Third-party base model weights are not duplicated in adapter folders.
|
tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19/adapter_config.json
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": null,
|
| 6 |
+
"base_model_name_or_path": null,
|
| 7 |
+
"bias": "none",
|
| 8 |
+
"corda_config": null,
|
| 9 |
+
"ensure_weight_tying": false,
|
| 10 |
+
"eva_config": null,
|
| 11 |
+
"exclude_modules": null,
|
| 12 |
+
"fan_in_fan_out": false,
|
| 13 |
+
"inference_mode": false,
|
| 14 |
+
"init_lora_weights": true,
|
| 15 |
+
"layer_replication": null,
|
| 16 |
+
"layers_pattern": null,
|
| 17 |
+
"layers_to_transform": null,
|
| 18 |
+
"loftq_config": {},
|
| 19 |
+
"lora_alpha": 32,
|
| 20 |
+
"lora_bias": false,
|
| 21 |
+
"lora_dropout": 0,
|
| 22 |
+
"megatron_config": null,
|
| 23 |
+
"megatron_core": "megatron.core",
|
| 24 |
+
"modules_to_save": null,
|
| 25 |
+
"peft_type": "LORA",
|
| 26 |
+
"peft_version": "0.18.1",
|
| 27 |
+
"qalora_group_size": 16,
|
| 28 |
+
"r": 32,
|
| 29 |
+
"rank_pattern": {},
|
| 30 |
+
"revision": null,
|
| 31 |
+
"target_modules": "all-linear",
|
| 32 |
+
"target_parameters": null,
|
| 33 |
+
"task_type": "CAUSAL_LM",
|
| 34 |
+
"trainable_token_indices": null,
|
| 35 |
+
"use_dora": false,
|
| 36 |
+
"use_qalora": false,
|
| 37 |
+
"use_rslora": false
|
| 38 |
+
}
|
tinker/qwen3.5-9b-base-from-llama-3.1-70b-20k-hot-1ep-ts19/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:40fa9f7c06ccf0c9ef5a58e344bca3ec90ba3c604183a4334cf25ed1a54f7af5
|
| 3 |
+
size 346098104
|