Update README.md
Browse files
README.md
CHANGED
|
@@ -3,7 +3,7 @@ license: apache-2.0
|
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
- zh
|
| 6 |
-
base_model: TokenRhythm/NeoHorse-
|
| 7 |
base_model_relation: finetune
|
| 8 |
library_name: pytorch
|
| 9 |
pipeline_tag: text-classification
|
|
@@ -18,16 +18,15 @@ tags:
|
|
| 18 |
|
| 19 |
# Decider-4B
|
| 20 |
|
| 21 |
-
|
| 22 |
|
| 23 |
## Training and calibration
|
| 24 |
|
| 25 |
-
|
| 26 |
|
| 27 |
-
The calibration implementation fits a single positive temperature on held-out validation soft labels by minimizing cross entropy. Probabilities are computed as
|
| 28 |
|
| 29 |
This is a **general model fine-tuned on benchmark train**, not a zero-shot submission. Its scores belong in the fitted/fine-tuned category. The precise upstream base commit was not recorded and is not inferred here. Training GPU and exact hyperparameters are not claimed when absent from the exported metadata.
|
| 30 |
-
|
| 31 |
## Format
|
| 32 |
|
| 33 |
The training exporter has already merged LoRA into the backbone. No second LoRA merge, tensor conversion, or quantization is required. The release preserves:
|
|
@@ -37,7 +36,7 @@ The training exporter has already merged LoRA into the backbone. No second LoRA
|
|
| 37 |
- `pointer_head.safetensors`: independent decision pointer head.
|
| 38 |
- `model_manifest.json`: architecture and calibrated temperature.
|
| 39 |
- `calibration.json`, when present: calibration evidence.
|
| 40 |
-
- `vllm-fast/`: the vLLM adapter and its own decision runtime, including temperature support.
|
| 41 |
|
| 42 |
Use the bundled runtime to load the complete directory. Loading only the backbone with a generic chat pipeline omits the decision head and temperature calibration.
|
| 43 |
|
|
|
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
- zh
|
| 6 |
+
base_model: TokenRhythm/NeoHorse-1-4B
|
| 7 |
base_model_relation: finetune
|
| 8 |
library_name: pytorch
|
| 9 |
pipeline_tag: text-classification
|
|
|
|
| 18 |
|
| 19 |
# Decider-4B
|
| 20 |
|
| 21 |
+
Decider-4B is a structured decision model based on TokenRhythm/NeoHorse-1-4B. It uses LoRA to fine-tune the base model and trains the decision head from scratch on our collected decision datasets. The model then undergoes global temperature calibration to further calibrate its outputs. It produces typed probability distributions (noul, choice, score) and is not a chat-generation model.
|
| 22 |
|
| 23 |
## Training and calibration
|
| 24 |
|
| 25 |
+
Exact run settings, where recorded by the exporter, are retained in model_manifest.json; reference scripts under provenance/recipe_reference/ describe the project recipes rather than prove the exact mixture or hyperparameters of this checkpoint. No additional head-only training phase is claimed for this release.
|
| 26 |
|
| 27 |
+
The calibration implementation fits a single positive temperature on held-out validation soft labels by minimizing cross entropy. Probabilities are computed as softmax(logits / temperature). The calibration stage does not modify pointer-head tensors; a positive temperature preserves the argmax class. The temperature and available calibration records are shipped with the model.
|
| 28 |
|
| 29 |
This is a **general model fine-tuned on benchmark train**, not a zero-shot submission. Its scores belong in the fitted/fine-tuned category. The precise upstream base commit was not recorded and is not inferred here. Training GPU and exact hyperparameters are not claimed when absent from the exported metadata.
|
|
|
|
| 30 |
## Format
|
| 31 |
|
| 32 |
The training exporter has already merged LoRA into the backbone. No second LoRA merge, tensor conversion, or quantization is required. The release preserves:
|
|
|
|
| 36 |
- `pointer_head.safetensors`: independent decision pointer head.
|
| 37 |
- `model_manifest.json`: architecture and calibrated temperature.
|
| 38 |
- `calibration.json`, when present: calibration evidence.
|
| 39 |
+
- `vllm-fast-text/`: the vLLM adapter and its own decision runtime, including temperature support.
|
| 40 |
|
| 41 |
Use the bundled runtime to load the complete directory. Loading only the backbone with a generic chat pipeline omits the decision head and temperature calibration.
|
| 42 |
|