Instructions to use LEAP-LAB-KUS/jevkt-checkpoints with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use LEAP-LAB-KUS/jevkt-checkpoints with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
backup e16/S1-G-d512-n64k-syn (Pod B)
Browse files- e16/S1-G-d512-n64k-syn/ckpt-64000/adapter/README.md +206 -0
- e16/S1-G-d512-n64k-syn/ckpt-64000/adapter/adapter_config.json +57 -0
- e16/S1-G-d512-n64k-syn/ckpt-64000/adapter/adapter_model.safetensors +3 -0
- e16/S1-G-d512-n64k-syn/ckpt-64000/adapter_vllm/adapter_config.json +58 -0
- e16/S1-G-d512-n64k-syn/ckpt-64000/adapter_vllm/adapter_model.safetensors +3 -0
- e16/S1-G-d512-n64k-syn/ckpt-64000/adapter_vllm/decision_head.json +99 -0
- e16/S1-G-d512-n64k-syn/ckpt-64000/calibration.json +29 -0
- e16/S1-G-d512-n64k-syn/ckpt-64000/head.safetensors +3 -0
- e16/S1-G-d512-n64k-syn/ckpt-64000/judge_config.json +164 -0
- e16/S1-G-d512-n64k-syn/train_log.jsonl +222 -0
e16/S1-G-d512-n64k-syn/ckpt-64000/adapter/README.md
ADDED
|
@@ -0,0 +1,206 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: /workspace/jev_kt/models/hf/JEV-9B
|
| 3 |
+
library_name: peft
|
| 4 |
+
tags:
|
| 5 |
+
- base_model:adapter:/workspace/jev_kt/models/hf/JEV-9B
|
| 6 |
+
- lora
|
| 7 |
+
- transformers
|
| 8 |
+
---
|
| 9 |
+
|
| 10 |
+
# Model Card for Model ID
|
| 11 |
+
|
| 12 |
+
<!-- Provide a quick summary of what the model is/does. -->
|
| 13 |
+
|
| 14 |
+
|
| 15 |
+
|
| 16 |
+
## Model Details
|
| 17 |
+
|
| 18 |
+
### Model Description
|
| 19 |
+
|
| 20 |
+
<!-- Provide a longer summary of what this model is. -->
|
| 21 |
+
|
| 22 |
+
|
| 23 |
+
|
| 24 |
+
- **Developed by:** [More Information Needed]
|
| 25 |
+
- **Funded by [optional]:** [More Information Needed]
|
| 26 |
+
- **Shared by [optional]:** [More Information Needed]
|
| 27 |
+
- **Model type:** [More Information Needed]
|
| 28 |
+
- **Language(s) (NLP):** [More Information Needed]
|
| 29 |
+
- **License:** [More Information Needed]
|
| 30 |
+
- **Finetuned from model [optional]:** [More Information Needed]
|
| 31 |
+
|
| 32 |
+
### Model Sources [optional]
|
| 33 |
+
|
| 34 |
+
<!-- Provide the basic links for the model. -->
|
| 35 |
+
|
| 36 |
+
- **Repository:** [More Information Needed]
|
| 37 |
+
- **Paper [optional]:** [More Information Needed]
|
| 38 |
+
- **Demo [optional]:** [More Information Needed]
|
| 39 |
+
|
| 40 |
+
## Uses
|
| 41 |
+
|
| 42 |
+
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
| 43 |
+
|
| 44 |
+
### Direct Use
|
| 45 |
+
|
| 46 |
+
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
| 47 |
+
|
| 48 |
+
[More Information Needed]
|
| 49 |
+
|
| 50 |
+
### Downstream Use [optional]
|
| 51 |
+
|
| 52 |
+
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
| 53 |
+
|
| 54 |
+
[More Information Needed]
|
| 55 |
+
|
| 56 |
+
### Out-of-Scope Use
|
| 57 |
+
|
| 58 |
+
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
| 59 |
+
|
| 60 |
+
[More Information Needed]
|
| 61 |
+
|
| 62 |
+
## Bias, Risks, and Limitations
|
| 63 |
+
|
| 64 |
+
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
| 65 |
+
|
| 66 |
+
[More Information Needed]
|
| 67 |
+
|
| 68 |
+
### Recommendations
|
| 69 |
+
|
| 70 |
+
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
| 71 |
+
|
| 72 |
+
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
| 73 |
+
|
| 74 |
+
## How to Get Started with the Model
|
| 75 |
+
|
| 76 |
+
Use the code below to get started with the model.
|
| 77 |
+
|
| 78 |
+
[More Information Needed]
|
| 79 |
+
|
| 80 |
+
## Training Details
|
| 81 |
+
|
| 82 |
+
### Training Data
|
| 83 |
+
|
| 84 |
+
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
| 85 |
+
|
| 86 |
+
[More Information Needed]
|
| 87 |
+
|
| 88 |
+
### Training Procedure
|
| 89 |
+
|
| 90 |
+
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
| 91 |
+
|
| 92 |
+
#### Preprocessing [optional]
|
| 93 |
+
|
| 94 |
+
[More Information Needed]
|
| 95 |
+
|
| 96 |
+
|
| 97 |
+
#### Training Hyperparameters
|
| 98 |
+
|
| 99 |
+
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
| 100 |
+
|
| 101 |
+
#### Speeds, Sizes, Times [optional]
|
| 102 |
+
|
| 103 |
+
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
| 104 |
+
|
| 105 |
+
[More Information Needed]
|
| 106 |
+
|
| 107 |
+
## Evaluation
|
| 108 |
+
|
| 109 |
+
<!-- This section describes the evaluation protocols and provides the results. -->
|
| 110 |
+
|
| 111 |
+
### Testing Data, Factors & Metrics
|
| 112 |
+
|
| 113 |
+
#### Testing Data
|
| 114 |
+
|
| 115 |
+
<!-- This should link to a Dataset Card if possible. -->
|
| 116 |
+
|
| 117 |
+
[More Information Needed]
|
| 118 |
+
|
| 119 |
+
#### Factors
|
| 120 |
+
|
| 121 |
+
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
| 122 |
+
|
| 123 |
+
[More Information Needed]
|
| 124 |
+
|
| 125 |
+
#### Metrics
|
| 126 |
+
|
| 127 |
+
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
| 128 |
+
|
| 129 |
+
[More Information Needed]
|
| 130 |
+
|
| 131 |
+
### Results
|
| 132 |
+
|
| 133 |
+
[More Information Needed]
|
| 134 |
+
|
| 135 |
+
#### Summary
|
| 136 |
+
|
| 137 |
+
|
| 138 |
+
|
| 139 |
+
## Model Examination [optional]
|
| 140 |
+
|
| 141 |
+
<!-- Relevant interpretability work for the model goes here -->
|
| 142 |
+
|
| 143 |
+
[More Information Needed]
|
| 144 |
+
|
| 145 |
+
## Environmental Impact
|
| 146 |
+
|
| 147 |
+
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
| 148 |
+
|
| 149 |
+
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
| 150 |
+
|
| 151 |
+
- **Hardware Type:** [More Information Needed]
|
| 152 |
+
- **Hours used:** [More Information Needed]
|
| 153 |
+
- **Cloud Provider:** [More Information Needed]
|
| 154 |
+
- **Compute Region:** [More Information Needed]
|
| 155 |
+
- **Carbon Emitted:** [More Information Needed]
|
| 156 |
+
|
| 157 |
+
## Technical Specifications [optional]
|
| 158 |
+
|
| 159 |
+
### Model Architecture and Objective
|
| 160 |
+
|
| 161 |
+
[More Information Needed]
|
| 162 |
+
|
| 163 |
+
### Compute Infrastructure
|
| 164 |
+
|
| 165 |
+
[More Information Needed]
|
| 166 |
+
|
| 167 |
+
#### Hardware
|
| 168 |
+
|
| 169 |
+
[More Information Needed]
|
| 170 |
+
|
| 171 |
+
#### Software
|
| 172 |
+
|
| 173 |
+
[More Information Needed]
|
| 174 |
+
|
| 175 |
+
## Citation [optional]
|
| 176 |
+
|
| 177 |
+
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
| 178 |
+
|
| 179 |
+
**BibTeX:**
|
| 180 |
+
|
| 181 |
+
[More Information Needed]
|
| 182 |
+
|
| 183 |
+
**APA:**
|
| 184 |
+
|
| 185 |
+
[More Information Needed]
|
| 186 |
+
|
| 187 |
+
## Glossary [optional]
|
| 188 |
+
|
| 189 |
+
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
|
| 190 |
+
|
| 191 |
+
[More Information Needed]
|
| 192 |
+
|
| 193 |
+
## More Information [optional]
|
| 194 |
+
|
| 195 |
+
[More Information Needed]
|
| 196 |
+
|
| 197 |
+
## Model Card Authors [optional]
|
| 198 |
+
|
| 199 |
+
[More Information Needed]
|
| 200 |
+
|
| 201 |
+
## Model Card Contact
|
| 202 |
+
|
| 203 |
+
[More Information Needed]
|
| 204 |
+
### Framework versions
|
| 205 |
+
|
| 206 |
+
- PEFT 0.21.2
|
e16/S1-G-d512-n64k-syn/ckpt-64000/adapter/adapter_config.json
ADDED
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": {
|
| 6 |
+
"base_model_class": "Qwen3_5ForCausalLM",
|
| 7 |
+
"parent_library": "transformers.models.qwen3_5.modeling_qwen3_5"
|
| 8 |
+
},
|
| 9 |
+
"base_model_name_or_path": "/workspace/jev_kt/models/hf/JEV-9B",
|
| 10 |
+
"bias": "none",
|
| 11 |
+
"corda_config": null,
|
| 12 |
+
"ensure_weight_tying": false,
|
| 13 |
+
"eva_config": null,
|
| 14 |
+
"exclude_modules": null,
|
| 15 |
+
"fan_in_fan_out": false,
|
| 16 |
+
"inference_mode": true,
|
| 17 |
+
"init_lora_weights": true,
|
| 18 |
+
"kasa_config": null,
|
| 19 |
+
"layer_replication": null,
|
| 20 |
+
"layers_pattern": null,
|
| 21 |
+
"layers_to_transform": null,
|
| 22 |
+
"loftq_config": {},
|
| 23 |
+
"lora_alpha": 32,
|
| 24 |
+
"lora_bias": false,
|
| 25 |
+
"lora_dropout": 0.05,
|
| 26 |
+
"lora_ga_config": null,
|
| 27 |
+
"megatron_config": null,
|
| 28 |
+
"megatron_core": "megatron.core",
|
| 29 |
+
"modules_to_save": null,
|
| 30 |
+
"monteclora_config": null,
|
| 31 |
+
"peft_type": "LORA",
|
| 32 |
+
"peft_version": "0.21.0",
|
| 33 |
+
"qalora_group_size": 16,
|
| 34 |
+
"r": 16,
|
| 35 |
+
"rank_pattern": {},
|
| 36 |
+
"revision": null,
|
| 37 |
+
"target_modules": [
|
| 38 |
+
"v_proj",
|
| 39 |
+
"out_proj",
|
| 40 |
+
"in_proj_z",
|
| 41 |
+
"in_proj_qkv",
|
| 42 |
+
"up_proj",
|
| 43 |
+
"gate_proj",
|
| 44 |
+
"k_proj",
|
| 45 |
+
"o_proj",
|
| 46 |
+
"q_proj",
|
| 47 |
+
"down_proj"
|
| 48 |
+
],
|
| 49 |
+
"target_parameters": null,
|
| 50 |
+
"task_type": null,
|
| 51 |
+
"trainable_token_indices": null,
|
| 52 |
+
"use_bdlora": null,
|
| 53 |
+
"use_dora": false,
|
| 54 |
+
"use_qalora": false,
|
| 55 |
+
"use_rslora": false,
|
| 56 |
+
"velora_config": null
|
| 57 |
+
}
|
e16/S1-G-d512-n64k-syn/ckpt-64000/adapter/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:53248f3e52f4f983508abb44f188c550532baa30b8a52a03c04a5e6646dc4947
|
| 3 |
+
size 160486456
|
e16/S1-G-d512-n64k-syn/ckpt-64000/adapter_vllm/adapter_config.json
ADDED
|
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"alora_invocation_tokens": null,
|
| 3 |
+
"alpha_pattern": {},
|
| 4 |
+
"arrow_config": null,
|
| 5 |
+
"auto_mapping": {
|
| 6 |
+
"base_model_class": "Qwen3_5ForCausalLM",
|
| 7 |
+
"parent_library": "transformers.models.qwen3_5.modeling_qwen3_5"
|
| 8 |
+
},
|
| 9 |
+
"base_model_name_or_path": null,
|
| 10 |
+
"bias": "none",
|
| 11 |
+
"corda_config": null,
|
| 12 |
+
"ensure_weight_tying": false,
|
| 13 |
+
"eva_config": null,
|
| 14 |
+
"exclude_modules": null,
|
| 15 |
+
"fan_in_fan_out": false,
|
| 16 |
+
"inference_mode": true,
|
| 17 |
+
"init_lora_weights": true,
|
| 18 |
+
"kasa_config": null,
|
| 19 |
+
"layer_replication": null,
|
| 20 |
+
"layers_pattern": null,
|
| 21 |
+
"layers_to_transform": null,
|
| 22 |
+
"loftq_config": {},
|
| 23 |
+
"lora_alpha": 64.0,
|
| 24 |
+
"lora_bias": false,
|
| 25 |
+
"lora_dropout": 0.0,
|
| 26 |
+
"lora_ga_config": null,
|
| 27 |
+
"megatron_config": null,
|
| 28 |
+
"megatron_core": "megatron.core",
|
| 29 |
+
"modules_to_save": null,
|
| 30 |
+
"monteclora_config": null,
|
| 31 |
+
"peft_type": "LORA",
|
| 32 |
+
"peft_version": "0.21.0",
|
| 33 |
+
"qalora_group_size": 16,
|
| 34 |
+
"r": 32,
|
| 35 |
+
"rank_pattern": {},
|
| 36 |
+
"revision": null,
|
| 37 |
+
"target_modules": [
|
| 38 |
+
"down_proj",
|
| 39 |
+
"gate_proj",
|
| 40 |
+
"in_proj_qkv",
|
| 41 |
+
"in_proj_z",
|
| 42 |
+
"k_proj",
|
| 43 |
+
"lm_head",
|
| 44 |
+
"o_proj",
|
| 45 |
+
"out_proj",
|
| 46 |
+
"q_proj",
|
| 47 |
+
"up_proj",
|
| 48 |
+
"v_proj"
|
| 49 |
+
],
|
| 50 |
+
"target_parameters": null,
|
| 51 |
+
"task_type": null,
|
| 52 |
+
"trainable_token_indices": null,
|
| 53 |
+
"use_bdlora": null,
|
| 54 |
+
"use_dora": false,
|
| 55 |
+
"use_qalora": false,
|
| 56 |
+
"use_rslora": false,
|
| 57 |
+
"velora_config": null
|
| 58 |
+
}
|
e16/S1-G-d512-n64k-syn/ckpt-64000/adapter_vllm/adapter_model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0dfcd019f239daeefe71f0b1568ae7caaf89a3c33eb5c73b00e710bd8c18ce88
|
| 3 |
+
size 176641832
|
e16/S1-G-d512-n64k-syn/ckpt-64000/adapter_vllm/decision_head.json
ADDED
|
@@ -0,0 +1,99 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"bias": [
|
| 3 |
+
0.0003610613930504769,
|
| 4 |
+
-0.0003613797889556736,
|
| 5 |
+
-0.003343968652188778,
|
| 6 |
+
-0.0022823461331427097,
|
| 7 |
+
-0.0009137440356425941,
|
| 8 |
+
0.00228967540897429,
|
| 9 |
+
0.0009489753865636885,
|
| 10 |
+
-0.003226210130378604,
|
| 11 |
+
-0.0006535293650813401,
|
| 12 |
+
-0.0008285562507808208,
|
| 13 |
+
-0.0005077689420431852,
|
| 14 |
+
0.00032306977664120495,
|
| 15 |
+
-0.000852672616019845,
|
| 16 |
+
-0.006932058837264776,
|
| 17 |
+
-0.0076689994893968105,
|
| 18 |
+
-0.007440886925905943,
|
| 19 |
+
-0.006169365718960762,
|
| 20 |
+
-0.005287813488394022,
|
| 21 |
+
-0.005697482265532017,
|
| 22 |
+
-0.0067338659428060055,
|
| 23 |
+
-0.004608632531017065,
|
| 24 |
+
-0.005164242349565029,
|
| 25 |
+
-0.006595464423298836,
|
| 26 |
+
-0.004675811622291803
|
| 27 |
+
],
|
| 28 |
+
"verbalizer_ids": [
|
| 29 |
+
3721,
|
| 30 |
+
1802,
|
| 31 |
+
15,
|
| 32 |
+
16,
|
| 33 |
+
17,
|
| 34 |
+
18,
|
| 35 |
+
19,
|
| 36 |
+
20,
|
| 37 |
+
32,
|
| 38 |
+
33,
|
| 39 |
+
34,
|
| 40 |
+
35,
|
| 41 |
+
36,
|
| 42 |
+
37,
|
| 43 |
+
38,
|
| 44 |
+
39,
|
| 45 |
+
40,
|
| 46 |
+
41,
|
| 47 |
+
42,
|
| 48 |
+
43,
|
| 49 |
+
44,
|
| 50 |
+
45,
|
| 51 |
+
46,
|
| 52 |
+
47
|
| 53 |
+
],
|
| 54 |
+
"slots": {
|
| 55 |
+
"num_slots": 24,
|
| 56 |
+
"ranges": {
|
| 57 |
+
"noul": [
|
| 58 |
+
0,
|
| 59 |
+
2
|
| 60 |
+
],
|
| 61 |
+
"score": [
|
| 62 |
+
2,
|
| 63 |
+
8
|
| 64 |
+
],
|
| 65 |
+
"choice": [
|
| 66 |
+
8,
|
| 67 |
+
24
|
| 68 |
+
]
|
| 69 |
+
},
|
| 70 |
+
"verbalizers": [
|
| 71 |
+
"false",
|
| 72 |
+
"true",
|
| 73 |
+
"0",
|
| 74 |
+
"1",
|
| 75 |
+
"2",
|
| 76 |
+
"3",
|
| 77 |
+
"4",
|
| 78 |
+
"5",
|
| 79 |
+
"A",
|
| 80 |
+
"B",
|
| 81 |
+
"C",
|
| 82 |
+
"D",
|
| 83 |
+
"E",
|
| 84 |
+
"F",
|
| 85 |
+
"G",
|
| 86 |
+
"H",
|
| 87 |
+
"I",
|
| 88 |
+
"J",
|
| 89 |
+
"K",
|
| 90 |
+
"L",
|
| 91 |
+
"M",
|
| 92 |
+
"N",
|
| 93 |
+
"O",
|
| 94 |
+
"P"
|
| 95 |
+
],
|
| 96 |
+
"template_version": "bare-v1"
|
| 97 |
+
},
|
| 98 |
+
"note": "decision logits = lm_head-LoRA logprobs of verbalizer ids + bias, then per-kind temperature"
|
| 99 |
+
}
|
e16/S1-G-d512-n64k-syn/ckpt-64000/calibration.json
ADDED
|
@@ -0,0 +1,29 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"version": 1,
|
| 3 |
+
"per_kind": {
|
| 4 |
+
"noul": 0.8535048029233984,
|
| 5 |
+
"choice": 1.0510900611843623,
|
| 6 |
+
"score": 1.0064881398589662
|
| 7 |
+
},
|
| 8 |
+
"fit": {
|
| 9 |
+
"noul": {
|
| 10 |
+
"n": 1087,
|
| 11 |
+
"T": 0.8535048029233984,
|
| 12 |
+
"ce_before": 0.5567172169685364,
|
| 13 |
+
"ce_after": 0.5546396374702454
|
| 14 |
+
},
|
| 15 |
+
"choice": {
|
| 16 |
+
"n": 60,
|
| 17 |
+
"T": 1.0510900611843623,
|
| 18 |
+
"ce_before": 0.698706865310669,
|
| 19 |
+
"ce_after": 0.6981315016746521
|
| 20 |
+
},
|
| 21 |
+
"score": {
|
| 22 |
+
"n": 53,
|
| 23 |
+
"T": 1.0064881398589662,
|
| 24 |
+
"ce_before": 1.0756179094314575,
|
| 25 |
+
"ce_after": 1.075606346130371
|
| 26 |
+
}
|
| 27 |
+
},
|
| 28 |
+
"source": "models/e16/S1-G-d512-n64k-syn/ckpt-64000"
|
| 29 |
+
}
|
e16/S1-G-d512-n64k-syn/ckpt-64000/head.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5bcdadac896dce541b2060255454bb7b5a00fea1488a143a8f142e7067b0d4ba
|
| 3 |
+
size 393464
|
e16/S1-G-d512-n64k-syn/ckpt-64000/judge_config.json
ADDED
|
@@ -0,0 +1,164 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"base_model_path": "/root/models/Qwen3.5-9B",
|
| 3 |
+
"hidden_size": 4096,
|
| 4 |
+
"slots": {
|
| 5 |
+
"num_slots": 24,
|
| 6 |
+
"ranges": {
|
| 7 |
+
"noul": [
|
| 8 |
+
0,
|
| 9 |
+
2
|
| 10 |
+
],
|
| 11 |
+
"score": [
|
| 12 |
+
2,
|
| 13 |
+
8
|
| 14 |
+
],
|
| 15 |
+
"choice": [
|
| 16 |
+
8,
|
| 17 |
+
24
|
| 18 |
+
]
|
| 19 |
+
},
|
| 20 |
+
"verbalizers": [
|
| 21 |
+
"false",
|
| 22 |
+
"true",
|
| 23 |
+
"0",
|
| 24 |
+
"1",
|
| 25 |
+
"2",
|
| 26 |
+
"3",
|
| 27 |
+
"4",
|
| 28 |
+
"5",
|
| 29 |
+
"A",
|
| 30 |
+
"B",
|
| 31 |
+
"C",
|
| 32 |
+
"D",
|
| 33 |
+
"E",
|
| 34 |
+
"F",
|
| 35 |
+
"G",
|
| 36 |
+
"H",
|
| 37 |
+
"I",
|
| 38 |
+
"J",
|
| 39 |
+
"K",
|
| 40 |
+
"L",
|
| 41 |
+
"M",
|
| 42 |
+
"N",
|
| 43 |
+
"O",
|
| 44 |
+
"P"
|
| 45 |
+
],
|
| 46 |
+
"template_version": "bare-v1"
|
| 47 |
+
},
|
| 48 |
+
"verbalizer_ids": [
|
| 49 |
+
3721,
|
| 50 |
+
1802,
|
| 51 |
+
15,
|
| 52 |
+
16,
|
| 53 |
+
17,
|
| 54 |
+
18,
|
| 55 |
+
19,
|
| 56 |
+
20,
|
| 57 |
+
32,
|
| 58 |
+
33,
|
| 59 |
+
34,
|
| 60 |
+
35,
|
| 61 |
+
36,
|
| 62 |
+
37,
|
| 63 |
+
38,
|
| 64 |
+
39,
|
| 65 |
+
40,
|
| 66 |
+
41,
|
| 67 |
+
42,
|
| 68 |
+
43,
|
| 69 |
+
44,
|
| 70 |
+
45,
|
| 71 |
+
46,
|
| 72 |
+
47
|
| 73 |
+
],
|
| 74 |
+
"kinds": [
|
| 75 |
+
"noul",
|
| 76 |
+
"choice",
|
| 77 |
+
"score"
|
| 78 |
+
],
|
| 79 |
+
"model_name": "jev-judge-qwen35-9b",
|
| 80 |
+
"model_version": "0.8.0",
|
| 81 |
+
"lm_head_included": true,
|
| 82 |
+
"weights_mode": "unmerged",
|
| 83 |
+
"adapter_subfolder": "adapter",
|
| 84 |
+
"lora": {
|
| 85 |
+
"r": 16,
|
| 86 |
+
"lora_alpha": 32,
|
| 87 |
+
"lora_dropout": 0.05,
|
| 88 |
+
"target_modules": [
|
| 89 |
+
"down_proj",
|
| 90 |
+
"gate_proj",
|
| 91 |
+
"in_proj_qkv",
|
| 92 |
+
"in_proj_z",
|
| 93 |
+
"k_proj",
|
| 94 |
+
"o_proj",
|
| 95 |
+
"out_proj",
|
| 96 |
+
"q_proj",
|
| 97 |
+
"up_proj",
|
| 98 |
+
"v_proj"
|
| 99 |
+
]
|
| 100 |
+
},
|
| 101 |
+
"trained_stage": "e16",
|
| 102 |
+
"source_checkpoint": "models/e16/S1-G-d512-n64k-syn/ckpt-64000",
|
| 103 |
+
"softcap": null,
|
| 104 |
+
"e16": {
|
| 105 |
+
"data": "data/e18/G-d512-n64k",
|
| 106 |
+
"data_manifest": {
|
| 107 |
+
"arm": "G-d512-n64k",
|
| 108 |
+
"name": null,
|
| 109 |
+
"train_sha256": "4c50d46f5065c5ad8d74742bbfcdd89592368cc3fc84570bde5712d6f642c7c4",
|
| 110 |
+
"n_train": 64000
|
| 111 |
+
},
|
| 112 |
+
"init": "released",
|
| 113 |
+
"objective": "s-log",
|
| 114 |
+
"sigma": 0.5,
|
| 115 |
+
"K": 8,
|
| 116 |
+
"reward": "brier",
|
| 117 |
+
"clip": 0.2,
|
| 118 |
+
"passes": 1,
|
| 119 |
+
"lr": 0.0001,
|
| 120 |
+
"lr_head": 0.0002,
|
| 121 |
+
"rows_per_step": 32,
|
| 122 |
+
"train_seed": 0,
|
| 123 |
+
"replay": "data/e16/replay/train.jsonl",
|
| 124 |
+
"replay_frac": 0.05,
|
| 125 |
+
"replay_sha256": "9dd2df19851678750cf79d2fdb47581720930ef2f0c6e18e6fbe23ef2181847e",
|
| 126 |
+
"max_len": 3072,
|
| 127 |
+
"schedule": "warmup 0.03 + cosine to x0.05 over 2000 steps",
|
| 128 |
+
"total_rows": 64000,
|
| 129 |
+
"lora": {
|
| 130 |
+
"r": 16,
|
| 131 |
+
"lora_alpha": 32,
|
| 132 |
+
"lora_dropout": 0.05
|
| 133 |
+
},
|
| 134 |
+
"trainer_sha256": "bc7c08e836bd99bb2665b02903cd41404ea029ecfa9b68a9ec1a7cda96958ba4",
|
| 135 |
+
"event": "ckpt",
|
| 136 |
+
"tag": "ckpt-64000",
|
| 137 |
+
"rows_seen": 64000,
|
| 138 |
+
"replay_seen": 3368,
|
| 139 |
+
"step": 2000,
|
| 140 |
+
"tokens": 36466937,
|
| 141 |
+
"tok_per_s": 798.3150595591214,
|
| 142 |
+
"rows_per_s": 1.4747849244186944,
|
| 143 |
+
"val": {
|
| 144 |
+
"n": 1200,
|
| 145 |
+
"dropped_long": 0,
|
| 146 |
+
"noul_ce": 0.5567172169685364,
|
| 147 |
+
"noul_T": 0.8535048029233984,
|
| 148 |
+
"choice_ce": 0.698706865310669,
|
| 149 |
+
"choice_T": 1.0510900611843623,
|
| 150 |
+
"score_ce": 1.0756179094314575,
|
| 151 |
+
"score_T": 1.0064881398589662,
|
| 152 |
+
"noul_auc": 0.7461504,
|
| 153 |
+
"noul_acc": 0.703,
|
| 154 |
+
"noul_f1": 0.7781926811053025,
|
| 155 |
+
"noul_nll": 0.5701980313435197,
|
| 156 |
+
"noul_ece": 0.029104432836174966,
|
| 157 |
+
"noul_brier": 0.19419158106517692,
|
| 158 |
+
"noul_sharp": 0.1844566911458969,
|
| 159 |
+
"entropy": 0.5918917655944824
|
| 160 |
+
},
|
| 161 |
+
"dropped_long": 0,
|
| 162 |
+
"peak_gib": 18.237416744232178
|
| 163 |
+
}
|
| 164 |
+
}
|
e16/S1-G-d512-n64k-syn/train_log.jsonl
ADDED
|
@@ -0,0 +1,222 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{"time": "17:26:10", "event": "start", "data": "data/e18/G-d512-n64k", "data_manifest": {"arm": "G-d512-n64k", "name": null, "train_sha256": "4c50d46f5065c5ad8d74742bbfcdd89592368cc3fc84570bde5712d6f642c7c4", "n_train": 64000}, "init": "released", "objective": "s-log", "sigma": 0.5, "K": 8, "reward": "brier", "clip": 0.2, "passes": 1, "lr": 0.0001, "lr_head": 0.0002, "rows_per_step": 32, "train_seed": 0, "replay": "data/e16/replay/train.jsonl", "replay_frac": 0.05, "replay_sha256": "9dd2df19851678750cf79d2fdb47581720930ef2f0c6e18e6fbe23ef2181847e", "max_len": 3072, "schedule": "warmup 0.03 + cosine to x0.05 over 2000 steps", "total_rows": 64000, "lora": {"r": 16, "lora_alpha": 32, "lora_dropout": 0.05}, "trainer_sha256": "bc7c08e836bd99bb2665b02903cd41404ea029ecfa9b68a9ec1a7cda96958ba4", "device": "cuda", "load_s": 116.18483519554138}
|
| 2 |
+
{"time": "17:29:48", "event": "step", "step": 10, "rows_seen": 320, "lr": 1.8333333333333333e-05, "tok_per_s": 823.8084063502204, "loss": 0.599112693220377, "entropy": 0.5378337725996971, "sharp": 0.22925241477787495}
|
| 3 |
+
{"time": "17:33:28", "event": "step", "step": 20, "rows_seen": 640, "lr": 3.5e-05, "tok_per_s": 826.2602477564694, "loss": 0.6132095009088516, "entropy": 0.6448538079857826, "sharp": 0.13269295450299978}
|
| 4 |
+
{"time": "17:37:09", "event": "step", "step": 30, "rows_seen": 960, "lr": 5.166666666666667e-05, "tok_per_s": 827.9753686009735, "loss": 0.6247377749532461, "entropy": 0.5712490510195494, "sharp": 0.21120773628354073}
|
| 5 |
+
{"time": "17:40:44", "event": "step", "step": 40, "rows_seen": 1280, "lr": 6.833333333333333e-05, "tok_per_s": 828.938717209469, "loss": 0.5839225202798843, "entropy": 0.603554043918848, "sharp": 0.18069155886769295}
|
| 6 |
+
{"time": "17:44:28", "event": "step", "step": 50, "rows_seen": 1600, "lr": 8.5e-05, "tok_per_s": 829.8241225340763, "loss": 0.5557582341134548, "entropy": 0.5487566776573658, "sharp": 0.22526764124631882}
|
| 7 |
+
{"time": "17:48:02", "event": "step", "step": 60, "rows_seen": 1920, "lr": 0.0001, "tok_per_s": 831.317273377766, "loss": 0.5865006595849991, "entropy": 0.6246115639805794, "sharp": 0.1624261476099491}
|
| 8 |
+
{"time": "17:51:42", "event": "step", "step": 70, "rows_seen": 2240, "lr": 9.999377197411753e-05, "tok_per_s": 831.8781067358904, "loss": 0.5956958681344986, "entropy": 0.6449213661253452, "sharp": 0.13523553032428026}
|
| 9 |
+
{"time": "17:55:18", "event": "step", "step": 80, "rows_seen": 2560, "lr": 9.997508952966197e-05, "tok_per_s": 832.4846263840668, "loss": 0.6140658315271139, "entropy": 0.6152744740247726, "sharp": 0.1722976053133607}
|
| 10 |
+
{"time": "17:59:00", "event": "step", "step": 90, "rows_seen": 2880, "lr": 9.994395756578056e-05, "tok_per_s": 834.5765618839464, "loss": 0.6348102949559689, "entropy": 0.6059958711266518, "sharp": 0.17103951890021563}
|
| 11 |
+
{"time": "18:02:38", "event": "step", "step": 100, "rows_seen": 3200, "lr": 9.990038424629131e-05, "tok_per_s": 835.1426125647318, "loss": 0.5703013893216848, "entropy": 0.6022226959466934, "sharp": 0.1839103326201439}
|
| 12 |
+
{"time": "18:04:05", "event": "val", "step": 100, "rows_seen": 3200, "n": 500, "dropped_long": 0, "noul_ce": 0.585247278213501, "noul_T": 0.9370156222449892, "noul_auc": 0.7420127930330289, "noul_acc": 0.688, "noul_f1": 0.7425742574257426, "noul_nll": 0.5884223307073116, "noul_ece": 0.08430007255077362, "noul_brier": 0.2013702536843216, "noul_sharp": 0.18235665559768677, "entropy": 0.5954493284225464}
|
| 13 |
+
{"time": "18:07:40", "event": "step", "step": 110, "rows_seen": 3520, "lr": 9.984438099754206e-05, "tok_per_s": 806.6185656787143, "loss": 0.6137428395450115, "entropy": 0.6074099950492382, "sharp": 0.1671527735888958}
|
| 14 |
+
{"time": "18:11:30", "event": "step", "step": 120, "rows_seen": 3840, "lr": 9.977596250541417e-05, "tok_per_s": 809.5523615286558, "loss": 0.5828855633735657, "entropy": 0.5840614959597588, "sharp": 0.18967116065323353}
|
| 15 |
+
{"time": "18:15:17", "event": "step", "step": 130, "rows_seen": 4160, "lr": 9.969514671147145e-05, "tok_per_s": 812.4074049639709, "loss": 0.5751809999346733, "entropy": 0.5418094769120216, "sharp": 0.23482727818191051}
|
| 16 |
+
{"time": "18:18:57", "event": "step", "step": 140, "rows_seen": 4480, "lr": 9.96019548082552e-05, "tok_per_s": 813.8262847508031, "loss": 0.6127641573548317, "entropy": 0.6207511760294437, "sharp": 0.15685556177049875}
|
| 17 |
+
{"time": "18:22:39", "event": "step", "step": 150, "rows_seen": 4800, "lr": 9.949641123372692e-05, "tok_per_s": 815.1183262568813, "loss": 0.6477248035371304, "entropy": 0.6281796470284462, "sharp": 0.1548933070152998}
|
| 18 |
+
{"time": "18:26:13", "event": "step", "step": 160, "rows_seen": 5120, "lr": 9.937854366485982e-05, "tok_per_s": 816.313877982214, "loss": 0.6310362201184034, "entropy": 0.5668924767524004, "sharp": 0.20595109649002552}
|
| 19 |
+
{"time": "18:29:55", "event": "step", "step": 170, "rows_seen": 5440, "lr": 9.924838301038104e-05, "tok_per_s": 817.5443869149651, "loss": 0.608681458979845, "entropy": 0.6260735616087914, "sharp": 0.1518351910635829}
|
| 20 |
+
{"time": "18:33:33", "event": "step", "step": 180, "rows_seen": 5760, "lr": 9.910596340266635e-05, "tok_per_s": 818.6047710516557, "loss": 0.5884558036923409, "entropy": 0.5948595814406872, "sharp": 0.1865435354411602}
|
| 21 |
+
{"time": "18:37:13", "event": "step", "step": 190, "rows_seen": 6080, "lr": 9.895132218878961e-05, "tok_per_s": 819.1396236282658, "loss": 0.638902485370636, "entropy": 0.6003691703081131, "sharp": 0.17645001783967018}
|
| 22 |
+
{"time": "18:40:53", "event": "step", "step": 200, "rows_seen": 6400, "lr": 9.8784499920729e-05, "tok_per_s": 819.9210397587129, "loss": 0.5926566459238529, "entropy": 0.6202309839427471, "sharp": 0.1680191606283188}
|
| 23 |
+
{"time": "18:42:21", "event": "val", "step": 200, "rows_seen": 6400, "n": 500, "dropped_long": 0, "noul_ce": 0.5795888900756836, "noul_T": 0.7671127616588858, "noul_auc": 0.7450675937958853, "noul_acc": 0.708, "noul_f1": 0.7689873417721519, "noul_nll": 0.5822293357402086, "noul_ece": 0.05734285658597947, "noul_brier": 0.19844285337160913, "noul_sharp": 0.16495634615421295, "entropy": 0.6154587268829346}
|
| 24 |
+
{"time": "18:46:06", "event": "step", "step": 210, "rows_seen": 6720, "lr": 9.860554034473306e-05, "tok_per_s": 805.5375929535954, "loss": 0.58513293415308, "entropy": 0.577089561149478, "sharp": 0.2040191199630499}
|
| 25 |
+
{"time": "18:49:41", "event": "step", "step": 220, "rows_seen": 7040, "lr": 9.841449038984903e-05, "tok_per_s": 806.5665926955562, "loss": 0.6043823957443237, "entropy": 0.5978571772575378, "sharp": 0.17987666744738817}
|
| 26 |
+
{"time": "18:53:13", "event": "step", "step": 230, "rows_seen": 7360, "lr": 9.821140015561645e-05, "tok_per_s": 807.7084301319783, "loss": 0.5892063565552235, "entropy": 0.5852174796164036, "sharp": 0.20552684739232063}
|
| 27 |
+
{"time": "18:56:48", "event": "step", "step": 240, "rows_seen": 7680, "lr": 9.79963228989294e-05, "tok_per_s": 808.9218514878618, "loss": 0.5898661259561777, "entropy": 0.5889728739857674, "sharp": 0.19280660152435303}
|
| 28 |
+
{"time": "19:00:39", "event": "step", "step": 250, "rows_seen": 8000, "lr": 9.776931502007089e-05, "tok_per_s": 809.873282189417, "loss": 0.6200935132801533, "entropy": 0.6324044764041901, "sharp": 0.14399932231754065}
|
| 29 |
+
{"time": "19:04:03", "event": "step", "step": 260, "rows_seen": 8320, "lr": 9.753043604792285e-05, "tok_per_s": 810.9005605944753, "loss": 0.5876366719603539, "entropy": 0.5853693708777428, "sharp": 0.18772707786411047}
|
| 30 |
+
{"time": "19:07:40", "event": "step", "step": 270, "rows_seen": 8640, "lr": 9.727974862435562e-05, "tok_per_s": 811.9160550382476, "loss": 0.6405646493658423, "entropy": 0.6195620074868202, "sharp": 0.15795282740145922}
|
| 31 |
+
{"time": "19:11:15", "event": "step", "step": 280, "rows_seen": 8960, "lr": 9.701731848780134e-05, "tok_per_s": 812.8455205870587, "loss": 0.6458072857931256, "entropy": 0.6069357171654701, "sharp": 0.17777706682682037}
|
| 32 |
+
{"time": "19:14:57", "event": "step", "step": 290, "rows_seen": 9280, "lr": 9.674321445601502e-05, "tok_per_s": 813.7733638651649, "loss": 0.6204153336584568, "entropy": 0.5677219144999981, "sharp": 0.20307076908648014}
|
| 33 |
+
{"time": "19:18:37", "event": "step", "step": 300, "rows_seen": 9600, "lr": 9.645750840802845e-05, "tok_per_s": 814.6968258730167, "loss": 0.5900059528648853, "entropy": 0.6041207294911146, "sharp": 0.15971660893410444}
|
| 34 |
+
{"time": "19:20:05", "event": "val", "step": 300, "rows_seen": 9600, "n": 500, "dropped_long": 0, "noul_ce": 0.5716248750686646, "noul_T": 0.835834233122695, "noul_auc": 0.7490844036387572, "noul_acc": 0.71, "noul_f1": 0.7806354009077155, "noul_nll": 0.574039947539568, "noul_ece": 0.07931666684150696, "noul_brier": 0.195309187285684, "noul_sharp": 0.17972733080387115, "entropy": 0.5989230275154114}
|
| 35 |
+
{"time": "19:23:38", "event": "step", "step": 310, "rows_seen": 9920, "lr": 9.616027526530109e-05, "tok_per_s": 804.9926646761685, "loss": 0.5744889844208956, "entropy": 0.6040050685405731, "sharp": 0.1757245846092701}
|
| 36 |
+
{"time": "19:27:05", "event": "step", "step": 320, "rows_seen": 10240, "lr": 9.585159297207315e-05, "tok_per_s": 805.6104602686072, "loss": 0.6383331548422575, "entropy": 0.620513204485178, "sharp": 0.16080713644623756}
|
| 37 |
+
{"time": "19:30:42", "event": "step", "step": 330, "rows_seen": 10560, "lr": 9.553154247492623e-05, "tok_per_s": 806.6865746580178, "loss": 0.5839524008333683, "entropy": 0.5579315908253193, "sharp": 0.2015186920762062}
|
| 38 |
+
{"time": "19:34:20", "event": "step", "step": 340, "rows_seen": 10880, "lr": 9.520020770155628e-05, "tok_per_s": 807.4217721252462, "loss": 0.6312203072011471, "entropy": 0.6085805632174015, "sharp": 0.17533842660486698}
|
| 39 |
+
{"time": "19:37:50", "event": "step", "step": 350, "rows_seen": 11200, "lr": 9.485767553876519e-05, "tok_per_s": 808.0563513589477, "loss": 0.6132026836276054, "entropy": 0.597775399684906, "sharp": 0.17305599618703127}
|
| 40 |
+
{"time": "19:41:26", "event": "step", "step": 360, "rows_seen": 11520, "lr": 9.450403580967612e-05, "tok_per_s": 808.8322373882746, "loss": 0.6264826096594334, "entropy": 0.5671568661928177, "sharp": 0.21901619713753462}
|
| 41 |
+
{"time": "19:45:00", "event": "step", "step": 370, "rows_seen": 11840, "lr": 9.413938125017902e-05, "tok_per_s": 809.6857585101387, "loss": 0.616279368288815, "entropy": 0.580541018396616, "sharp": 0.19624828174710274}
|
| 42 |
+
{"time": "19:48:45", "event": "step", "step": 380, "rows_seen": 12160, "lr": 9.376380748461219e-05, "tok_per_s": 810.3272312175628, "loss": 0.6385758854448795, "entropy": 0.594707015901804, "sharp": 0.1821389589458704}
|
| 43 |
+
{"time": "19:52:30", "event": "step", "step": 390, "rows_seen": 12480, "lr": 9.337741300068645e-05, "tok_per_s": 811.3022807376244, "loss": 0.6391983162611723, "entropy": 0.6296384297311306, "sharp": 0.13497451972216368}
|
| 44 |
+
{"time": "19:55:59", "event": "step", "step": 400, "rows_seen": 12800, "lr": 9.298029912365855e-05, "tok_per_s": 811.7849916099681, "loss": 0.6125209331512451, "entropy": 0.6068423613905907, "sharp": 0.16828123573213816}
|
| 45 |
+
{"time": "19:57:27", "event": "val", "step": 400, "rows_seen": 12800, "n": 500, "dropped_long": 0, "noul_ce": 0.5835309028625488, "noul_T": 0.9562369262019412, "noul_auc": 0.7509577897419453, "noul_acc": 0.69, "noul_f1": 0.7386172006745363, "noul_nll": 0.582161457106471, "noul_ece": 0.07229784739017488, "noul_brier": 0.19923953587838877, "noul_sharp": 0.18357835710048676, "entropy": 0.5905129313468933}
|
| 46 |
+
{"time": "20:01:00", "event": "step", "step": 410, "rows_seen": 13120, "lr": 9.257256998976022e-05, "tok_per_s": 804.7781701694341, "loss": 0.6081415340304375, "entropy": 0.6134931743144989, "sharp": 0.16123863123357296}
|
| 47 |
+
{"time": "20:04:26", "event": "step", "step": 420, "rows_seen": 13440, "lr": 9.215433251889039e-05, "tok_per_s": 805.4324360180899, "loss": 0.642293537966907, "entropy": 0.6114007160067558, "sharp": 0.1660714503377676}
|
| 48 |
+
{"time": "20:08:08", "event": "step", "step": 430, "rows_seen": 13760, "lr": 9.172569638657718e-05, "tok_per_s": 806.1347224717322, "loss": 0.6138114528730512, "entropy": 0.5810211561620235, "sharp": 0.18990903440862894}
|
| 49 |
+
{"time": "20:11:39", "event": "step", "step": 440, "rows_seen": 14080, "lr": 9.128677399521752e-05, "tok_per_s": 806.7739822935281, "loss": 0.6150751672685146, "entropy": 0.6160191297531128, "sharp": 0.1541505642235279}
|
| 50 |
+
{"time": "20:15:26", "event": "step", "step": 450, "rows_seen": 14400, "lr": 9.083768044460145e-05, "tok_per_s": 807.3194191424623, "loss": 0.5766563527286053, "entropy": 0.5736211761832237, "sharp": 0.2067499589174986}
|
| 51 |
+
{"time": "20:18:54", "event": "step", "step": 460, "rows_seen": 14720, "lr": 9.037853350172924e-05, "tok_per_s": 807.7982672898116, "loss": 0.6065797246992588, "entropy": 0.6461699958890676, "sharp": 0.1277233473956585}
|
| 52 |
+
{"time": "20:22:24", "event": "step", "step": 470, "rows_seen": 15040, "lr": 8.990945356992909e-05, "tok_per_s": 808.3513289670047, "loss": 0.6545101292431355, "entropy": 0.5917323753237724, "sharp": 0.18908053915947676}
|
| 53 |
+
{"time": "20:26:10", "event": "step", "step": 480, "rows_seen": 15360, "lr": 8.943056365728335e-05, "tok_per_s": 809.0067896956335, "loss": 0.6108952201902866, "entropy": 0.6285397373139858, "sharp": 0.1499732043594122}
|
| 54 |
+
{"time": "20:29:54", "event": "step", "step": 490, "rows_seen": 15680, "lr": 8.894198934437185e-05, "tok_per_s": 809.5673098163121, "loss": 0.5883891880512238, "entropy": 0.5686792619526386, "sharp": 0.2197609283030033}
|
| 55 |
+
{"time": "20:33:39", "event": "step", "step": 500, "rows_seen": 16000, "lr": 8.844385875134053e-05, "tok_per_s": 810.1399916628825, "loss": 0.5682156831026077, "entropy": 0.5892259925603867, "sharp": 0.20601525716483593}
|
| 56 |
+
{"time": "20:35:07", "event": "val", "step": 500, "rows_seen": 16000, "n": 500, "dropped_long": 0, "noul_ce": 0.5759879350662231, "noul_T": 0.7463050755233063, "noul_auc": 0.7525948929131998, "noul_acc": 0.708, "noul_f1": 0.7794561933534743, "noul_nll": 0.5763037536889315, "noul_ece": 0.073002050280571, "noul_brier": 0.19580203141386157, "noul_sharp": 0.16573596000671387, "entropy": 0.6158044338226318}
|
| 57 |
+
{"time": "20:38:37", "event": "step", "step": 510, "rows_seen": 16320, "lr": 8.793630250430419e-05, "tok_per_s": 804.3944398291909, "loss": 0.5768524892628193, "entropy": 0.5339876674115658, "sharp": 0.24554545059800148}
|
| 58 |
+
{"time": "20:42:19", "event": "step", "step": 520, "rows_seen": 16640, "lr": 8.741945370109202e-05, "tok_per_s": 805.050944194265, "loss": 0.630652941763401, "entropy": 0.6110940426588058, "sharp": 0.16118838265538216}
|
| 59 |
+
{"time": "20:45:59", "event": "step", "step": 530, "rows_seen": 16960, "lr": 8.689344787634503e-05, "tok_per_s": 805.5769798641808, "loss": 0.598234792239964, "entropy": 0.5817919503897429, "sharp": 0.1958646960556507}
|
| 60 |
+
{"time": "20:49:33", "event": "step", "step": 540, "rows_seen": 17280, "lr": 8.63584229659744e-05, "tok_per_s": 806.0562717224659, "loss": 0.6200268287211657, "entropy": 0.6183005124330521, "sharp": 0.15807027742266655}
|
| 61 |
+
{"time": "20:53:12", "event": "step", "step": 550, "rows_seen": 17600, "lr": 8.581451927099022e-05, "tok_per_s": 806.6745383507964, "loss": 0.6240405756980181, "entropy": 0.5984462723135948, "sharp": 0.1868487149477005}
|
| 62 |
+
{"time": "20:56:47", "event": "step", "step": 560, "rows_seen": 17920, "lr": 8.526187942070997e-05, "tok_per_s": 807.0435588298856, "loss": 0.6061782650649548, "entropy": 0.5857973285019398, "sharp": 0.1946662338450551}
|
| 63 |
+
{"time": "21:00:23", "event": "step", "step": 570, "rows_seen": 18240, "lr": 8.470064833535642e-05, "tok_per_s": 807.3663360385759, "loss": 0.5958134103566408, "entropy": 0.5881839469075203, "sharp": 0.204501798376441}
|
| 64 |
+
{"time": "21:04:03", "event": "step", "step": 580, "rows_seen": 18560, "lr": 8.413097318805486e-05, "tok_per_s": 807.692361451328, "loss": 0.6425746120512486, "entropy": 0.6071428749710321, "sharp": 0.17438950948417187}
|
| 65 |
+
{"time": "21:07:47", "event": "step", "step": 590, "rows_seen": 18880, "lr": 8.35530033662395e-05, "tok_per_s": 808.0963864145333, "loss": 0.6439343765377998, "entropy": 0.6308360919356346, "sharp": 0.13900996651500463}
|
| 66 |
+
{"time": "21:11:26", "event": "step", "step": 600, "rows_seen": 19200, "lr": 8.296689043247915e-05, "tok_per_s": 808.5555109074544, "loss": 0.5941970460116863, "entropy": 0.5810583308339119, "sharp": 0.19355445355176926}
|
| 67 |
+
{"time": "21:12:54", "event": "val", "step": 600, "rows_seen": 19200, "n": 500, "dropped_long": 0, "noul_ce": 0.5697677731513977, "noul_T": 0.8830772883091224, "noul_auc": 0.7497088656731533, "noul_acc": 0.7, "noul_f1": 0.7692307692307693, "noul_nll": 0.5715883835181594, "noul_ece": 0.04558582061529161, "noul_brier": 0.1947380071518737, "noul_sharp": 0.1863180547952652, "entropy": 0.5895237922668457}
|
| 68 |
+
{"time": "21:16:37", "event": "step", "step": 610, "rows_seen": 19520, "lr": 8.237278808473261e-05, "tok_per_s": 803.7261782964318, "loss": 0.6031788997352123, "entropy": 0.5943836271762848, "sharp": 0.18938025552779436}
|
| 69 |
+
{"time": "21:20:15", "event": "step", "step": 620, "rows_seen": 19840, "lr": 8.177085211604405e-05, "tok_per_s": 804.2325394894209, "loss": 0.6217584311962128, "entropy": 0.5638203173875809, "sharp": 0.21818658150732517}
|
| 70 |
+
{"time": "21:23:57", "event": "step", "step": 630, "rows_seen": 20160, "lr": 8.116124037368893e-05, "tok_per_s": 804.7932586541585, "loss": 0.6145120151340961, "entropy": 0.6315363831818104, "sharp": 0.15080085210502148}
|
| 71 |
+
{"time": "21:27:29", "event": "step", "step": 640, "rows_seen": 20480, "lr": 8.054411271778132e-05, "tok_per_s": 805.2321485638912, "loss": 0.606266631744802, "entropy": 0.6107124052941799, "sharp": 0.1672702580690384}
|
| 72 |
+
{"time": "21:31:04", "event": "step", "step": 650, "rows_seen": 20800, "lr": 7.991963097935343e-05, "tok_per_s": 805.670743679338, "loss": 0.6342944651842117, "entropy": 0.6031250208616257, "sharp": 0.18211055733263493}
|
| 73 |
+
{"time": "21:34:45", "event": "step", "step": 660, "rows_seen": 21120, "lr": 7.928795891791805e-05, "tok_per_s": 806.0875908948341, "loss": 0.5829924698919058, "entropy": 0.6079849936068058, "sharp": 0.1844965536147356}
|
| 74 |
+
{"time": "21:38:14", "event": "step", "step": 670, "rows_seen": 21440, "lr": 7.864926217852567e-05, "tok_per_s": 806.3566377158899, "loss": 0.5984178557991982, "entropy": 0.5967707484960556, "sharp": 0.18899256736040115}
|
| 75 |
+
{"time": "21:41:48", "event": "step", "step": 680, "rows_seen": 21760, "lr": 7.800370824832674e-05, "tok_per_s": 806.7048082443648, "loss": 0.6482108067721128, "entropy": 0.6019908525049686, "sharp": 0.18048657476902008}
|
| 76 |
+
{"time": "21:45:33", "event": "step", "step": 690, "rows_seen": 22080, "lr": 7.735146641265118e-05, "tok_per_s": 807.2058991843788, "loss": 0.6409512721002102, "entropy": 0.5883828662335873, "sharp": 0.19210071489214897}
|
| 77 |
+
{"time": "21:49:05", "event": "step", "step": 700, "rows_seen": 22400, "lr": 7.669270771061626e-05, "tok_per_s": 807.4802220204739, "loss": 0.5671348944306374, "entropy": 0.5709163621068001, "sharp": 0.21074962243437767}
|
| 78 |
+
{"time": "21:50:33", "event": "val", "step": 700, "rows_seen": 22400, "n": 500, "dropped_long": 0, "noul_ce": 0.5693226456642151, "noul_T": 0.8555638478752624, "noul_auc": 0.7535062699363724, "noul_acc": 0.712, "noul_f1": 0.7906976744186046, "noul_nll": 0.5702664678022266, "noul_ece": 0.06365754175186158, "noul_brier": 0.19433937054533504, "noul_sharp": 0.18387790024280548, "entropy": 0.5936452746391296}
|
| 79 |
+
{"time": "21:54:20", "event": "step", "step": 710, "rows_seen": 22720, "lr": 7.602760489027442e-05, "tok_per_s": 803.3070114668891, "loss": 0.6163050048053265, "entropy": 0.5956370662897825, "sharp": 0.18725462071597576}
|
| 80 |
+
{"time": "21:58:05", "event": "step", "step": 720, "rows_seen": 23040, "lr": 7.535633236331324e-05, "tok_per_s": 803.6310723777285, "loss": 0.5429306887090206, "entropy": 0.6024518348276615, "sharp": 0.1605987874791026}
|
| 81 |
+
{"time": "22:01:44", "event": "step", "step": 730, "rows_seen": 23360, "lr": 7.467906615931893e-05, "tok_per_s": 803.9798738305301, "loss": 0.6378678558394313, "entropy": 0.608835844323039, "sharp": 0.16141242161393166}
|
| 82 |
+
{"time": "22:05:28", "event": "step", "step": 740, "rows_seen": 23680, "lr": 7.399598387961561e-05, "tok_per_s": 804.4448809097466, "loss": 0.5859776437282562, "entropy": 0.548449918627739, "sharp": 0.23401758261024952}
|
| 83 |
+
{"time": "22:09:19", "event": "step", "step": 750, "rows_seen": 24000, "lr": 7.330726465069241e-05, "tok_per_s": 804.7109674269597, "loss": 0.5837650001049042, "entropy": 0.598329309374094, "sharp": 0.17667677905410528}
|
| 84 |
+
{"time": "22:12:57", "event": "step", "step": 760, "rows_seen": 24320, "lr": 7.26130890772308e-05, "tok_per_s": 805.0055910340566, "loss": 0.6224271804094315, "entropy": 0.582566499710083, "sharp": 0.19773798435926437}
|
| 85 |
+
{"time": "22:16:42", "event": "step", "step": 770, "rows_seen": 24640, "lr": 7.191363919474393e-05, "tok_per_s": 805.4078659655906, "loss": 0.5862307846546173, "entropy": 0.5963775813579559, "sharp": 0.1911447374150157}
|
| 86 |
+
{"time": "22:20:32", "event": "step", "step": 780, "rows_seen": 24960, "lr": 7.120909842184114e-05, "tok_per_s": 805.8624861647331, "loss": 0.6111729759722948, "entropy": 0.597191110253334, "sharp": 0.17797538451850414}
|
| 87 |
+
{"time": "22:24:06", "event": "step", "step": 790, "rows_seen": 25280, "lr": 7.049965151212958e-05, "tok_per_s": 806.1620393145984, "loss": 0.5737132094800472, "entropy": 0.5794903263449669, "sharp": 0.20056679286062717}
|
| 88 |
+
{"time": "22:27:35", "event": "step", "step": 800, "rows_seen": 25600, "lr": 6.978548450576568e-05, "tok_per_s": 806.5175366225255, "loss": 0.5845129117369652, "entropy": 0.5571156144142151, "sharp": 0.22465571481734514}
|
| 89 |
+
{"time": "22:29:03", "event": "val", "step": 800, "rows_seen": 25600, "n": 500, "dropped_long": 0, "noul_ce": 0.5703588128089905, "noul_T": 0.9200610782083432, "noul_auc": 0.7552277598690318, "noul_acc": 0.708, "noul_f1": 0.7753846153846153, "noul_nll": 0.5677916010320186, "noul_ece": 0.06640667617321015, "noul_brier": 0.19284991773918092, "noul_sharp": 0.1954621821641922, "entropy": 0.5845456123352051}
|
| 90 |
+
{"time": "22:32:39", "event": "step", "step": 810, "rows_seen": 25920, "lr": 6.90667846806694e-05, "tok_per_s": 803.0653337291844, "loss": 0.6163565814495087, "entropy": 0.6400619819760323, "sharp": 0.13098817598074675}
|
| 91 |
+
{"time": "22:36:15", "event": "step", "step": 820, "rows_seen": 26240, "lr": 6.834374050341399e-05, "tok_per_s": 803.2492196367704, "loss": 0.593910239636898, "entropy": 0.5815205611288548, "sharp": 0.19383638817816973}
|
| 92 |
+
{"time": "22:39:58", "event": "step", "step": 830, "rows_seen": 26560, "lr": 6.76165415798036e-05, "tok_per_s": 803.7396116564756, "loss": 0.5758469104766846, "entropy": 0.6130468659102917, "sharp": 0.1645418582484126}
|
| 93 |
+
{"time": "22:43:49", "event": "step", "step": 840, "rows_seen": 26880, "lr": 6.688537860515266e-05, "tok_per_s": 804.1586396079656, "loss": 0.6402302663773298, "entropy": 0.5955320503562689, "sharp": 0.1893979199230671}
|
| 94 |
+
{"time": "22:47:28", "event": "step", "step": 850, "rows_seen": 27200, "lr": 6.615044331427935e-05, "tok_per_s": 804.4716741746585, "loss": 0.5975833740085363, "entropy": 0.6300072930753231, "sharp": 0.1498454473912716}
|
| 95 |
+
{"time": "22:51:04", "event": "step", "step": 860, "rows_seen": 27520, "lr": 6.541192843122628e-05, "tok_per_s": 804.7453240839512, "loss": 0.6074474044144154, "entropy": 0.5767574682831764, "sharp": 0.1833212487399578}
|
| 96 |
+
{"time": "22:54:45", "event": "step", "step": 870, "rows_seen": 27840, "lr": 6.467002761872219e-05, "tok_per_s": 805.0073576547003, "loss": 0.617696700617671, "entropy": 0.6095476262271404, "sharp": 0.15915284305810928}
|
| 97 |
+
{"time": "22:58:28", "event": "step", "step": 880, "rows_seen": 28160, "lr": 6.392493542739706e-05, "tok_per_s": 805.3245141752333, "loss": 0.6443127989768982, "entropy": 0.6242972314357758, "sharp": 0.1531973034143448}
|
| 98 |
+
{"time": "23:01:57", "event": "step", "step": 890, "rows_seen": 28480, "lr": 6.317684724476465e-05, "tok_per_s": 805.536730683529, "loss": 0.611614590510726, "entropy": 0.5629315711557865, "sharp": 0.21475996263325214}
|
| 99 |
+
{"time": "23:05:33", "event": "step", "step": 900, "rows_seen": 28800, "lr": 6.242595924398558e-05, "tok_per_s": 805.8740193593236, "loss": 0.6291909888386726, "entropy": 0.6244536861777306, "sharp": 0.15188618376851082}
|
| 100 |
+
{"time": "23:07:02", "event": "val", "step": 900, "rows_seen": 28800, "n": 500, "dropped_long": 0, "noul_ce": 0.5730011463165283, "noul_T": 0.8086843797440889, "noul_auc": 0.7527974211405715, "noul_acc": 0.698, "noul_f1": 0.7680491551459293, "noul_nll": 0.5719129692465067, "noul_ece": 0.06379690569639206, "noul_brier": 0.19455041503638315, "noul_sharp": 0.17399676144123077, "entropy": 0.6038395762443542}
|
| 101 |
+
{"time": "23:10:34", "event": "step", "step": 910, "rows_seen": 29120, "lr": 6.16724683324242e-05, "tok_per_s": 802.5310890423618, "loss": 0.5759238107129931, "entropy": 0.6169619560241699, "sharp": 0.15984487440437078}
|
| 102 |
+
{"time": "23:14:12", "event": "step", "step": 920, "rows_seen": 29440, "lr": 6.091657210001309e-05, "tok_per_s": 802.88789743478, "loss": 0.5750399921089411, "entropy": 0.5831661969423294, "sharp": 0.18769042380154133}
|
| 103 |
+
{"time": "23:17:50", "event": "step", "step": 930, "rows_seen": 29760, "lr": 6.015846876743859e-05, "tok_per_s": 803.1319244523246, "loss": 0.5630629770457745, "entropy": 0.5812638327479362, "sharp": 0.20042648166418076}
|
| 104 |
+
{"time": "23:21:28", "event": "step", "step": 940, "rows_seen": 30080, "lr": 5.9398357134160796e-05, "tok_per_s": 803.4538896397271, "loss": 0.5934323631227016, "entropy": 0.5813169069588184, "sharp": 0.2025748249143362}
|
| 105 |
+
{"time": "23:25:09", "event": "step", "step": 950, "rows_seen": 30400, "lr": 5.8636436526281816e-05, "tok_per_s": 803.8537141628609, "loss": 0.6061611771583557, "entropy": 0.6122143641114235, "sharp": 0.17016896419227123}
|
| 106 |
+
{"time": "23:28:40", "event": "step", "step": 960, "rows_seen": 30720, "lr": 5.7872906744276015e-05, "tok_per_s": 804.1360796003514, "loss": 0.5847873650491238, "entropy": 0.5734932497143745, "sharp": 0.21523411571979523}
|
| 107 |
+
{"time": "23:32:17", "event": "step", "step": 970, "rows_seen": 31040, "lr": 5.7107968010595795e-05, "tok_per_s": 804.359238729822, "loss": 0.620391184464097, "entropy": 0.6039679255336523, "sharp": 0.1639625858515501}
|
| 108 |
+
{"time": "23:35:53", "event": "step", "step": 980, "rows_seen": 31360, "lr": 5.634182091716671e-05, "tok_per_s": 804.6178923959316, "loss": 0.6421829611063004, "entropy": 0.5824473984539509, "sharp": 0.19299164973199368}
|
| 109 |
+
{"time": "23:39:25", "event": "step", "step": 990, "rows_seen": 31680, "lr": 5.5574666372785714e-05, "tok_per_s": 804.8161840967355, "loss": 0.6378424670547247, "entropy": 0.6355002280324697, "sharp": 0.1318527990952134}
|
| 110 |
+
{"time": "23:43:06", "event": "step", "step": 1000, "rows_seen": 32000, "lr": 5.48067055504363e-05, "tok_per_s": 805.2107845481962, "loss": 0.5791911296546459, "entropy": 0.5957245603203773, "sharp": 0.19396396540105343}
|
| 111 |
+
{"time": "23:44:34", "event": "val", "step": 1000, "rows_seen": 32000, "n": 500, "dropped_long": 0, "noul_ce": 0.5772563219070435, "noul_T": 0.8139214788504422, "noul_auc": 0.7523248552767042, "noul_acc": 0.7, "noul_f1": 0.7648902821316614, "noul_nll": 0.5768786190450191, "noul_ece": 0.07644764214754107, "noul_brier": 0.19647254193277902, "noul_sharp": 0.16982769966125488, "entropy": 0.6060745716094971}
|
| 112 |
+
{"time": "23:48:19", "event": "step", "step": 1010, "rows_seen": 32320, "lr": 5.403813983453441e-05, "tok_per_s": 802.437885975375, "loss": 0.5788560844957829, "entropy": 0.5866680592298508, "sharp": 0.2007125336676836}
|
| 113 |
+
{"time": "23:52:06", "event": "step", "step": 1020, "rows_seen": 32640, "lr": 5.3269170768118824e-05, "tok_per_s": 802.7248375970015, "loss": 0.6336379908025265, "entropy": 0.6195270866155624, "sharp": 0.14045202732086182}
|
| 114 |
+
{"time": "23:55:47", "event": "step", "step": 1030, "rows_seen": 32960, "lr": 5.25e-05, "tok_per_s": 803.0677184505561, "loss": 0.5854517109692097, "entropy": 0.5712234899401665, "sharp": 0.2040963750332594}
|
| 115 |
+
{"time": "23:59:26", "event": "step", "step": 1040, "rows_seen": 33280, "lr": 5.173082923188119e-05, "tok_per_s": 803.3811005646285, "loss": 0.5759162660688162, "entropy": 0.6014338284730911, "sharp": 0.17573728319257498}
|
| 116 |
+
{"time": "00:03:14", "event": "step", "step": 1050, "rows_seen": 33600, "lr": 5.0961860165465604e-05, "tok_per_s": 803.6384099594483, "loss": 0.6355218105018139, "entropy": 0.6187156438827515, "sharp": 0.1632898524403572}
|
| 117 |
+
{"time": "00:07:02", "event": "step", "step": 1060, "rows_seen": 33920, "lr": 5.019329444956372e-05, "tok_per_s": 803.9547290831043, "loss": 0.5782307544723153, "entropy": 0.5888644121587276, "sharp": 0.19725852087140083}
|
| 118 |
+
{"time": "00:10:41", "event": "step", "step": 1070, "rows_seen": 34240, "lr": 4.9425333627214304e-05, "tok_per_s": 804.3072018261036, "loss": 0.6283455416560173, "entropy": 0.6237584501504898, "sharp": 0.15201062243431807}
|
| 119 |
+
{"time": "00:14:14", "event": "step", "step": 1080, "rows_seen": 34560, "lr": 4.865817908283331e-05, "tok_per_s": 804.5207399582008, "loss": 0.5923137590289116, "entropy": 0.5810692608356476, "sharp": 0.201420359313488}
|
| 120 |
+
{"time": "00:17:58", "event": "step", "step": 1090, "rows_seen": 34880, "lr": 4.7892031989404217e-05, "tok_per_s": 804.7336962257403, "loss": 0.6043605022132397, "entropy": 0.5957245156168938, "sharp": 0.187166016548872}
|
| 121 |
+
{"time": "00:21:39", "event": "step", "step": 1100, "rows_seen": 35200, "lr": 4.7127093255723996e-05, "tok_per_s": 804.9813827549212, "loss": 0.5935360006988049, "entropy": 0.6043978706002235, "sharp": 0.16485761478543282}
|
| 122 |
+
{"time": "00:23:07", "event": "val", "step": 1100, "rows_seen": 35200, "n": 500, "dropped_long": 0, "noul_ce": 0.571830153465271, "noul_T": 0.8708786030335052, "noul_auc": 0.7517003932423081, "noul_acc": 0.704, "noul_f1": 0.765079365079365, "noul_nll": 0.5721050594523549, "noul_ece": 0.05642494142055512, "noul_brier": 0.19498351823937662, "noul_sharp": 0.18035787343978882, "entropy": 0.5926236510276794}
|
| 123 |
+
{"time": "00:26:54", "event": "step", "step": 1110, "rows_seen": 35520, "lr": 4.636356347371821e-05, "tok_per_s": 802.4677368824749, "loss": 0.5793475955724716, "entropy": 0.5775967128574848, "sharp": 0.18573563266545534}
|
| 124 |
+
{"time": "00:30:23", "event": "step", "step": 1120, "rows_seen": 35840, "lr": 4.560164286583922e-05, "tok_per_s": 802.651530554985, "loss": 0.613525778055191, "entropy": 0.6306480169296265, "sharp": 0.14442045893520117}
|
| 125 |
+
{"time": "00:33:55", "event": "step", "step": 1130, "rows_seen": 36160, "lr": 4.4841531232561406e-05, "tok_per_s": 802.8258691504789, "loss": 0.6176405660808086, "entropy": 0.6076195798814297, "sharp": 0.16850444860756397}
|
| 126 |
+
{"time": "00:37:37", "event": "step", "step": 1140, "rows_seen": 36480, "lr": 4.4083427899986926e-05, "tok_per_s": 803.1080688749873, "loss": 0.5927219539880753, "entropy": 0.6080335378646851, "sharp": 0.1767757423222065}
|
| 127 |
+
{"time": "00:41:19", "event": "step", "step": 1150, "rows_seen": 36800, "lr": 4.3327531667575824e-05, "tok_per_s": 803.495118342618, "loss": 0.6233232989907265, "entropy": 0.6203469838947058, "sharp": 0.16114984638988972}
|
| 128 |
+
{"time": "00:44:57", "event": "step", "step": 1160, "rows_seen": 37120, "lr": 4.257404075601443e-05, "tok_per_s": 803.8504465137478, "loss": 0.598531398922205, "entropy": 0.6126706525683403, "sharp": 0.16605456173419952}
|
| 129 |
+
{"time": "00:48:30", "event": "step", "step": 1170, "rows_seen": 37440, "lr": 4.182315275523537e-05, "tok_per_s": 804.0942177298843, "loss": 0.6070727594196796, "entropy": 0.6106801256537437, "sharp": 0.1649452606216073}
|
| 130 |
+
{"time": "00:52:16", "event": "step", "step": 1180, "rows_seen": 37760, "lr": 4.1075064572602964e-05, "tok_per_s": 804.3366417833646, "loss": 0.616926234215498, "entropy": 0.6127586327493191, "sharp": 0.1575631368905306}
|
| 131 |
+
{"time": "00:56:01", "event": "step", "step": 1190, "rows_seen": 38080, "lr": 4.0329972381277805e-05, "tok_per_s": 804.6012118949249, "loss": 0.6303438395261765, "entropy": 0.6017320528626442, "sharp": 0.18471589870750904}
|
| 132 |
+
{"time": "00:59:43", "event": "step", "step": 1200, "rows_seen": 38400, "lr": 3.958807156877371e-05, "tok_per_s": 804.833611851307, "loss": 0.565640420652926, "entropy": 0.5952031742781401, "sharp": 0.18327799998223782}
|
| 133 |
+
{"time": "01:01:11", "event": "val", "step": 1200, "rows_seen": 38400, "n": 500, "dropped_long": 0, "noul_ce": 0.5696312785148621, "noul_T": 0.8343279065321632, "noul_auc": 0.7547551940051642, "noul_acc": 0.714, "noul_f1": 0.787518573551263, "noul_nll": 0.5711311309486627, "noul_ece": 0.0692233300805092, "noul_brier": 0.1944008739982068, "noul_sharp": 0.1790219247341156, "entropy": 0.597215473651886}
|
| 134 |
+
{"time": "01:04:50", "event": "step", "step": 1210, "rows_seen": 38720, "lr": 3.884955668572066e-05, "tok_per_s": 802.4523592419184, "loss": 0.6136786304414272, "entropy": 0.6378681026399136, "sharp": 0.1440948275849223}
|
| 135 |
+
{"time": "01:08:30", "event": "step", "step": 1220, "rows_seen": 39040, "lr": 3.811462139484735e-05, "tok_per_s": 802.6530937142794, "loss": 0.6132729649543762, "entropy": 0.581800565123558, "sharp": 0.20678756013512611}
|
| 136 |
+
{"time": "01:12:13", "event": "step", "step": 1230, "rows_seen": 39360, "lr": 3.738345842019643e-05, "tok_per_s": 802.9133804154341, "loss": 0.6398288179188967, "entropy": 0.6234533861279488, "sharp": 0.1450795941054821}
|
| 137 |
+
{"time": "01:15:49", "event": "step", "step": 1240, "rows_seen": 39680, "lr": 3.665625949658603e-05, "tok_per_s": 803.1235954814916, "loss": 0.5904432833194733, "entropy": 0.6053890138864517, "sharp": 0.17590180970728397}
|
| 138 |
+
{"time": "01:19:28", "event": "step", "step": 1250, "rows_seen": 40000, "lr": 3.5933215319330585e-05, "tok_per_s": 803.3115821285443, "loss": 0.5930176004767418, "entropy": 0.574333380907774, "sharp": 0.20643742755055428}
|
| 139 |
+
{"time": "01:22:55", "event": "step", "step": 1260, "rows_seen": 40320, "lr": 3.521451549423435e-05, "tok_per_s": 803.5137490212423, "loss": 0.5955317914485931, "entropy": 0.6033919919282198, "sharp": 0.17216491792351007}
|
| 140 |
+
{"time": "01:26:32", "event": "step", "step": 1270, "rows_seen": 40640, "lr": 3.450034848787043e-05, "tok_per_s": 803.700910518799, "loss": 0.5709371902048588, "entropy": 0.5640142783522606, "sharp": 0.2122865691781044}
|
| 141 |
+
{"time": "01:30:22", "event": "step", "step": 1280, "rows_seen": 40960, "lr": 3.379090157815887e-05, "tok_per_s": 803.9829268877552, "loss": 0.592074878513813, "entropy": 0.5809339880943298, "sharp": 0.1874542785808444}
|
| 142 |
+
{"time": "01:34:11", "event": "step", "step": 1290, "rows_seen": 41280, "lr": 3.3086360805256096e-05, "tok_per_s": 804.3141811917865, "loss": 0.6213221997022629, "entropy": 0.6186188496649265, "sharp": 0.15179462544620037}
|
| 143 |
+
{"time": "01:37:44", "event": "step", "step": 1300, "rows_seen": 41600, "lr": 3.238691092276923e-05, "tok_per_s": 804.4035773125631, "loss": 0.6409780196845531, "entropy": 0.6146176382899284, "sharp": 0.16502886824309826}
|
| 144 |
+
{"time": "01:39:12", "event": "val", "step": 1300, "rows_seen": 41600, "n": 500, "dropped_long": 0, "noul_ce": 0.5687131285667419, "noul_T": 0.8877660302715585, "noul_auc": 0.7564935612901049, "noul_acc": 0.692, "noul_f1": 0.7570977917981072, "noul_nll": 0.5678326138928532, "noul_ece": 0.059240382313728336, "noul_brier": 0.19312611135158939, "noul_sharp": 0.18690001964569092, "entropy": 0.5877224802970886}
|
| 145 |
+
{"time": "01:42:44", "event": "step", "step": 1310, "rows_seen": 41920, "lr": 3.169273534930759e-05, "tok_per_s": 802.1464053618403, "loss": 0.6021811589598656, "entropy": 0.5903636589646339, "sharp": 0.18689828179776669}
|
| 146 |
+
{"time": "01:46:06", "event": "step", "step": 1320, "rows_seen": 42240, "lr": 3.10040161203844e-05, "tok_per_s": 802.3127671785052, "loss": 0.6355570331215858, "entropy": 0.612435407936573, "sharp": 0.16311484668403864}
|
| 147 |
+
{"time": "01:49:37", "event": "step", "step": 1330, "rows_seen": 42560, "lr": 3.032093384068107e-05, "tok_per_s": 802.4886299981355, "loss": 0.5851787962019444, "entropy": 0.6020034477114677, "sharp": 0.17977359518408775}
|
| 148 |
+
{"time": "01:53:18", "event": "step", "step": 1340, "rows_seen": 42880, "lr": 2.9643667636686757e-05, "tok_per_s": 802.7689813435172, "loss": 0.5875096432864666, "entropy": 0.5977996997535229, "sharp": 0.1920839659869671}
|
| 149 |
+
{"time": "01:56:48", "event": "step", "step": 1350, "rows_seen": 43200, "lr": 2.8972395109725607e-05, "tok_per_s": 802.9937701584388, "loss": 0.5786034949123859, "entropy": 0.600655123591423, "sharp": 0.16231488436460495}
|
| 150 |
+
{"time": "02:00:20", "event": "step", "step": 1360, "rows_seen": 43520, "lr": 2.8307292289383776e-05, "tok_per_s": 803.2088220163902, "loss": 0.6276335548609495, "entropy": 0.5949684269726276, "sharp": 0.18143825605511665}
|
| 151 |
+
{"time": "02:04:00", "event": "step", "step": 1370, "rows_seen": 43840, "lr": 2.7648533587348822e-05, "tok_per_s": 803.489524517316, "loss": 0.5687801726162434, "entropy": 0.57680419459939, "sharp": 0.20693822391331196}
|
| 152 |
+
{"time": "02:07:38", "event": "step", "step": 1380, "rows_seen": 44160, "lr": 2.699629175167327e-05, "tok_per_s": 803.8300381081941, "loss": 0.667755488306284, "entropy": 0.6070003286004066, "sharp": 0.17875464633107185}
|
| 153 |
+
{"time": "02:11:24", "event": "step", "step": 1390, "rows_seen": 44480, "lr": 2.635073782147433e-05, "tok_per_s": 804.0741778311348, "loss": 0.6397939417511225, "entropy": 0.62706708163023, "sharp": 0.14018109813332558}
|
| 154 |
+
{"time": "02:15:08", "event": "step", "step": 1400, "rows_seen": 44800, "lr": 2.571204108208194e-05, "tok_per_s": 804.2701980022953, "loss": 0.6016284264624119, "entropy": 0.605534739792347, "sharp": 0.1639297166839242}
|
| 155 |
+
{"time": "02:16:36", "event": "val", "step": 1400, "rows_seen": 44800, "n": 500, "dropped_long": 0, "noul_ce": 0.5716301202774048, "noul_T": 0.8520821625679821, "noul_auc": 0.7532193549475958, "noul_acc": 0.692, "noul_f1": 0.7547770700636943, "noul_nll": 0.5714837267398835, "noul_ece": 0.05917163240909576, "noul_brier": 0.19450272046401468, "noul_sharp": 0.17935778200626373, "entropy": 0.5958580374717712}
|
| 156 |
+
{"time": "02:20:08", "event": "step", "step": 1410, "rows_seen": 45120, "lr": 2.5080369020646587e-05, "tok_per_s": 802.2158420644574, "loss": 0.5868079364299774, "entropy": 0.5569612737745047, "sharp": 0.2308846153318882}
|
| 157 |
+
{"time": "02:23:46", "event": "step", "step": 1420, "rows_seen": 45440, "lr": 2.4455887282218688e-05, "tok_per_s": 802.4637575496957, "loss": 0.6507194302976131, "entropy": 0.6250457856804132, "sharp": 0.15349598601460457}
|
| 158 |
+
{"time": "02:27:27", "event": "step", "step": 1430, "rows_seen": 45760, "lr": 2.383875962631108e-05, "tok_per_s": 802.7372038809303, "loss": 0.6353090349584818, "entropy": 0.5994072929024696, "sharp": 0.17103604413568974}
|
| 159 |
+
{"time": "02:31:05", "event": "step", "step": 1440, "rows_seen": 46080, "lr": 2.322914788395595e-05, "tok_per_s": 802.9956545430114, "loss": 0.6169801782816648, "entropy": 0.6059464532881975, "sharp": 0.1732911393046379}
|
| 160 |
+
{"time": "02:34:40", "event": "step", "step": 1450, "rows_seen": 46400, "lr": 2.2627211915267383e-05, "tok_per_s": 803.1611293121292, "loss": 0.6287219561636448, "entropy": 0.6112353578209877, "sharp": 0.1638268381357193}
|
| 161 |
+
{"time": "02:38:11", "event": "step", "step": 1460, "rows_seen": 46720, "lr": 2.2033109567520866e-05, "tok_per_s": 803.3327064904055, "loss": 0.5844658799469471, "entropy": 0.5919441282749176, "sharp": 0.1860271980985999}
|
| 162 |
+
{"time": "02:41:56", "event": "step", "step": 1470, "rows_seen": 47040, "lr": 2.144699663376052e-05, "tok_per_s": 803.5814404033348, "loss": 0.6239926405251026, "entropy": 0.5988636910915375, "sharp": 0.1887905690819025}
|
| 163 |
+
{"time": "02:45:32", "event": "step", "step": 1480, "rows_seen": 47360, "lr": 2.0869026811945157e-05, "tok_per_s": 803.7921546731176, "loss": 0.593594953417778, "entropy": 0.6114340275526047, "sharp": 0.1567987408488989}
|
| 164 |
+
{"time": "02:49:11", "event": "step", "step": 1490, "rows_seen": 47680, "lr": 2.0299351664643596e-05, "tok_per_s": 803.956604661029, "loss": 0.5558442659676075, "entropy": 0.5752397961914539, "sharp": 0.2019147016108036}
|
| 165 |
+
{"time": "02:52:39", "event": "step", "step": 1500, "rows_seen": 48000, "lr": 1.973812057929005e-05, "tok_per_s": 804.1345905186116, "loss": 0.6411490403115749, "entropy": 0.6010269299149513, "sharp": 0.18075632210820913}
|
| 166 |
+
{"time": "02:54:08", "event": "val", "step": 1500, "rows_seen": 48000, "n": 500, "dropped_long": 0, "noul_ce": 0.5704439878463745, "noul_T": 0.8612374928909273, "noul_auc": 0.7541307319707684, "noul_acc": 0.694, "noul_f1": 0.7605633802816901, "noul_nll": 0.5700499647855759, "noul_ece": 0.057271878957748414, "noul_brier": 0.19385944542972913, "noul_sharp": 0.18276715278625488, "entropy": 0.5936899185180664}
|
| 167 |
+
{"time": "02:57:50", "event": "step", "step": 1510, "rows_seen": 48320, "lr": 1.9185480729009792e-05, "tok_per_s": 802.2883904978, "loss": 0.5777376089245081, "entropy": 0.5616706945002079, "sharp": 0.2153843156993389}
|
| 168 |
+
{"time": "03:01:28", "event": "step", "step": 1520, "rows_seen": 48640, "lr": 1.8641577034025627e-05, "tok_per_s": 802.4975628322875, "loss": 0.6000414118170738, "entropy": 0.6023919116705656, "sharp": 0.17773010209202766}
|
| 169 |
+
{"time": "03:05:09", "event": "step", "step": 1530, "rows_seen": 48960, "lr": 1.810655212365499e-05, "tok_per_s": 802.7084444905365, "loss": 0.5627078507095575, "entropy": 0.5702306926250458, "sharp": 0.20506539568305016}
|
| 170 |
+
{"time": "03:08:48", "event": "step", "step": 1540, "rows_seen": 49280, "lr": 1.7580546298907994e-05, "tok_per_s": 802.937603072404, "loss": 0.6261179968714714, "entropy": 0.6015963908284903, "sharp": 0.17562493681907654}
|
| 171 |
+
{"time": "03:12:20", "event": "step", "step": 1550, "rows_seen": 49600, "lr": 1.7063697495695813e-05, "tok_per_s": 803.1192882531288, "loss": 0.6333082914352417, "entropy": 0.6213281378149986, "sharp": 0.1550979297608137}
|
| 172 |
+
{"time": "03:16:05", "event": "step", "step": 1560, "rows_seen": 49920, "lr": 1.6556141248659472e-05, "tok_per_s": 803.2991876287415, "loss": 0.5969172455370426, "entropy": 0.5797387734055519, "sharp": 0.19614441320300102}
|
| 173 |
+
{"time": "03:19:45", "event": "step", "step": 1570, "rows_seen": 50240, "lr": 1.605801065562816e-05, "tok_per_s": 803.439412839884, "loss": 0.629240907728672, "entropy": 0.6060352101922035, "sharp": 0.17376297805458307}
|
| 174 |
+
{"time": "03:23:29", "event": "step", "step": 1580, "rows_seen": 50560, "lr": 1.556943634271667e-05, "tok_per_s": 803.6647578809096, "loss": 0.6280848821625113, "entropy": 0.613665146753192, "sharp": 0.15531476493924856}
|
| 175 |
+
{"time": "03:27:11", "event": "step", "step": 1590, "rows_seen": 50880, "lr": 1.5090546430070923e-05, "tok_per_s": 803.8812429542733, "loss": 0.609030295163393, "entropy": 0.6258873119950294, "sharp": 0.14857789315283298}
|
| 176 |
+
{"time": "03:30:49", "event": "step", "step": 1600, "rows_seen": 51200, "lr": 1.4621466498270773e-05, "tok_per_s": 804.0812405249036, "loss": 0.5818341001868248, "entropy": 0.5628990428522229, "sharp": 0.22095390781760216}
|
| 177 |
+
{"time": "03:32:17", "event": "val", "step": 1600, "rows_seen": 51200, "n": 500, "dropped_long": 0, "noul_ce": 0.568766713142395, "noul_T": 0.8580577648984231, "noul_auc": 0.753759430220587, "noul_acc": 0.702, "noul_f1": 0.7711213517665131, "noul_nll": 0.569818709090352, "noul_ece": 0.04428054368495942, "noul_brier": 0.19387525570792405, "noul_sharp": 0.18298879265785217, "entropy": 0.5926580429077148}
|
| 178 |
+
{"time": "03:35:49", "event": "step", "step": 1610, "rows_seen": 51520, "lr": 1.4162319555398557e-05, "tok_per_s": 802.316765143233, "loss": 0.6056209299713373, "entropy": 0.5967187937349081, "sharp": 0.18796800076961517}
|
| 179 |
+
{"time": "03:39:30", "event": "step", "step": 1620, "rows_seen": 51840, "lr": 1.3713226004782476e-05, "tok_per_s": 802.51168829022, "loss": 0.6280053034424782, "entropy": 0.6136301830410957, "sharp": 0.16228561848402023}
|
| 180 |
+
{"time": "03:43:05", "event": "step", "step": 1630, "rows_seen": 52160, "lr": 1.3274303613422823e-05, "tok_per_s": 802.6713966862657, "loss": 0.6019925586879253, "entropy": 0.5970427021384239, "sharp": 0.1882552169263363}
|
| 181 |
+
{"time": "03:46:40", "event": "step", "step": 1640, "rows_seen": 52480, "lr": 1.284566748110963e-05, "tok_per_s": 802.8188957882913, "loss": 0.583078995347023, "entropy": 0.5974731594324112, "sharp": 0.17808591946959496}
|
| 182 |
+
{"time": "03:50:16", "event": "step", "step": 1650, "rows_seen": 52800, "lr": 1.2427430010239793e-05, "tok_per_s": 802.8882751831629, "loss": 0.6262619309127331, "entropy": 0.5842486843466759, "sharp": 0.20407236274331808}
|
| 183 |
+
{"time": "03:54:02", "event": "step", "step": 1660, "rows_seen": 53120, "lr": 1.2019700876341466e-05, "tok_per_s": 803.1124923754008, "loss": 0.6132151708006859, "entropy": 0.6235057078301907, "sharp": 0.14312320947647095}
|
| 184 |
+
{"time": "03:57:41", "event": "step", "step": 1670, "rows_seen": 53440, "lr": 1.162258699931355e-05, "tok_per_s": 803.2902731167084, "loss": 0.6259133480489254, "entropy": 0.6026657670736313, "sharp": 0.18115730956196785}
|
| 185 |
+
{"time": "04:01:20", "event": "step", "step": 1680, "rows_seen": 53760, "lr": 1.1236192515387821e-05, "tok_per_s": 803.4910894424116, "loss": 0.6065345220267773, "entropy": 0.6001008898019791, "sharp": 0.17149724625051022}
|
| 186 |
+
{"time": "04:05:00", "event": "step", "step": 1690, "rows_seen": 54080, "lr": 1.0860618749820988e-05, "tok_per_s": 803.6736164347589, "loss": 0.6555461920797825, "entropy": 0.6060707122087479, "sharp": 0.18270920403301716}
|
| 187 |
+
{"time": "04:08:42", "event": "step", "step": 1700, "rows_seen": 54400, "lr": 1.0495964190323887e-05, "tok_per_s": 803.8403445270684, "loss": 0.5800250042229891, "entropy": 0.5845926888287067, "sharp": 0.19803933054208755}
|
| 188 |
+
{"time": "04:10:10", "event": "val", "step": 1700, "rows_seen": 54400, "n": 500, "dropped_long": 0, "noul_ce": 0.570905327796936, "noul_T": 0.8514805715481472, "noul_auc": 0.7521729591061753, "noul_acc": 0.694, "noul_f1": 0.7635239567233385, "noul_nll": 0.5721130614727735, "noul_ece": 0.041661069989204415, "noul_brier": 0.19477602794820403, "noul_sharp": 0.18032798171043396, "entropy": 0.5955395698547363}
|
| 189 |
+
{"time": "04:13:51", "event": "step", "step": 1710, "rows_seen": 54720, "lr": 1.0142324461234822e-05, "tok_per_s": 802.1613278045709, "loss": 0.6159766390919685, "entropy": 0.6006135307252407, "sharp": 0.17347155883908272}
|
| 190 |
+
{"time": "04:17:35", "event": "step", "step": 1720, "rows_seen": 55040, "lr": 9.799792298443728e-06, "tok_per_s": 802.3557249180209, "loss": 0.5895236283540726, "entropy": 0.5916754193603992, "sharp": 0.18364067561924458}
|
| 191 |
+
{"time": "04:21:21", "event": "step", "step": 1730, "rows_seen": 55360, "lr": 9.468457525073774e-06, "tok_per_s": 802.5270033849536, "loss": 0.6543920673429966, "entropy": 0.6333656683564186, "sharp": 0.13444537669420242}
|
| 192 |
+
{"time": "04:24:56", "event": "step", "step": 1740, "rows_seen": 55680, "lr": 9.148407027926849e-06, "tok_per_s": 802.6825037818783, "loss": 0.5733702853322029, "entropy": 0.5818492583930492, "sharp": 0.19884969014674425}
|
| 193 |
+
{"time": "04:28:27", "event": "step", "step": 1750, "rows_seen": 56000, "lr": 8.839724734698926e-06, "tok_per_s": 802.8031131795419, "loss": 0.6074120998382568, "entropy": 0.5759431645274162, "sharp": 0.2008442673832178}
|
| 194 |
+
{"time": "04:32:07", "event": "step", "step": 1760, "rows_seen": 56320, "lr": 8.542491591971554e-06, "tok_per_s": 803.0073270926986, "loss": 0.5831787325441837, "entropy": 0.5674722753465176, "sharp": 0.2207379750907421}
|
| 195 |
+
{"time": "04:35:42", "event": "step", "step": 1770, "rows_seen": 56640, "lr": 8.256785543984993e-06, "tok_per_s": 803.1530802298719, "loss": 0.6293186098337173, "entropy": 0.6251245364546776, "sharp": 0.1565861152485013}
|
| 196 |
+
{"time": "04:39:10", "event": "step", "step": 1780, "rows_seen": 56960, "lr": 7.982681512198684e-06, "tok_per_s": 803.2569449863661, "loss": 0.6376250050961971, "entropy": 0.6162878423929214, "sharp": 0.1713048443198204}
|
| 197 |
+
{"time": "04:42:37", "event": "step", "step": 1790, "rows_seen": 57280, "lr": 7.720251375644373e-06, "tok_per_s": 803.414890053516, "loss": 0.610152393579483, "entropy": 0.5797921363264322, "sharp": 0.18533926829695702}
|
| 198 |
+
{"time": "04:46:25", "event": "step", "step": 1800, "rows_seen": 57600, "lr": 7.469563952077155e-06, "tok_per_s": 803.6103692207753, "loss": 0.6117260456085205, "entropy": 0.6065185815095901, "sharp": 0.17947568371891975}
|
| 199 |
+
{"time": "04:47:54", "event": "val", "step": 1800, "rows_seen": 57600, "n": 500, "dropped_long": 0, "noul_ce": 0.5707350373268127, "noul_T": 0.8423950925819487, "noul_auc": 0.7539282037433968, "noul_acc": 0.694, "noul_f1": 0.7605633802816901, "noul_nll": 0.5713530558049679, "noul_ece": 0.05328732252120971, "noul_brier": 0.19446019254110977, "noul_sharp": 0.17869886755943298, "entropy": 0.5967177748680115}
|
| 200 |
+
{"time": "04:51:38", "event": "step", "step": 1810, "rows_seen": 57920, "lr": 7.230684979929109e-06, "tok_per_s": 802.0407382500533, "loss": 0.6199827156960964, "entropy": 0.5700331702828407, "sharp": 0.20372146740555763}
|
| 201 |
+
{"time": "04:55:19", "event": "step", "step": 1820, "rows_seen": 58240, "lr": 7.003677101070616e-06, "tok_per_s": 802.19336356447, "loss": 0.6194582674652338, "entropy": 0.6280778534710407, "sharp": 0.1398115586489439}
|
| 202 |
+
{"time": "04:59:01", "event": "step", "step": 1830, "rows_seen": 58560, "lr": 6.7885998443835666e-06, "tok_per_s": 802.3575418599542, "loss": 0.5697636641561985, "entropy": 0.5869953669607639, "sharp": 0.1870750728994608}
|
| 203 |
+
{"time": "05:02:43", "event": "step", "step": 1840, "rows_seen": 58880, "lr": 6.585509610150972e-06, "tok_per_s": 802.4606660837383, "loss": 0.5850734524428844, "entropy": 0.6043939907103777, "sharp": 0.17470237147063017}
|
| 204 |
+
{"time": "05:06:19", "event": "step", "step": 1850, "rows_seen": 59200, "lr": 6.394459655266939e-06, "tok_per_s": 802.5641670268421, "loss": 0.6190571710467339, "entropy": 0.6290580183267593, "sharp": 0.1498702671378851}
|
| 205 |
+
{"time": "05:09:52", "event": "step", "step": 1860, "rows_seen": 59520, "lr": 6.215500079271015e-06, "tok_per_s": 802.6845888584593, "loss": 0.6429889090359211, "entropy": 0.6048034355044365, "sharp": 0.17201770842075348}
|
| 206 |
+
{"time": "05:13:33", "event": "step", "step": 1870, "rows_seen": 59840, "lr": 6.048677811210399e-06, "tok_per_s": 802.8563080679884, "loss": 0.5927097052335739, "entropy": 0.6066640317440033, "sharp": 0.16941378824412823}
|
| 207 |
+
{"time": "05:17:16", "event": "step", "step": 1880, "rows_seen": 60160, "lr": 5.894036597333646e-06, "tok_per_s": 803.0337203157851, "loss": 0.6240316517651081, "entropy": 0.5889193825423717, "sharp": 0.18237800896167755}
|
| 208 |
+
{"time": "05:20:49", "event": "step", "step": 1890, "rows_seen": 60480, "lr": 5.751616989618974e-06, "tok_per_s": 803.1618525516822, "loss": 0.570098128169775, "entropy": 0.5868259947746992, "sharp": 0.1783216567710042}
|
| 209 |
+
{"time": "05:24:35", "event": "step", "step": 1900, "rows_seen": 60800, "lr": 5.6214563351401916e-06, "tok_per_s": 803.3489700811791, "loss": 0.6059344056993723, "entropy": 0.6025320701301098, "sharp": 0.17911315895617008}
|
| 210 |
+
{"time": "05:26:03", "event": "val", "step": 1900, "rows_seen": 60800, "n": 500, "dropped_long": 0, "noul_ce": 0.5695679187774658, "noul_T": 0.8800671944688598, "noul_auc": 0.7540125905048016, "noul_acc": 0.692, "noul_f1": 0.7601246105919003, "noul_nll": 0.5703453297019004, "noul_ece": 0.0428368158340454, "noul_brier": 0.19404684028899088, "noul_sharp": 0.18579518795013428, "entropy": 0.5900408029556274}
|
| 211 |
+
{"time": "05:29:50", "event": "step", "step": 1910, "rows_seen": 61120, "lr": 5.5035887662730904e-06, "tok_per_s": 801.9110263533606, "loss": 0.5519254878163338, "entropy": 0.5677958577871323, "sharp": 0.20776239968836308}
|
| 212 |
+
{"time": "05:33:23", "event": "step", "step": 1920, "rows_seen": 61440, "lr": 5.398045191744809e-06, "tok_per_s": 802.0120384683887, "loss": 0.6145251095294952, "entropy": 0.5927648656070232, "sharp": 0.1854279236868024}
|
| 213 |
+
{"time": "05:36:53", "event": "step", "step": 1930, "rows_seen": 61760, "lr": 5.304853288528564e-06, "tok_per_s": 802.1536152844664, "loss": 0.620875209569931, "entropy": 0.6061406098306179, "sharp": 0.1688556047156453}
|
| 214 |
+
{"time": "05:40:36", "event": "step", "step": 1940, "rows_seen": 62080, "lr": 5.224037494585838e-06, "tok_per_s": 802.283661360481, "loss": 0.5868309941142797, "entropy": 0.5994484648108482, "sharp": 0.18054177146404982}
|
| 215 |
+
{"time": "05:44:22", "event": "step", "step": 1950, "rows_seen": 62400, "lr": 5.1556190024579555e-06, "tok_per_s": 802.4668189187701, "loss": 0.5869347024708986, "entropy": 0.5992071460932493, "sharp": 0.18677933886647224}
|
| 216 |
+
{"time": "05:48:00", "event": "step", "step": 1960, "rows_seen": 62720, "lr": 5.099615753708697e-06, "tok_per_s": 802.6038973387243, "loss": 0.5847222786396742, "entropy": 0.5827902685850859, "sharp": 0.19672034867107868}
|
| 217 |
+
{"time": "05:51:37", "event": "step", "step": 1970, "rows_seen": 63040, "lr": 5.056042434219443e-06, "tok_per_s": 802.7676136826657, "loss": 0.5943300779908895, "entropy": 0.6148218847811222, "sharp": 0.15836448222398758}
|
| 218 |
+
{"time": "05:55:18", "event": "step", "step": 1980, "rows_seen": 63360, "lr": 5.0249104703380416e-06, "tok_per_s": 802.9293668011985, "loss": 0.6111159808933735, "entropy": 0.5943204574286938, "sharp": 0.18325492925941944}
|
| 219 |
+
{"time": "05:59:06", "event": "step", "step": 1990, "rows_seen": 63680, "lr": 5.006228025882471e-06, "tok_per_s": 803.049377889489, "loss": 0.6112006232142448, "entropy": 0.5772557072341442, "sharp": 0.2007421161979437}
|
| 220 |
+
{"time": "06:02:53", "event": "step", "step": 2000, "rows_seen": 64000, "lr": 5e-06, "tok_per_s": 803.1750870401827, "loss": 0.6381847001612186, "entropy": 0.6315665580332279, "sharp": 0.14891666918992996}
|
| 221 |
+
{"time": "06:04:22", "event": "val", "step": 2000, "rows_seen": 64000, "n": 500, "dropped_long": 0, "noul_ce": 0.5701301693916321, "noul_T": 0.8503933204501113, "noul_auc": 0.753826939629711, "noul_acc": 0.698, "noul_f1": 0.7651632970451011, "noul_nll": 0.5708975880444049, "noul_ece": 0.04126676380634309, "noul_brier": 0.19428395385485295, "noul_sharp": 0.18055951595306396, "entropy": 0.5949648022651672}
|
| 222 |
+
{"time": "06:07:32", "event": "ckpt", "tag": "ckpt-64000", "rows_seen": 64000, "replay_seen": 3368, "step": 2000, "tokens": 36466937, "tok_per_s": 798.3150595591214, "rows_per_s": 1.4747849244186944, "val": {"n": 1200, "dropped_long": 0, "noul_ce": 0.5567172169685364, "noul_T": 0.8535048029233984, "choice_ce": 0.698706865310669, "choice_T": 1.0510900611843623, "score_ce": 1.0756179094314575, "score_T": 1.0064881398589662, "noul_auc": 0.7461504, "noul_acc": 0.703, "noul_f1": 0.7781926811053025, "noul_nll": 0.5701980313435197, "noul_ece": 0.029104432836174966, "noul_brier": 0.19419158106517692, "noul_sharp": 0.1844566911458969, "entropy": 0.5918917655944824}, "dropped_long": 0, "peak_gib": 18.237416744232178}
|