Checkpoint at step 100

checkpoint-100/README.md

@@ -0,0 +1,202 @@
+---
+base_model: google/flan-t5-xl
+library_name: peft
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.15.2

checkpoint-100/adapter_config.json

@@ -0,0 +1,36 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "google/flan-t5-xl",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.1,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "v",
+    "q",
+    "o",
+    "k"
+  ],
+  "task_type": "SEQ_2_SEQ_LM",
+  "trainable_token_indices": null,
+  "use_dora": true,
+  "use_rslora": false
+}

checkpoint-100/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:571e26c865ce34a839624668c86f857d87efb98efe85e533d536a15a646a8538
+size 77981776

checkpoint-100/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b10e0c29d9956b5374bbd275278fa618a25be5ec3e887920e351de77d361d455
+size 43903766

checkpoint-100/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:02948e05e4fc846ffce9375fd9d935e4e7e34830a59897c46b8badf26ab6d88d
+size 14244

checkpoint-100/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:688dc6c6d51821e2fd2d23b5594ba67eb05b98d7833d39c13b8154c0c125b66a
+size 1064

checkpoint-100/special_tokens_map.json

@@ -0,0 +1,119 @@
+{
+  "additional_special_tokens": [
+    "<extra_id_0>",
+    "<extra_id_1>",
+    "<extra_id_2>",
+    "<extra_id_3>",
+    "<extra_id_4>",
+    "<extra_id_5>",
+    "<extra_id_6>",
+    "<extra_id_7>",
+    "<extra_id_8>",
+    "<extra_id_9>",
+    "<extra_id_10>",
+    "<extra_id_11>",
+    "<extra_id_12>",
+    "<extra_id_13>",
+    "<extra_id_14>",
+    "<extra_id_15>",
+    "<extra_id_16>",
+    "<extra_id_17>",
+    "<extra_id_18>",
+    "<extra_id_19>",
+    "<extra_id_20>",
+    "<extra_id_21>",
+    "<extra_id_22>",
+    "<extra_id_23>",
+    "<extra_id_24>",
+    "<extra_id_25>",
+    "<extra_id_26>",
+    "<extra_id_27>",
+    "<extra_id_28>",
+    "<extra_id_29>",
+    "<extra_id_30>",
+    "<extra_id_31>",
+    "<extra_id_32>",
+    "<extra_id_33>",
+    "<extra_id_34>",
+    "<extra_id_35>",
+    "<extra_id_36>",
+    "<extra_id_37>",
+    "<extra_id_38>",
+    "<extra_id_39>",
+    "<extra_id_40>",
+    "<extra_id_41>",
+    "<extra_id_42>",
+    "<extra_id_43>",
+    "<extra_id_44>",
+    "<extra_id_45>",
+    "<extra_id_46>",
+    "<extra_id_47>",
+    "<extra_id_48>",
+    "<extra_id_49>",
+    "<extra_id_50>",
+    "<extra_id_51>",
+    "<extra_id_52>",
+    "<extra_id_53>",
+    "<extra_id_54>",
+    "<extra_id_55>",
+    "<extra_id_56>",
+    "<extra_id_57>",
+    "<extra_id_58>",
+    "<extra_id_59>",
+    "<extra_id_60>",
+    "<extra_id_61>",
+    "<extra_id_62>",
+    "<extra_id_63>",
+    "<extra_id_64>",
+    "<extra_id_65>",
+    "<extra_id_66>",
+    "<extra_id_67>",
+    "<extra_id_68>",
+    "<extra_id_69>",
+    "<extra_id_70>",
+    "<extra_id_71>",
+    "<extra_id_72>",
+    "<extra_id_73>",
+    "<extra_id_74>",
+    "<extra_id_75>",
+    "<extra_id_76>",
+    "<extra_id_77>",
+    "<extra_id_78>",
+    "<extra_id_79>",
+    "<extra_id_80>",
+    "<extra_id_81>",
+    "<extra_id_82>",
+    "<extra_id_83>",
+    "<extra_id_84>",
+    "<extra_id_85>",
+    "<extra_id_86>",
+    "<extra_id_87>",
+    "<extra_id_88>",
+    "<extra_id_89>",
+    "<extra_id_90>",
+    "<extra_id_91>",
+    "<extra_id_92>",
+    "<extra_id_93>",
+    "<extra_id_94>",
+    "<extra_id_95>",
+    "<extra_id_96>",
+    "<extra_id_97>",
+    "<extra_id_98>",
+    "<extra_id_99>"
+  ],
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "</s>",
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

checkpoint-100/spiece.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86
+size 791656

checkpoint-100/tokenizer_config.json

@@ -0,0 +1,940 @@
+{
+  "add_prefix_space": null,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32000": {
+      "content": "<extra_id_99>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32001": {
+      "content": "<extra_id_98>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32002": {
+      "content": "<extra_id_97>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32003": {
+      "content": "<extra_id_96>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32004": {
+      "content": "<extra_id_95>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32005": {
+      "content": "<extra_id_94>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32006": {
+      "content": "<extra_id_93>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32007": {
+      "content": "<extra_id_92>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32008": {
+      "content": "<extra_id_91>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32009": {
+      "content": "<extra_id_90>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32010": {
+      "content": "<extra_id_89>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32011": {
+      "content": "<extra_id_88>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32012": {
+      "content": "<extra_id_87>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32013": {
+      "content": "<extra_id_86>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32014": {
+      "content": "<extra_id_85>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32015": {
+      "content": "<extra_id_84>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32016": {
+      "content": "<extra_id_83>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32017": {
+      "content": "<extra_id_82>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32018": {
+      "content": "<extra_id_81>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32019": {
+      "content": "<extra_id_80>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32020": {
+      "content": "<extra_id_79>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32021": {
+      "content": "<extra_id_78>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32022": {
+      "content": "<extra_id_77>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32023": {
+      "content": "<extra_id_76>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32024": {
+      "content": "<extra_id_75>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32025": {
+      "content": "<extra_id_74>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32026": {
+      "content": "<extra_id_73>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32027": {
+      "content": "<extra_id_72>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32028": {
+      "content": "<extra_id_71>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32029": {
+      "content": "<extra_id_70>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32030": {
+      "content": "<extra_id_69>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32031": {
+      "content": "<extra_id_68>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32032": {
+      "content": "<extra_id_67>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32033": {
+      "content": "<extra_id_66>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32034": {
+      "content": "<extra_id_65>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32035": {
+      "content": "<extra_id_64>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32036": {
+      "content": "<extra_id_63>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32037": {
+      "content": "<extra_id_62>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32038": {
+      "content": "<extra_id_61>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32039": {
+      "content": "<extra_id_60>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32040": {
+      "content": "<extra_id_59>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32041": {
+      "content": "<extra_id_58>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32042": {
+      "content": "<extra_id_57>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32043": {
+      "content": "<extra_id_56>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32044": {
+      "content": "<extra_id_55>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32045": {
+      "content": "<extra_id_54>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32046": {
+      "content": "<extra_id_53>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32047": {
+      "content": "<extra_id_52>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32048": {
+      "content": "<extra_id_51>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32049": {
+      "content": "<extra_id_50>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32050": {
+      "content": "<extra_id_49>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32051": {
+      "content": "<extra_id_48>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32052": {
+      "content": "<extra_id_47>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32053": {
+      "content": "<extra_id_46>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32054": {
+      "content": "<extra_id_45>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32055": {
+      "content": "<extra_id_44>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32056": {
+      "content": "<extra_id_43>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32057": {
+      "content": "<extra_id_42>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32058": {
+      "content": "<extra_id_41>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32059": {
+      "content": "<extra_id_40>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32060": {
+      "content": "<extra_id_39>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32061": {
+      "content": "<extra_id_38>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32062": {
+      "content": "<extra_id_37>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32063": {
+      "content": "<extra_id_36>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32064": {
+      "content": "<extra_id_35>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32065": {
+      "content": "<extra_id_34>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32066": {
+      "content": "<extra_id_33>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32067": {
+      "content": "<extra_id_32>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32068": {
+      "content": "<extra_id_31>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32069": {
+      "content": "<extra_id_30>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32070": {
+      "content": "<extra_id_29>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32071": {
+      "content": "<extra_id_28>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32072": {
+      "content": "<extra_id_27>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32073": {
+      "content": "<extra_id_26>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32074": {
+      "content": "<extra_id_25>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32075": {
+      "content": "<extra_id_24>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32076": {
+      "content": "<extra_id_23>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32077": {
+      "content": "<extra_id_22>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32078": {
+      "content": "<extra_id_21>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32079": {
+      "content": "<extra_id_20>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32080": {
+      "content": "<extra_id_19>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32081": {
+      "content": "<extra_id_18>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32082": {
+      "content": "<extra_id_17>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32083": {
+      "content": "<extra_id_16>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32084": {
+      "content": "<extra_id_15>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32085": {
+      "content": "<extra_id_14>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32086": {
+      "content": "<extra_id_13>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32087": {
+      "content": "<extra_id_12>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32088": {
+      "content": "<extra_id_11>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32089": {
+      "content": "<extra_id_10>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32090": {
+      "content": "<extra_id_9>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32091": {
+      "content": "<extra_id_8>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32092": {
+      "content": "<extra_id_7>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32093": {
+      "content": "<extra_id_6>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32094": {
+      "content": "<extra_id_5>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32095": {
+      "content": "<extra_id_4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32096": {
+      "content": "<extra_id_3>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32097": {
+      "content": "<extra_id_2>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32098": {
+      "content": "<extra_id_1>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "32099": {
+      "content": "<extra_id_0>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<extra_id_0>",
+    "<extra_id_1>",
+    "<extra_id_2>",
+    "<extra_id_3>",
+    "<extra_id_4>",
+    "<extra_id_5>",
+    "<extra_id_6>",
+    "<extra_id_7>",
+    "<extra_id_8>",
+    "<extra_id_9>",
+    "<extra_id_10>",
+    "<extra_id_11>",
+    "<extra_id_12>",
+    "<extra_id_13>",
+    "<extra_id_14>",
+    "<extra_id_15>",
+    "<extra_id_16>",
+    "<extra_id_17>",
+    "<extra_id_18>",
+    "<extra_id_19>",
+    "<extra_id_20>",
+    "<extra_id_21>",
+    "<extra_id_22>",
+    "<extra_id_23>",
+    "<extra_id_24>",
+    "<extra_id_25>",
+    "<extra_id_26>",
+    "<extra_id_27>",
+    "<extra_id_28>",
+    "<extra_id_29>",
+    "<extra_id_30>",
+    "<extra_id_31>",
+    "<extra_id_32>",
+    "<extra_id_33>",
+    "<extra_id_34>",
+    "<extra_id_35>",
+    "<extra_id_36>",
+    "<extra_id_37>",
+    "<extra_id_38>",
+    "<extra_id_39>",
+    "<extra_id_40>",
+    "<extra_id_41>",
+    "<extra_id_42>",
+    "<extra_id_43>",
+    "<extra_id_44>",
+    "<extra_id_45>",
+    "<extra_id_46>",
+    "<extra_id_47>",
+    "<extra_id_48>",
+    "<extra_id_49>",
+    "<extra_id_50>",
+    "<extra_id_51>",
+    "<extra_id_52>",
+    "<extra_id_53>",
+    "<extra_id_54>",
+    "<extra_id_55>",
+    "<extra_id_56>",
+    "<extra_id_57>",
+    "<extra_id_58>",
+    "<extra_id_59>",
+    "<extra_id_60>",
+    "<extra_id_61>",
+    "<extra_id_62>",
+    "<extra_id_63>",
+    "<extra_id_64>",
+    "<extra_id_65>",
+    "<extra_id_66>",
+    "<extra_id_67>",
+    "<extra_id_68>",
+    "<extra_id_69>",
+    "<extra_id_70>",
+    "<extra_id_71>",
+    "<extra_id_72>",
+    "<extra_id_73>",
+    "<extra_id_74>",
+    "<extra_id_75>",
+    "<extra_id_76>",
+    "<extra_id_77>",
+    "<extra_id_78>",
+    "<extra_id_79>",
+    "<extra_id_80>",
+    "<extra_id_81>",
+    "<extra_id_82>",
+    "<extra_id_83>",
+    "<extra_id_84>",
+    "<extra_id_85>",
+    "<extra_id_86>",
+    "<extra_id_87>",
+    "<extra_id_88>",
+    "<extra_id_89>",
+    "<extra_id_90>",
+    "<extra_id_91>",
+    "<extra_id_92>",
+    "<extra_id_93>",
+    "<extra_id_94>",
+    "<extra_id_95>",
+    "<extra_id_96>",
+    "<extra_id_97>",
+    "<extra_id_98>",
+    "<extra_id_99>"
+  ],
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "extra_ids": 100,
+  "extra_special_tokens": {},
+  "model_max_length": 512,
+  "pad_token": "</s>",
+  "sp_model_kwargs": {},
+  "tokenizer_class": "T5Tokenizer",
+  "unk_token": "<unk>"
+}

checkpoint-100/trainer_state.json

@@ -0,0 +1,734 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 0.06916825177243645,
+  "eval_steps": 500,
+  "global_step": 100,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.0006916825177243646,
+      "grad_norm": 0.2954893708229065,
+      "learning_rate": 0.0,
+      "loss": 2.3812,
+      "step": 1
+    },
+    {
+      "epoch": 0.0013833650354487291,
+      "grad_norm": 0.3372870683670044,
+      "learning_rate": 1.3698630136986302e-06,
+      "loss": 2.6562,
+      "step": 2
+    },
+    {
+      "epoch": 0.0020750475531730937,
+      "grad_norm": 0.41708794236183167,
+      "learning_rate": 2.7397260273972604e-06,
+      "loss": 2.779,
+      "step": 3
+    },
+    {
+      "epoch": 0.0027667300708974583,
+      "grad_norm": 0.48284393548965454,
+      "learning_rate": 4.10958904109589e-06,
+      "loss": 2.83,
+      "step": 4
+    },
+    {
+      "epoch": 0.0034584125886218224,
+      "grad_norm": 0.328521728515625,
+      "learning_rate": 5.479452054794521e-06,
+      "loss": 2.3607,
+      "step": 5
+    },
+    {
+      "epoch": 0.004150095106346187,
+      "grad_norm": 0.3413754403591156,
+      "learning_rate": 6.849315068493151e-06,
+      "loss": 1.9744,
+      "step": 6
+    },
+    {
+      "epoch": 0.0048417776240705515,
+      "grad_norm": 0.43425995111465454,
+      "learning_rate": 8.21917808219178e-06,
+      "loss": 1.915,
+      "step": 7
+    },
+    {
+      "epoch": 0.0055334601417949165,
+      "grad_norm": 0.45184195041656494,
+      "learning_rate": 9.589041095890411e-06,
+      "loss": 2.0002,
+      "step": 8
+    },
+    {
+      "epoch": 0.006225142659519281,
+      "grad_norm": 0.3451146185398102,
+      "learning_rate": 1.0958904109589042e-05,
+      "loss": 2.5739,
+      "step": 9
+    },
+    {
+      "epoch": 0.006916825177243645,
+      "grad_norm": 0.39400503039360046,
+      "learning_rate": 1.2328767123287671e-05,
+      "loss": 2.6139,
+      "step": 10
+    },
+    {
+      "epoch": 0.00760850769496801,
+      "grad_norm": 0.4555888772010803,
+      "learning_rate": 1.3698630136986302e-05,
+      "loss": 2.4346,
+      "step": 11
+    },
+    {
+      "epoch": 0.008300190212692375,
+      "grad_norm": 0.5475619435310364,
+      "learning_rate": 1.5068493150684931e-05,
+      "loss": 1.485,
+      "step": 12
+    },
+    {
+      "epoch": 0.008991872730416739,
+      "grad_norm": 1.219076156616211,
+      "learning_rate": 1.643835616438356e-05,
+      "loss": 2.0555,
+      "step": 13
+    },
+    {
+      "epoch": 0.009683555248141103,
+      "grad_norm": 0.3271433711051941,
+      "learning_rate": 1.780821917808219e-05,
+      "loss": 2.8418,
+      "step": 14
+    },
+    {
+      "epoch": 0.010375237765865467,
+      "grad_norm": 0.3261394500732422,
+      "learning_rate": 1.9178082191780822e-05,
+      "loss": 2.287,
+      "step": 15
+    },
+    {
+      "epoch": 0.011066920283589833,
+      "grad_norm": 0.39713796973228455,
+      "learning_rate": 2.0547945205479453e-05,
+      "loss": 2.7331,
+      "step": 16
+    },
+    {
+      "epoch": 0.011758602801314197,
+      "grad_norm": 0.3226444125175476,
+      "learning_rate": 2.1917808219178083e-05,
+      "loss": 2.7307,
+      "step": 17
+    },
+    {
+      "epoch": 0.012450285319038561,
+      "grad_norm": 0.4153122007846832,
+      "learning_rate": 2.328767123287671e-05,
+      "loss": 2.3229,
+      "step": 18
+    },
+    {
+      "epoch": 0.013141967836762926,
+      "grad_norm": 0.29302462935447693,
+      "learning_rate": 2.4657534246575342e-05,
+      "loss": 2.2093,
+      "step": 19
+    },
+    {
+      "epoch": 0.01383365035448729,
+      "grad_norm": 0.42535701394081116,
+      "learning_rate": 2.6027397260273973e-05,
+      "loss": 2.3698,
+      "step": 20
+    },
+    {
+      "epoch": 0.014525332872211656,
+      "grad_norm": 0.33567023277282715,
+      "learning_rate": 2.7397260273972603e-05,
+      "loss": 2.6456,
+      "step": 21
+    },
+    {
+      "epoch": 0.01521701538993602,
+      "grad_norm": 0.37375620007514954,
+      "learning_rate": 2.8767123287671234e-05,
+      "loss": 2.4148,
+      "step": 22
+    },
+    {
+      "epoch": 0.015908697907660384,
+      "grad_norm": 0.2704203128814697,
+      "learning_rate": 3.0136986301369862e-05,
+      "loss": 1.6722,
+      "step": 23
+    },
+    {
+      "epoch": 0.01660038042538475,
+      "grad_norm": 0.3946782946586609,
+      "learning_rate": 3.1506849315068496e-05,
+      "loss": 2.6759,
+      "step": 24
+    },
+    {
+      "epoch": 0.017292062943109112,
+      "grad_norm": 0.368335098028183,
+      "learning_rate": 3.287671232876712e-05,
+      "loss": 2.6882,
+      "step": 25
+    },
+    {
+      "epoch": 0.017983745460833478,
+      "grad_norm": 0.38029783964157104,
+      "learning_rate": 3.424657534246575e-05,
+      "loss": 2.6915,
+      "step": 26
+    },
+    {
+      "epoch": 0.01867542797855784,
+      "grad_norm": 0.36253222823143005,
+      "learning_rate": 3.561643835616438e-05,
+      "loss": 2.1426,
+      "step": 27
+    },
+    {
+      "epoch": 0.019367110496282206,
+      "grad_norm": 0.35769322514533997,
+      "learning_rate": 3.698630136986301e-05,
+      "loss": 2.6634,
+      "step": 28
+    },
+    {
+      "epoch": 0.020058793014006572,
+      "grad_norm": 0.44577229022979736,
+      "learning_rate": 3.8356164383561644e-05,
+      "loss": 2.5996,
+      "step": 29
+    },
+    {
+      "epoch": 0.020750475531730934,
+      "grad_norm": 0.5225628614425659,
+      "learning_rate": 3.9726027397260274e-05,
+      "loss": 2.5993,
+      "step": 30
+    },
+    {
+      "epoch": 0.0214421580494553,
+      "grad_norm": 0.45649707317352295,
+      "learning_rate": 4.1095890410958905e-05,
+      "loss": 2.3344,
+      "step": 31
+    },
+    {
+      "epoch": 0.022133840567179666,
+      "grad_norm": 0.31408172845840454,
+      "learning_rate": 4.2465753424657536e-05,
+      "loss": 2.343,
+      "step": 32
+    },
+    {
+      "epoch": 0.02282552308490403,
+      "grad_norm": 0.3498693108558655,
+      "learning_rate": 4.383561643835617e-05,
+      "loss": 1.7196,
+      "step": 33
+    },
+    {
+      "epoch": 0.023517205602628394,
+      "grad_norm": 0.5255292654037476,
+      "learning_rate": 4.520547945205479e-05,
+      "loss": 1.5354,
+      "step": 34
+    },
+    {
+      "epoch": 0.024208888120352757,
+      "grad_norm": 0.3460487425327301,
+      "learning_rate": 4.657534246575342e-05,
+      "loss": 2.1435,
+      "step": 35
+    },
+    {
+      "epoch": 0.024900570638077123,
+      "grad_norm": 0.47466233372688293,
+      "learning_rate": 4.794520547945205e-05,
+      "loss": 2.7025,
+      "step": 36
+    },
+    {
+      "epoch": 0.02559225315580149,
+      "grad_norm": 0.39667466282844543,
+      "learning_rate": 4.9315068493150684e-05,
+      "loss": 2.2736,
+      "step": 37
+    },
+    {
+      "epoch": 0.02628393567352585,
+      "grad_norm": 0.40798133611679077,
+      "learning_rate": 5.068493150684932e-05,
+      "loss": 1.4074,
+      "step": 38
+    },
+    {
+      "epoch": 0.026975618191250217,
+      "grad_norm": 0.39603471755981445,
+      "learning_rate": 5.2054794520547945e-05,
+      "loss": 2.4354,
+      "step": 39
+    },
+    {
+      "epoch": 0.02766730070897458,
+      "grad_norm": 0.5650593042373657,
+      "learning_rate": 5.342465753424658e-05,
+      "loss": 1.7307,
+      "step": 40
+    },
+    {
+      "epoch": 0.028358983226698945,
+      "grad_norm": 0.7711919546127319,
+      "learning_rate": 5.479452054794521e-05,
+      "loss": 1.2067,
+      "step": 41
+    },
+    {
+      "epoch": 0.02905066574442331,
+      "grad_norm": 0.46603119373321533,
+      "learning_rate": 5.616438356164384e-05,
+      "loss": 1.0539,
+      "step": 42
+    },
+    {
+      "epoch": 0.029742348262147673,
+      "grad_norm": 0.2997550666332245,
+      "learning_rate": 5.753424657534247e-05,
+      "loss": 1.9997,
+      "step": 43
+    },
+    {
+      "epoch": 0.03043403077987204,
+      "grad_norm": 0.4058617651462555,
+      "learning_rate": 5.89041095890411e-05,
+      "loss": 2.3323,
+      "step": 44
+    },
+    {
+      "epoch": 0.0311257132975964,
+      "grad_norm": 0.3763635754585266,
+      "learning_rate": 6.0273972602739724e-05,
+      "loss": 1.8749,
+      "step": 45
+    },
+    {
+      "epoch": 0.03181739581532077,
+      "grad_norm": 0.3507993221282959,
+      "learning_rate": 6.164383561643835e-05,
+      "loss": 2.3828,
+      "step": 46
+    },
+    {
+      "epoch": 0.03250907833304513,
+      "grad_norm": 0.34240859746932983,
+      "learning_rate": 6.301369863013699e-05,
+      "loss": 2.3809,
+      "step": 47
+    },
+    {
+      "epoch": 0.0332007608507695,
+      "grad_norm": 0.4183844029903412,
+      "learning_rate": 6.438356164383562e-05,
+      "loss": 2.2065,
+      "step": 48
+    },
+    {
+      "epoch": 0.03389244336849386,
+      "grad_norm": 0.5209120512008667,
+      "learning_rate": 6.575342465753424e-05,
+      "loss": 2.061,
+      "step": 49
+    },
+    {
+      "epoch": 0.034584125886218224,
+      "grad_norm": 0.6568111181259155,
+      "learning_rate": 6.712328767123288e-05,
+      "loss": 2.1576,
+      "step": 50
+    },
+    {
+      "epoch": 0.03527580840394259,
+      "grad_norm": 0.5327390432357788,
+      "learning_rate": 6.84931506849315e-05,
+      "loss": 1.5562,
+      "step": 51
+    },
+    {
+      "epoch": 0.035967490921666956,
+      "grad_norm": 0.6389997005462646,
+      "learning_rate": 6.986301369863014e-05,
+      "loss": 2.3966,
+      "step": 52
+    },
+    {
+      "epoch": 0.03665917343939132,
+      "grad_norm": 0.6374388933181763,
+      "learning_rate": 7.123287671232876e-05,
+      "loss": 2.4013,
+      "step": 53
+    },
+    {
+      "epoch": 0.03735085595711568,
+      "grad_norm": 0.4383719563484192,
+      "learning_rate": 7.26027397260274e-05,
+      "loss": 2.061,
+      "step": 54
+    },
+    {
+      "epoch": 0.03804253847484005,
+      "grad_norm": 0.4306814670562744,
+      "learning_rate": 7.397260273972603e-05,
+      "loss": 2.4931,
+      "step": 55
+    },
+    {
+      "epoch": 0.03873422099256441,
+      "grad_norm": 0.5693032145500183,
+      "learning_rate": 7.534246575342466e-05,
+      "loss": 2.2842,
+      "step": 56
+    },
+    {
+      "epoch": 0.039425903510288775,
+      "grad_norm": 0.7792916297912598,
+      "learning_rate": 7.671232876712329e-05,
+      "loss": 1.8452,
+      "step": 57
+    },
+    {
+      "epoch": 0.040117586028013144,
+      "grad_norm": 0.4936494827270508,
+      "learning_rate": 7.808219178082192e-05,
+      "loss": 1.8668,
+      "step": 58
+    },
+    {
+      "epoch": 0.040809268545737507,
+      "grad_norm": 0.49626269936561584,
+      "learning_rate": 7.945205479452055e-05,
+      "loss": 1.9564,
+      "step": 59
+    },
+    {
+      "epoch": 0.04150095106346187,
+      "grad_norm": 0.4702766537666321,
+      "learning_rate": 8.082191780821919e-05,
+      "loss": 2.419,
+      "step": 60
+    },
+    {
+      "epoch": 0.04219263358118624,
+      "grad_norm": 0.6959900259971619,
+      "learning_rate": 8.219178082191781e-05,
+      "loss": 1.5835,
+      "step": 61
+    },
+    {
+      "epoch": 0.0428843160989106,
+      "grad_norm": 0.5963976979255676,
+      "learning_rate": 8.356164383561645e-05,
+      "loss": 2.2932,
+      "step": 62
+    },
+    {
+      "epoch": 0.04357599861663496,
+      "grad_norm": 0.4605785310268402,
+      "learning_rate": 8.493150684931507e-05,
+      "loss": 2.397,
+      "step": 63
+    },
+    {
+      "epoch": 0.04426768113435933,
+      "grad_norm": 0.4479796588420868,
+      "learning_rate": 8.630136986301371e-05,
+      "loss": 2.0257,
+      "step": 64
+    },
+    {
+      "epoch": 0.044959363652083695,
+      "grad_norm": 0.4342099726200104,
+      "learning_rate": 8.767123287671233e-05,
+      "loss": 1.9476,
+      "step": 65
+    },
+    {
+      "epoch": 0.04565104616980806,
+      "grad_norm": 0.44643279910087585,
+      "learning_rate": 8.904109589041096e-05,
+      "loss": 2.4669,
+      "step": 66
+    },
+    {
+      "epoch": 0.04634272868753242,
+      "grad_norm": 0.513254702091217,
+      "learning_rate": 9.041095890410958e-05,
+      "loss": 2.2581,
+      "step": 67
+    },
+    {
+      "epoch": 0.04703441120525679,
+      "grad_norm": 0.6621958613395691,
+      "learning_rate": 9.178082191780822e-05,
+      "loss": 1.3013,
+      "step": 68
+    },
+    {
+      "epoch": 0.04772609372298115,
+      "grad_norm": 0.43388229608535767,
+      "learning_rate": 9.315068493150684e-05,
+      "loss": 2.5325,
+      "step": 69
+    },
+    {
+      "epoch": 0.048417776240705514,
+      "grad_norm": 0.539757490158081,
+      "learning_rate": 9.452054794520548e-05,
+      "loss": 1.76,
+      "step": 70
+    },
+    {
+      "epoch": 0.04910945875842988,
+      "grad_norm": 0.33598029613494873,
+      "learning_rate": 9.58904109589041e-05,
+      "loss": 1.6931,
+      "step": 71
+    },
+    {
+      "epoch": 0.049801141276154245,
+      "grad_norm": 0.8661749958992004,
+      "learning_rate": 9.726027397260274e-05,
+      "loss": 2.1326,
+      "step": 72
+    },
+    {
+      "epoch": 0.05049282379387861,
+      "grad_norm": 0.5956202149391174,
+      "learning_rate": 9.863013698630137e-05,
+      "loss": 2.0554,
+      "step": 73
+    },
+    {
+      "epoch": 0.05118450631160298,
+      "grad_norm": 0.7723128199577332,
+      "learning_rate": 0.0001,
+      "loss": 1.4837,
+      "step": 74
+    },
+    {
+      "epoch": 0.05187618882932734,
+      "grad_norm": 0.5357879996299744,
+      "learning_rate": 9.992716678805537e-05,
+      "loss": 2.1688,
+      "step": 75
+    },
+    {
+      "epoch": 0.0525678713470517,
+      "grad_norm": 0.48623108863830566,
+      "learning_rate": 9.985433357611071e-05,
+      "loss": 2.1567,
+      "step": 76
+    },
+    {
+      "epoch": 0.053259553864776064,
+      "grad_norm": 0.4244164228439331,
+      "learning_rate": 9.978150036416607e-05,
+      "loss": 1.8235,
+      "step": 77
+    },
+    {
+      "epoch": 0.053951236382500434,
+      "grad_norm": 0.6056337356567383,
+      "learning_rate": 9.970866715222141e-05,
+      "loss": 2.0154,
+      "step": 78
+    },
+    {
+      "epoch": 0.054642918900224796,
+      "grad_norm": 0.5280382037162781,
+      "learning_rate": 9.963583394027677e-05,
+      "loss": 1.9959,
+      "step": 79
+    },
+    {
+      "epoch": 0.05533460141794916,
+      "grad_norm": 0.44745901226997375,
+      "learning_rate": 9.956300072833212e-05,
+      "loss": 1.2171,
+      "step": 80
+    },
+    {
+      "epoch": 0.05602628393567353,
+      "grad_norm": 0.7180289030075073,
+      "learning_rate": 9.949016751638748e-05,
+      "loss": 1.7036,
+      "step": 81
+    },
+    {
+      "epoch": 0.05671796645339789,
+      "grad_norm": 0.6465222239494324,
+      "learning_rate": 9.941733430444284e-05,
+      "loss": 1.8992,
+      "step": 82
+    },
+    {
+      "epoch": 0.05740964897112225,
+      "grad_norm": 0.4792153239250183,
+      "learning_rate": 9.934450109249819e-05,
+      "loss": 2.0712,
+      "step": 83
+    },
+    {
+      "epoch": 0.05810133148884662,
+      "grad_norm": 0.47839808464050293,
+      "learning_rate": 9.927166788055353e-05,
+      "loss": 1.7548,
+      "step": 84
+    },
+    {
+      "epoch": 0.058793014006570984,
+      "grad_norm": 0.7118557095527649,
+      "learning_rate": 9.919883466860888e-05,
+      "loss": 1.5835,
+      "step": 85
+    },
+    {
+      "epoch": 0.05948469652429535,
+      "grad_norm": 0.5179592370986938,
+      "learning_rate": 9.912600145666424e-05,
+      "loss": 1.621,
+      "step": 86
+    },
+    {
+      "epoch": 0.060176379042019716,
+      "grad_norm": 0.9235703349113464,
+      "learning_rate": 9.905316824471959e-05,
+      "loss": 0.8581,
+      "step": 87
+    },
+    {
+      "epoch": 0.06086806155974408,
+      "grad_norm": 0.8734163045883179,
+      "learning_rate": 9.898033503277495e-05,
+      "loss": 2.2878,
+      "step": 88
+    },
+    {
+      "epoch": 0.06155974407746844,
+      "grad_norm": 0.45049625635147095,
+      "learning_rate": 9.890750182083031e-05,
+      "loss": 2.2186,
+      "step": 89
+    },
+    {
+      "epoch": 0.0622514265951928,
+      "grad_norm": 0.6119429469108582,
+      "learning_rate": 9.883466860888566e-05,
+      "loss": 2.2461,
+      "step": 90
+    },
+    {
+      "epoch": 0.06294310911291717,
+      "grad_norm": 0.5095340013504028,
+      "learning_rate": 9.876183539694101e-05,
+      "loss": 2.2954,
+      "step": 91
+    },
+    {
+      "epoch": 0.06363479163064154,
+      "grad_norm": 0.6094918251037598,
+      "learning_rate": 9.868900218499635e-05,
+      "loss": 2.3478,
+      "step": 92
+    },
+    {
+      "epoch": 0.0643264741483659,
+      "grad_norm": 1.8420301675796509,
+      "learning_rate": 9.861616897305172e-05,
+      "loss": 2.213,
+      "step": 93
+    },
+    {
+      "epoch": 0.06501815666609026,
+      "grad_norm": 0.6151532530784607,
+      "learning_rate": 9.854333576110706e-05,
+      "loss": 1.8737,
+      "step": 94
+    },
+    {
+      "epoch": 0.06570983918381462,
+      "grad_norm": 0.5210903286933899,
+      "learning_rate": 9.847050254916242e-05,
+      "loss": 2.019,
+      "step": 95
+    },
+    {
+      "epoch": 0.066401521701539,
+      "grad_norm": 0.535746693611145,
+      "learning_rate": 9.839766933721779e-05,
+      "loss": 2.399,
+      "step": 96
+    },
+    {
+      "epoch": 0.06709320421926336,
+      "grad_norm": 0.8154505491256714,
+      "learning_rate": 9.832483612527313e-05,
+      "loss": 1.9442,
+      "step": 97
+    },
+    {
+      "epoch": 0.06778488673698772,
+      "grad_norm": 0.521247923374176,
+      "learning_rate": 9.825200291332848e-05,
+      "loss": 2.5264,
+      "step": 98
+    },
+    {
+      "epoch": 0.06847656925471209,
+      "grad_norm": 0.41544124484062195,
+      "learning_rate": 9.817916970138383e-05,
+      "loss": 1.8267,
+      "step": 99
+    },
+    {
+      "epoch": 0.06916825177243645,
+      "grad_norm": 0.538253128528595,
+      "learning_rate": 9.810633648943919e-05,
+      "loss": 1.6463,
+      "step": 100
+    }
+  ],
+  "logging_steps": 1,
+  "max_steps": 1446,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 1,
+  "save_steps": 50,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 3239229827579904.0,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-100/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd0007b27af53a6cc2b8b24995f12ecaf3b58e0bc65f0dc96a6c7563d56724d8
+size 5432