Forced push from Callback: Step 17000

checkpoint-17000/README.md

@@ -0,0 +1,206 @@
+---
+base_model: mohammed525671/final_arabic_grammarly_2
+library_name: peft
+tags:
+- base_model:adapter:mohammed525671/final_arabic_grammarly_2
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.19.1

checkpoint-17000/adapter_config.json

@@ -0,0 +1,43 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "mohammed525671/final_arabic_grammarly_2",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "peft_version": "0.19.1",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "v",
+    "q"
+  ],
+  "target_parameters": null,
+  "task_type": "SEQ_2_SEQ_LM",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

checkpoint-17000/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dc013a5f6885d8c22be0574989cc362bdbf01a7bc264c5cb49bbf7c9f1c4d3a2
+size 7098016

checkpoint-17000/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c12cd52bb1eb660779b430e0fe867a369f9ec837ca0467eae444630d155d12f3
+size 14279243

checkpoint-17000/rng_state.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed6c8a87f86a4bb0dd8f8a0404df295186e499289238a2655f23f774fe76a39b
+size 14645

checkpoint-17000/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f2884010ceb3fb85d97b60898ce2597684f8f1549d4c75d5f9fb08c87a0f8fa0
+size 1465

checkpoint-17000/tokenizer_config.json

@@ -0,0 +1,16 @@
+{
+  "backend": "tokenizers",
+  "eos_token": "</s>",
+  "extra_ids": 0,
+  "extra_special_tokens": [
+    "<pad>",
+    "</s>"
+  ],
+  "is_local": false,
+  "local_files_only": false,
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "tokenizer_class": "T5Tokenizer",
+  "unk_id": 2,
+  "unk_token": "<unk>"
+}

checkpoint-17000/trainer_state.json

@@ -0,0 +1,1411 @@
+{
+  "best_global_step": 16000,
+  "best_metric": 0.29995807718830964,
+  "best_model_checkpoint": "/content/lora_checkpoints/checkpoint-16000",
+  "epoch": 1.9887693027608797,
+  "eval_steps": 1000,
+  "global_step": 17000,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.01169864295741694,
+      "grad_norm": 0.17465531826019287,
+      "learning_rate": 3.960000000000001e-05,
+      "loss": 0.8288492584228515,
+      "step": 100
+    },
+    {
+      "epoch": 0.02339728591483388,
+      "grad_norm": 0.10292098671197891,
+      "learning_rate": 7.960000000000001e-05,
+      "loss": 0.8100727844238281,
+      "step": 200
+    },
+    {
+      "epoch": 0.03509592887225082,
+      "grad_norm": 0.7526177763938904,
+      "learning_rate": 0.00011960000000000001,
+      "loss": 0.6363310241699218,
+      "step": 300
+    },
+    {
+      "epoch": 0.04679457182966776,
+      "grad_norm": 0.13997608423233032,
+      "learning_rate": 0.0001596,
+      "loss": 0.667275161743164,
+      "step": 400
+    },
+    {
+      "epoch": 0.0584932147870847,
+      "grad_norm": 0.435800701379776,
+      "learning_rate": 0.0001996,
+      "loss": 0.666079330444336,
+      "step": 500
+    },
+    {
+      "epoch": 0.07019185774450164,
+      "grad_norm": 0.29729676246643066,
+      "learning_rate": 0.0001988069414316703,
+      "loss": 0.7561639404296875,
+      "step": 600
+    },
+    {
+      "epoch": 0.08189050070191858,
+      "grad_norm": 0.5007213354110718,
+      "learning_rate": 0.00019760183176669078,
+      "loss": 0.9136177825927735,
+      "step": 700
+    },
+    {
+      "epoch": 0.09358914365933552,
+      "grad_norm": 0.3354756832122803,
+      "learning_rate": 0.00019639672210171127,
+      "loss": 0.7920448303222656,
+      "step": 800
+    },
+    {
+      "epoch": 0.10528778661675246,
+      "grad_norm": 0.2753271460533142,
+      "learning_rate": 0.00019519161243673175,
+      "loss": 0.7825648498535156,
+      "step": 900
+    },
+    {
+      "epoch": 0.1169864295741694,
+      "grad_norm": 0.2488747239112854,
+      "learning_rate": 0.00019398650277175223,
+      "loss": 0.8908327484130859,
+      "step": 1000
+    },
+    {
+      "epoch": 0.1169864295741694,
+      "eval_bleu": 14.159322048476906,
+      "eval_chrf++": 37.25199978938141,
+      "eval_gleu": 0.29527796770330317,
+      "eval_loss": 0.13655707240104675,
+      "eval_runtime": 3076.623,
+      "eval_samples_per_second": 8.126,
+      "eval_steps_per_second": 1.016,
+      "step": 1000
+    },
+    {
+      "epoch": 0.12868507253158634,
+      "grad_norm": 0.30232590436935425,
+      "learning_rate": 0.00019278139310677272,
+      "loss": 0.7722515106201172,
+      "step": 1100
+    },
+    {
+      "epoch": 0.14038371548900327,
+      "grad_norm": 0.38113218545913696,
+      "learning_rate": 0.00019157628344179323,
+      "loss": 0.761008529663086,
+      "step": 1200
+    },
+    {
+      "epoch": 0.1520823584464202,
+      "grad_norm": 0.833577036857605,
+      "learning_rate": 0.0001903711737768137,
+      "loss": 0.729088134765625,
+      "step": 1300
+    },
+    {
+      "epoch": 0.16378100140383717,
+      "grad_norm": 0.27296575903892517,
+      "learning_rate": 0.0001891660641118342,
+      "loss": 0.7132440948486328,
+      "step": 1400
+    },
+    {
+      "epoch": 0.1754796443612541,
+      "grad_norm": 0.43808019161224365,
+      "learning_rate": 0.00018796095444685468,
+      "loss": 0.7673744964599609,
+      "step": 1500
+    },
+    {
+      "epoch": 0.18717828731867103,
+      "grad_norm": 0.5978686213493347,
+      "learning_rate": 0.00018675584478187516,
+      "loss": 0.7649851989746094,
+      "step": 1600
+    },
+    {
+      "epoch": 0.19887693027608797,
+      "grad_norm": 0.27942633628845215,
+      "learning_rate": 0.00018555073511689564,
+      "loss": 0.73284912109375,
+      "step": 1700
+    },
+    {
+      "epoch": 0.21057557323350493,
+      "grad_norm": 0.7221409678459167,
+      "learning_rate": 0.00018434562545191613,
+      "loss": 0.8051951599121093,
+      "step": 1800
+    },
+    {
+      "epoch": 0.22227421619092186,
+      "grad_norm": 0.5762982964515686,
+      "learning_rate": 0.00018314051578693664,
+      "loss": 0.7878440856933594,
+      "step": 1900
+    },
+    {
+      "epoch": 0.2339728591483388,
+      "grad_norm": 0.5500592589378357,
+      "learning_rate": 0.0001819354061219571,
+      "loss": 0.7237545013427734,
+      "step": 2000
+    },
+    {
+      "epoch": 0.2339728591483388,
+      "eval_bleu": 14.170822767293767,
+      "eval_chrf++": 37.26464042738157,
+      "eval_gleu": 0.29572456761353044,
+      "eval_loss": 0.1321471929550171,
+      "eval_runtime": 3046.6444,
+      "eval_samples_per_second": 8.206,
+      "eval_steps_per_second": 1.026,
+      "step": 2000
+    },
+    {
+      "epoch": 0.24567150210575572,
+      "grad_norm": 0.24421566724777222,
+      "learning_rate": 0.00018073029645697758,
+      "loss": 0.8127301025390625,
+      "step": 2100
+    },
+    {
+      "epoch": 0.2573701450631727,
+      "grad_norm": 0.4300897419452667,
+      "learning_rate": 0.0001795251867919981,
+      "loss": 0.7431999206542969,
+      "step": 2200
+    },
+    {
+      "epoch": 0.2690687880205896,
+      "grad_norm": 0.4674065411090851,
+      "learning_rate": 0.00017832007712701857,
+      "loss": 0.7770858764648437,
+      "step": 2300
+    },
+    {
+      "epoch": 0.28076743097800655,
+      "grad_norm": 0.3334859311580658,
+      "learning_rate": 0.00017711496746203905,
+      "loss": 0.7566382598876953,
+      "step": 2400
+    },
+    {
+      "epoch": 0.2924660739354235,
+      "grad_norm": 0.5279520153999329,
+      "learning_rate": 0.00017590985779705954,
+      "loss": 0.7609191131591797,
+      "step": 2500
+    },
+    {
+      "epoch": 0.3041647168928404,
+      "grad_norm": 0.40749409794807434,
+      "learning_rate": 0.00017470474813208002,
+      "loss": 0.8018978118896485,
+      "step": 2600
+    },
+    {
+      "epoch": 0.3158633598502574,
+      "grad_norm": 0.5021436214447021,
+      "learning_rate": 0.0001734996384671005,
+      "loss": 0.704549560546875,
+      "step": 2700
+    },
+    {
+      "epoch": 0.32756200280767434,
+      "grad_norm": 0.21254391968250275,
+      "learning_rate": 0.00017229452880212102,
+      "loss": 0.6860762786865234,
+      "step": 2800
+    },
+    {
+      "epoch": 0.33926064576509124,
+      "grad_norm": 0.5828664898872375,
+      "learning_rate": 0.0001710894191371415,
+      "loss": 0.7940917205810547,
+      "step": 2900
+    },
+    {
+      "epoch": 0.3509592887225082,
+      "grad_norm": 0.6279259920120239,
+      "learning_rate": 0.00016988430947216198,
+      "loss": 0.7563919830322265,
+      "step": 3000
+    },
+    {
+      "epoch": 0.3509592887225082,
+      "eval_bleu": 14.190561307729688,
+      "eval_chrf++": 37.282843281422906,
+      "eval_gleu": 0.2959946351903762,
+      "eval_loss": 0.1300257444381714,
+      "eval_runtime": 3028.8248,
+      "eval_samples_per_second": 8.254,
+      "eval_steps_per_second": 1.032,
+      "step": 3000
+    },
+    {
+      "epoch": 0.3626579316799251,
+      "grad_norm": 0.49756914377212524,
+      "learning_rate": 0.00016867919980718247,
+      "loss": 0.7388571929931641,
+      "step": 3100
+    },
+    {
+      "epoch": 0.37435657463734207,
+      "grad_norm": 0.2790064513683319,
+      "learning_rate": 0.00016747409014220295,
+      "loss": 0.8041506958007812,
+      "step": 3200
+    },
+    {
+      "epoch": 0.386055217594759,
+      "grad_norm": 0.4176758825778961,
+      "learning_rate": 0.00016626898047722343,
+      "loss": 0.7459670257568359,
+      "step": 3300
+    },
+    {
+      "epoch": 0.39775386055217593,
+      "grad_norm": 0.643490731716156,
+      "learning_rate": 0.00016506387081224392,
+      "loss": 0.7993578338623046,
+      "step": 3400
+    },
+    {
+      "epoch": 0.4094525035095929,
+      "grad_norm": 0.4160093665122986,
+      "learning_rate": 0.00016385876114726443,
+      "loss": 0.7083788299560547,
+      "step": 3500
+    },
+    {
+      "epoch": 0.42115114646700985,
+      "grad_norm": 0.5131481289863586,
+      "learning_rate": 0.00016265365148228488,
+      "loss": 0.7386051177978515,
+      "step": 3600
+    },
+    {
+      "epoch": 0.43284978942442676,
+      "grad_norm": 0.34466978907585144,
+      "learning_rate": 0.00016144854181730537,
+      "loss": 0.7423291778564454,
+      "step": 3700
+    },
+    {
+      "epoch": 0.4445484323818437,
+      "grad_norm": 0.3849602937698364,
+      "learning_rate": 0.00016024343215232588,
+      "loss": 0.7886087799072266,
+      "step": 3800
+    },
+    {
+      "epoch": 0.4562470753392606,
+      "grad_norm": 1.0863958597183228,
+      "learning_rate": 0.00015903832248734636,
+      "loss": 0.7084539031982422,
+      "step": 3900
+    },
+    {
+      "epoch": 0.4679457182966776,
+      "grad_norm": 0.5512566566467285,
+      "learning_rate": 0.00015783321282236684,
+      "loss": 0.7262689208984375,
+      "step": 4000
+    },
+    {
+      "epoch": 0.4679457182966776,
+      "eval_bleu": 14.223643604859138,
+      "eval_chrf++": 37.31221944095716,
+      "eval_gleu": 0.29643493674629917,
+      "eval_loss": 0.13029149174690247,
+      "eval_runtime": 3029.0038,
+      "eval_samples_per_second": 8.254,
+      "eval_steps_per_second": 1.032,
+      "step": 4000
+    },
+    {
+      "epoch": 0.47964436125409454,
+      "grad_norm": 0.5066221356391907,
+      "learning_rate": 0.00015662810315738733,
+      "loss": 0.7101921844482422,
+      "step": 4100
+    },
+    {
+      "epoch": 0.49134300421151145,
+      "grad_norm": 0.25377070903778076,
+      "learning_rate": 0.0001554229934924078,
+      "loss": 0.8036322021484374,
+      "step": 4200
+    },
+    {
+      "epoch": 0.5030416471689284,
+      "grad_norm": 0.36515700817108154,
+      "learning_rate": 0.0001542178838274283,
+      "loss": 0.7672134399414062,
+      "step": 4300
+    },
+    {
+      "epoch": 0.5147402901263454,
+      "grad_norm": 0.5217819213867188,
+      "learning_rate": 0.00015301277416244878,
+      "loss": 0.7055610656738281,
+      "step": 4400
+    },
+    {
+      "epoch": 0.5264389330837623,
+      "grad_norm": 0.5822096467018127,
+      "learning_rate": 0.0001518076644974693,
+      "loss": 0.7314647674560547,
+      "step": 4500
+    },
+    {
+      "epoch": 0.5381375760411792,
+      "grad_norm": 0.35088884830474854,
+      "learning_rate": 0.00015060255483248977,
+      "loss": 0.7090898132324219,
+      "step": 4600
+    },
+    {
+      "epoch": 0.5498362189985961,
+      "grad_norm": 0.32798826694488525,
+      "learning_rate": 0.00014939744516751023,
+      "loss": 0.7123609161376954,
+      "step": 4700
+    },
+    {
+      "epoch": 0.5615348619560131,
+      "grad_norm": 0.36279675364494324,
+      "learning_rate": 0.00014819233550253074,
+      "loss": 0.6808916473388672,
+      "step": 4800
+    },
+    {
+      "epoch": 0.5732335049134301,
+      "grad_norm": 0.2988830506801605,
+      "learning_rate": 0.00014698722583755122,
+      "loss": 0.7374357604980468,
+      "step": 4900
+    },
+    {
+      "epoch": 0.584932147870847,
+      "grad_norm": 0.3163226246833801,
+      "learning_rate": 0.0001457821161725717,
+      "loss": 0.7219663238525391,
+      "step": 5000
+    },
+    {
+      "epoch": 0.584932147870847,
+      "eval_bleu": 14.478830100713067,
+      "eval_chrf++": 37.47970478737833,
+      "eval_gleu": 0.2988842723825056,
+      "eval_loss": 0.11943691223859787,
+      "eval_runtime": 1205.6734,
+      "eval_samples_per_second": 8.294,
+      "eval_steps_per_second": 1.037,
+      "step": 5000
+    },
+    {
+      "epoch": 0.5966307908282639,
+      "grad_norm": 0.31236299872398376,
+      "learning_rate": 0.00014457700650759222,
+      "loss": 0.8105551147460938,
+      "step": 5100
+    },
+    {
+      "epoch": 0.6083294337856808,
+      "grad_norm": 0.7482622265815735,
+      "learning_rate": 0.00014337189684261267,
+      "loss": 0.7455428314208984,
+      "step": 5200
+    },
+    {
+      "epoch": 0.6200280767430978,
+      "grad_norm": 0.6311819553375244,
+      "learning_rate": 0.00014216678717763316,
+      "loss": 0.7499707794189453,
+      "step": 5300
+    },
+    {
+      "epoch": 0.6317267197005147,
+      "grad_norm": 0.34233975410461426,
+      "learning_rate": 0.00014096167751265367,
+      "loss": 0.7408732604980469,
+      "step": 5400
+    },
+    {
+      "epoch": 0.6434253626579317,
+      "grad_norm": 0.3610491454601288,
+      "learning_rate": 0.00013975656784767415,
+      "loss": 0.7493981170654297,
+      "step": 5500
+    },
+    {
+      "epoch": 0.6551240056153487,
+      "grad_norm": 0.4709091782569885,
+      "learning_rate": 0.00013855145818269463,
+      "loss": 0.8191841125488282,
+      "step": 5600
+    },
+    {
+      "epoch": 0.6668226485727655,
+      "grad_norm": 0.5121857523918152,
+      "learning_rate": 0.00013734634851771512,
+      "loss": 0.6936610412597656,
+      "step": 5700
+    },
+    {
+      "epoch": 0.6785212915301825,
+      "grad_norm": 0.7599558234214783,
+      "learning_rate": 0.0001361412388527356,
+      "loss": 0.7444110107421875,
+      "step": 5800
+    },
+    {
+      "epoch": 0.6902199344875994,
+      "grad_norm": 0.6298537850379944,
+      "learning_rate": 0.00013493612918775608,
+      "loss": 0.7107616424560547,
+      "step": 5900
+    },
+    {
+      "epoch": 0.7019185774450164,
+      "grad_norm": 0.2870277762413025,
+      "learning_rate": 0.00013373101952277657,
+      "loss": 0.7334302520751953,
+      "step": 6000
+    },
+    {
+      "epoch": 0.7019185774450164,
+      "eval_bleu": 14.488435073289184,
+      "eval_chrf++": 37.48978876281374,
+      "eval_gleu": 0.2990189486794314,
+      "eval_loss": 0.11909547448158264,
+      "eval_runtime": 1214.3147,
+      "eval_samples_per_second": 8.235,
+      "eval_steps_per_second": 1.029,
+      "step": 6000
+    },
+    {
+      "epoch": 0.7136172204024334,
+      "grad_norm": 0.4360315203666687,
+      "learning_rate": 0.00013252590985779708,
+      "loss": 0.6945421600341797,
+      "step": 6100
+    },
+    {
+      "epoch": 0.7253158633598502,
+      "grad_norm": 0.3737637996673584,
+      "learning_rate": 0.00013132080019281756,
+      "loss": 0.6860015869140625,
+      "step": 6200
+    },
+    {
+      "epoch": 0.7370145063172672,
+      "grad_norm": 0.49848639965057373,
+      "learning_rate": 0.00013011569052783802,
+      "loss": 0.6818071746826172,
+      "step": 6300
+    },
+    {
+      "epoch": 0.7487131492746841,
+      "grad_norm": 0.6076132655143738,
+      "learning_rate": 0.00012891058086285853,
+      "loss": 0.710874252319336,
+      "step": 6400
+    },
+    {
+      "epoch": 0.7604117922321011,
+      "grad_norm": 0.7525620460510254,
+      "learning_rate": 0.000127705471197879,
+      "loss": 0.7014482116699219,
+      "step": 6500
+    },
+    {
+      "epoch": 0.772110435189518,
+      "grad_norm": 0.48904329538345337,
+      "learning_rate": 0.0001265003615328995,
+      "loss": 0.7943169403076172,
+      "step": 6600
+    },
+    {
+      "epoch": 0.7838090781469349,
+      "grad_norm": 0.6170476675033569,
+      "learning_rate": 0.00012529525186792,
+      "loss": 0.77107177734375,
+      "step": 6700
+    },
+    {
+      "epoch": 0.7955077211043519,
+      "grad_norm": 0.6584415435791016,
+      "learning_rate": 0.00012409014220294046,
+      "loss": 0.7662942504882813,
+      "step": 6800
+    },
+    {
+      "epoch": 0.8072063640617688,
+      "grad_norm": 0.31831711530685425,
+      "learning_rate": 0.00012288503253796095,
+      "loss": 0.7174318695068359,
+      "step": 6900
+    },
+    {
+      "epoch": 0.8189050070191858,
+      "grad_norm": 0.37177735567092896,
+      "learning_rate": 0.00012167992287298144,
+      "loss": 0.6696205902099609,
+      "step": 7000
+    },
+    {
+      "epoch": 0.8189050070191858,
+      "eval_bleu": 14.5068510567031,
+      "eval_chrf++": 37.506118060519015,
+      "eval_gleu": 0.29926847210407215,
+      "eval_loss": 0.12007667124271393,
+      "eval_runtime": 1211.1951,
+      "eval_samples_per_second": 8.256,
+      "eval_steps_per_second": 1.032,
+      "step": 7000
+    },
+    {
+      "epoch": 0.8306036499766027,
+      "grad_norm": 0.8013473153114319,
+      "learning_rate": 0.00012047481320800194,
+      "loss": 0.7044999694824219,
+      "step": 7100
+    },
+    {
+      "epoch": 0.8423022929340197,
+      "grad_norm": 0.358571320772171,
+      "learning_rate": 0.00011926970354302242,
+      "loss": 0.7327379608154296,
+      "step": 7200
+    },
+    {
+      "epoch": 0.8540009358914366,
+      "grad_norm": 0.37857064604759216,
+      "learning_rate": 0.00011806459387804292,
+      "loss": 0.7405216979980469,
+      "step": 7300
+    },
+    {
+      "epoch": 0.8656995788488535,
+      "grad_norm": 0.45062392950057983,
+      "learning_rate": 0.00011685948421306339,
+      "loss": 0.8378986358642578,
+      "step": 7400
+    },
+    {
+      "epoch": 0.8773982218062705,
+      "grad_norm": 0.5343255400657654,
+      "learning_rate": 0.00011565437454808387,
+      "loss": 0.7547644805908204,
+      "step": 7500
+    },
+    {
+      "epoch": 0.8890968647636874,
+      "grad_norm": 0.8177404403686523,
+      "learning_rate": 0.00011444926488310437,
+      "loss": 0.7001251983642578,
+      "step": 7600
+    },
+    {
+      "epoch": 0.9007955077211044,
+      "grad_norm": 0.5869405269622803,
+      "learning_rate": 0.00011324415521812485,
+      "loss": 0.716758804321289,
+      "step": 7700
+    },
+    {
+      "epoch": 0.9124941506785212,
+      "grad_norm": 0.4506022036075592,
+      "learning_rate": 0.00011203904555314535,
+      "loss": 0.7107328796386718,
+      "step": 7800
+    },
+    {
+      "epoch": 0.9241927936359382,
+      "grad_norm": 0.2641665041446686,
+      "learning_rate": 0.00011083393588816582,
+      "loss": 0.7106300354003906,
+      "step": 7900
+    },
+    {
+      "epoch": 0.9358914365933552,
+      "grad_norm": 0.5322011709213257,
+      "learning_rate": 0.0001096288262231863,
+      "loss": 0.7510108184814454,
+      "step": 8000
+    },
+    {
+      "epoch": 0.9358914365933552,
+      "eval_bleu": 14.520449558878378,
+      "eval_chrf++": 37.51544173918585,
+      "eval_gleu": 0.29948060296940066,
+      "eval_loss": 0.11775639653205872,
+      "eval_runtime": 1214.3875,
+      "eval_samples_per_second": 8.235,
+      "eval_steps_per_second": 1.029,
+      "step": 8000
+    },
+    {
+      "epoch": 0.9475900795507721,
+      "grad_norm": 0.4723975360393524,
+      "learning_rate": 0.0001084237165582068,
+      "loss": 0.6648786163330078,
+      "step": 8100
+    },
+    {
+      "epoch": 0.9592887225081891,
+      "grad_norm": 0.42831510305404663,
+      "learning_rate": 0.00010721860689322729,
+      "loss": 0.6549470520019531,
+      "step": 8200
+    },
+    {
+      "epoch": 0.970987365465606,
+      "grad_norm": 0.388265460729599,
+      "learning_rate": 0.00010601349722824778,
+      "loss": 0.7303677368164062,
+      "step": 8300
+    },
+    {
+      "epoch": 0.9826860084230229,
+      "grad_norm": 0.5474498271942139,
+      "learning_rate": 0.00010480838756326828,
+      "loss": 0.8067118835449218,
+      "step": 8400
+    },
+    {
+      "epoch": 0.9943846513804399,
+      "grad_norm": 0.9511393308639526,
+      "learning_rate": 0.00010360327789828874,
+      "loss": 0.7670970153808594,
+      "step": 8500
+    },
+    {
+      "epoch": 1.0060832943378568,
+      "grad_norm": 0.2868870794773102,
+      "learning_rate": 0.00010239816823330923,
+      "loss": 0.6472264862060547,
+      "step": 8600
+    },
+    {
+      "epoch": 1.0177819372952737,
+      "grad_norm": 0.832443118095398,
+      "learning_rate": 0.00010119305856832973,
+      "loss": 0.669017333984375,
+      "step": 8700
+    },
+    {
+      "epoch": 1.0294805802526907,
+      "grad_norm": 0.2420782595872879,
+      "learning_rate": 9.998794890335021e-05,
+      "loss": 0.6649874877929688,
+      "step": 8800
+    },
+    {
+      "epoch": 1.0411792232101076,
+      "grad_norm": 0.5215428471565247,
+      "learning_rate": 9.87828392383707e-05,
+      "loss": 0.7587005615234375,
+      "step": 8900
+    },
+    {
+      "epoch": 1.0528778661675247,
+      "grad_norm": 0.8157791495323181,
+      "learning_rate": 9.757772957339118e-05,
+      "loss": 0.6947088623046875,
+      "step": 9000
+    },
+    {
+      "epoch": 1.0528778661675247,
+      "eval_bleu": 14.500393579414828,
+      "eval_chrf++": 37.49853705733522,
+      "eval_gleu": 0.29935044809948724,
+      "eval_loss": 0.11809124797582626,
+      "eval_runtime": 1215.2785,
+      "eval_samples_per_second": 8.229,
+      "eval_steps_per_second": 1.029,
+      "step": 9000
+    },
+    {
+      "epoch": 1.0645765091249415,
+      "grad_norm": 0.387218177318573,
+      "learning_rate": 9.637261990841166e-05,
+      "loss": 0.6912640380859375,
+      "step": 9100
+    },
+    {
+      "epoch": 1.0762751520823584,
+      "grad_norm": 1.0965436697006226,
+      "learning_rate": 9.516751024343216e-05,
+      "loss": 0.6768216705322265,
+      "step": 9200
+    },
+    {
+      "epoch": 1.0879737950397754,
+      "grad_norm": 0.6017298698425293,
+      "learning_rate": 9.396240057845264e-05,
+      "loss": 0.7039140319824219,
+      "step": 9300
+    },
+    {
+      "epoch": 1.0996724379971923,
+      "grad_norm": 0.4617173969745636,
+      "learning_rate": 9.275729091347313e-05,
+      "loss": 0.7260798645019532,
+      "step": 9400
+    },
+    {
+      "epoch": 1.1113710809546093,
+      "grad_norm": 0.7048476338386536,
+      "learning_rate": 9.155218124849362e-05,
+      "loss": 0.7394924926757812,
+      "step": 9500
+    },
+    {
+      "epoch": 1.1230697239120262,
+      "grad_norm": 0.5826933979988098,
+      "learning_rate": 9.034707158351411e-05,
+      "loss": 0.7072663116455078,
+      "step": 9600
+    },
+    {
+      "epoch": 1.134768366869443,
+      "grad_norm": 0.3691169023513794,
+      "learning_rate": 8.914196191853459e-05,
+      "loss": 0.6494306945800781,
+      "step": 9700
+    },
+    {
+      "epoch": 1.1464670098268601,
+      "grad_norm": 0.47712188959121704,
+      "learning_rate": 8.793685225355507e-05,
+      "loss": 0.6558272552490234,
+      "step": 9800
+    },
+    {
+      "epoch": 1.158165652784277,
+      "grad_norm": 0.9774093627929688,
+      "learning_rate": 8.673174258857556e-05,
+      "loss": 0.7194374084472657,
+      "step": 9900
+    },
+    {
+      "epoch": 1.169864295741694,
+      "grad_norm": 0.3435943126678467,
+      "learning_rate": 8.552663292359605e-05,
+      "loss": 0.6887811279296875,
+      "step": 10000
+    },
+    {
+      "epoch": 1.169864295741694,
+      "eval_bleu": 14.523754720604463,
+      "eval_chrf++": 37.52024827868022,
+      "eval_gleu": 0.2996251395928957,
+      "eval_loss": 0.11600016057491302,
+      "eval_runtime": 1218.0271,
+      "eval_samples_per_second": 8.21,
+      "eval_steps_per_second": 1.026,
+      "step": 10000
+    },
+    {
+      "epoch": 1.1815629386991109,
+      "grad_norm": 0.6822844743728638,
+      "learning_rate": 8.432152325861654e-05,
+      "loss": 0.6329551696777344,
+      "step": 10100
+    },
+    {
+      "epoch": 1.193261581656528,
+      "grad_norm": 0.4269537329673767,
+      "learning_rate": 8.311641359363702e-05,
+      "loss": 0.6722025299072265,
+      "step": 10200
+    },
+    {
+      "epoch": 1.2049602246139448,
+      "grad_norm": 0.4388682246208191,
+      "learning_rate": 8.191130392865752e-05,
+      "loss": 0.670188980102539,
+      "step": 10300
+    },
+    {
+      "epoch": 1.2166588675713617,
+      "grad_norm": 0.47956228256225586,
+      "learning_rate": 8.0706194263678e-05,
+      "loss": 0.7441038513183593,
+      "step": 10400
+    },
+    {
+      "epoch": 1.2283575105287787,
+      "grad_norm": 0.8559459447860718,
+      "learning_rate": 7.950108459869849e-05,
+      "loss": 0.7326296997070313,
+      "step": 10500
+    },
+    {
+      "epoch": 1.2400561534861956,
+      "grad_norm": 0.7326633334159851,
+      "learning_rate": 7.829597493371897e-05,
+      "loss": 0.6727855682373047,
+      "step": 10600
+    },
+    {
+      "epoch": 1.2517547964436124,
+      "grad_norm": 0.7285364866256714,
+      "learning_rate": 7.709086526873945e-05,
+      "loss": 0.6967699432373047,
+      "step": 10700
+    },
+    {
+      "epoch": 1.2634534394010295,
+      "grad_norm": 0.6713935732841492,
+      "learning_rate": 7.588575560375995e-05,
+      "loss": 0.6788345336914062,
+      "step": 10800
+    },
+    {
+      "epoch": 1.2751520823584463,
+      "grad_norm": 0.5959323048591614,
+      "learning_rate": 7.468064593878043e-05,
+      "loss": 0.7201693725585937,
+      "step": 10900
+    },
+    {
+      "epoch": 1.2868507253158634,
+      "grad_norm": 0.5355884432792664,
+      "learning_rate": 7.347553627380092e-05,
+      "loss": 0.7906954193115234,
+      "step": 11000
+    },
+    {
+      "epoch": 1.2868507253158634,
+      "eval_bleu": 14.53828038451814,
+      "eval_chrf++": 37.53020426993731,
+      "eval_gleu": 0.299763204427279,
+      "eval_loss": 0.11504543572664261,
+      "eval_runtime": 1213.9876,
+      "eval_samples_per_second": 8.237,
+      "eval_steps_per_second": 1.03,
+      "step": 11000
+    },
+    {
+      "epoch": 1.2985493682732803,
+      "grad_norm": 0.4787856936454773,
+      "learning_rate": 7.22704266088214e-05,
+      "loss": 0.6870306396484375,
+      "step": 11100
+    },
+    {
+      "epoch": 1.3102480112306973,
+      "grad_norm": 0.46248602867126465,
+      "learning_rate": 7.10653169438419e-05,
+      "loss": 0.7633894348144531,
+      "step": 11200
+    },
+    {
+      "epoch": 1.3219466541881142,
+      "grad_norm": 0.41607213020324707,
+      "learning_rate": 6.986020727886238e-05,
+      "loss": 0.7653987121582031,
+      "step": 11300
+    },
+    {
+      "epoch": 1.333645297145531,
+      "grad_norm": 0.8680844306945801,
+      "learning_rate": 6.865509761388286e-05,
+      "loss": 0.6899723052978516,
+      "step": 11400
+    },
+    {
+      "epoch": 1.345343940102948,
+      "grad_norm": 0.5581705570220947,
+      "learning_rate": 6.744998794890335e-05,
+      "loss": 0.7067771148681641,
+      "step": 11500
+    },
+    {
+      "epoch": 1.357042583060365,
+      "grad_norm": 0.6461847424507141,
+      "learning_rate": 6.624487828392384e-05,
+      "loss": 0.7375769805908203,
+      "step": 11600
+    },
+    {
+      "epoch": 1.3687412260177818,
+      "grad_norm": 0.40462443232536316,
+      "learning_rate": 6.503976861894433e-05,
+      "loss": 0.7069922637939453,
+      "step": 11700
+    },
+    {
+      "epoch": 1.3804398689751989,
+      "grad_norm": 0.9013503789901733,
+      "learning_rate": 6.383465895396481e-05,
+      "loss": 0.6799465942382813,
+      "step": 11800
+    },
+    {
+      "epoch": 1.392138511932616,
+      "grad_norm": 0.34807902574539185,
+      "learning_rate": 6.26295492889853e-05,
+      "loss": 0.6732534790039062,
+      "step": 11900
+    },
+    {
+      "epoch": 1.4038371548900328,
+      "grad_norm": 0.6756672859191895,
+      "learning_rate": 6.142443962400579e-05,
+      "loss": 0.6892965698242187,
+      "step": 12000
+    },
+    {
+      "epoch": 1.4038371548900328,
+      "eval_bleu": 14.54841929829885,
+      "eval_chrf++": 37.54267515113367,
+      "eval_gleu": 0.2999206846289975,
+      "eval_loss": 0.11491711437702179,
+      "eval_runtime": 1250.0551,
+      "eval_samples_per_second": 8.0,
+      "eval_steps_per_second": 1.0,
+      "step": 12000
+    },
+    {
+      "epoch": 1.4155357978474497,
+      "grad_norm": 0.915681004524231,
+      "learning_rate": 6.021932995902627e-05,
+      "loss": 0.6486312103271484,
+      "step": 12100
+    },
+    {
+      "epoch": 1.4272344408048667,
+      "grad_norm": 0.25071626901626587,
+      "learning_rate": 5.9014220294046766e-05,
+      "loss": 0.7008678436279296,
+      "step": 12200
+    },
+    {
+      "epoch": 1.4389330837622836,
+      "grad_norm": 1.296534538269043,
+      "learning_rate": 5.780911062906724e-05,
+      "loss": 0.6701705932617188,
+      "step": 12300
+    },
+    {
+      "epoch": 1.4506317267197004,
+      "grad_norm": 0.23513908684253693,
+      "learning_rate": 5.660400096408773e-05,
+      "loss": 0.6670191192626953,
+      "step": 12400
+    },
+    {
+      "epoch": 1.4623303696771175,
+      "grad_norm": 0.31218859553337097,
+      "learning_rate": 5.539889129910822e-05,
+      "loss": 0.7042135620117187,
+      "step": 12500
+    },
+    {
+      "epoch": 1.4740290126345343,
+      "grad_norm": 0.5226182341575623,
+      "learning_rate": 5.4193781634128706e-05,
+      "loss": 0.6547274780273438,
+      "step": 12600
+    },
+    {
+      "epoch": 1.4857276555919514,
+      "grad_norm": 0.5317768454551697,
+      "learning_rate": 5.2988671969149196e-05,
+      "loss": 0.6750004577636719,
+      "step": 12700
+    },
+    {
+      "epoch": 1.4974262985493683,
+      "grad_norm": 1.2140891551971436,
+      "learning_rate": 5.1783562304169687e-05,
+      "loss": 0.6759020233154297,
+      "step": 12800
+    },
+    {
+      "epoch": 1.5091249415067853,
+      "grad_norm": 1.6087536811828613,
+      "learning_rate": 5.057845263919016e-05,
+      "loss": 0.6786493682861328,
+      "step": 12900
+    },
+    {
+      "epoch": 1.5208235844642022,
+      "grad_norm": 0.6858401894569397,
+      "learning_rate": 4.9373342974210654e-05,
+      "loss": 0.6580669403076171,
+      "step": 13000
+    },
+    {
+      "epoch": 1.5208235844642022,
+      "eval_bleu": 14.54379160395645,
+      "eval_chrf++": 37.53861056390243,
+      "eval_gleu": 0.2999019883493414,
+      "eval_loss": 0.11569300293922424,
+      "eval_runtime": 1263.7603,
+      "eval_samples_per_second": 7.913,
+      "eval_steps_per_second": 0.989,
+      "step": 13000
+    },
+    {
+      "epoch": 1.532522227421619,
+      "grad_norm": 0.24844329059123993,
+      "learning_rate": 4.8168233309231144e-05,
+      "loss": 0.6728450012207031,
+      "step": 13100
+    },
+    {
+      "epoch": 1.544220870379036,
+      "grad_norm": 0.4155369699001312,
+      "learning_rate": 4.696312364425163e-05,
+      "loss": 0.6870063781738281,
+      "step": 13200
+    },
+    {
+      "epoch": 1.555919513336453,
+      "grad_norm": 0.6331890821456909,
+      "learning_rate": 4.575801397927212e-05,
+      "loss": 0.7015911865234375,
+      "step": 13300
+    },
+    {
+      "epoch": 1.5676181562938698,
+      "grad_norm": 1.9651973247528076,
+      "learning_rate": 4.45529043142926e-05,
+      "loss": 0.7413447570800781,
+      "step": 13400
+    },
+    {
+      "epoch": 1.5793167992512869,
+      "grad_norm": 0.8101264238357544,
+      "learning_rate": 4.334779464931309e-05,
+      "loss": 0.6737877655029297,
+      "step": 13500
+    },
+    {
+      "epoch": 1.591015442208704,
+      "grad_norm": 0.6638650298118591,
+      "learning_rate": 4.2142684984333575e-05,
+      "loss": 0.6960884094238281,
+      "step": 13600
+    },
+    {
+      "epoch": 1.6027140851661206,
+      "grad_norm": 0.5854291915893555,
+      "learning_rate": 4.0937575319354065e-05,
+      "loss": 0.6611504364013672,
+      "step": 13700
+    },
+    {
+      "epoch": 1.6144127281235376,
+      "grad_norm": 0.7677696347236633,
+      "learning_rate": 3.973246565437455e-05,
+      "loss": 0.6808192443847656,
+      "step": 13800
+    },
+    {
+      "epoch": 1.6261113710809547,
+      "grad_norm": 1.0709278583526611,
+      "learning_rate": 3.852735598939504e-05,
+      "loss": 0.6932936859130859,
+      "step": 13900
+    },
+    {
+      "epoch": 1.6378100140383716,
+      "grad_norm": 1.739449381828308,
+      "learning_rate": 3.732224632441552e-05,
+      "loss": 0.6909654998779297,
+      "step": 14000
+    },
+    {
+      "epoch": 1.6378100140383716,
+      "eval_bleu": 14.544812702203275,
+      "eval_chrf++": 37.54043872169369,
+      "eval_gleu": 0.2999048647000577,
+      "eval_loss": 0.11546756327152252,
+      "eval_runtime": 1253.3705,
+      "eval_samples_per_second": 7.978,
+      "eval_steps_per_second": 0.997,
+      "step": 14000
+    },
+    {
+      "epoch": 1.6495086569957884,
+      "grad_norm": 2.5099761486053467,
+      "learning_rate": 3.611713665943601e-05,
+      "loss": 0.65455810546875,
+      "step": 14100
+    },
+    {
+      "epoch": 1.6612072999532055,
+      "grad_norm": 1.5957136154174805,
+      "learning_rate": 3.4912026994456496e-05,
+      "loss": 0.6780166625976562,
+      "step": 14200
+    },
+    {
+      "epoch": 1.6729059429106223,
+      "grad_norm": 0.5432596206665039,
+      "learning_rate": 3.3706917329476986e-05,
+      "loss": 0.7031693267822265,
+      "step": 14300
+    },
+    {
+      "epoch": 1.6846045858680392,
+      "grad_norm": 0.7204278707504272,
+      "learning_rate": 3.250180766449747e-05,
+      "loss": 0.6511004638671875,
+      "step": 14400
+    },
+    {
+      "epoch": 1.6963032288254563,
+      "grad_norm": 0.5538216233253479,
+      "learning_rate": 3.129669799951796e-05,
+      "loss": 0.6823389434814453,
+      "step": 14500
+    },
+    {
+      "epoch": 1.7080018717828733,
+      "grad_norm": 0.34660300612449646,
+      "learning_rate": 3.0091588334538446e-05,
+      "loss": 0.7040463256835937,
+      "step": 14600
+    },
+    {
+      "epoch": 1.7197005147402902,
+      "grad_norm": 0.4229566752910614,
+      "learning_rate": 2.888647866955893e-05,
+      "loss": 0.7030789184570313,
+      "step": 14700
+    },
+    {
+      "epoch": 1.731399157697707,
+      "grad_norm": 0.7541176080703735,
+      "learning_rate": 2.7681369004579417e-05,
+      "loss": 0.6858772277832031,
+      "step": 14800
+    },
+    {
+      "epoch": 1.743097800655124,
+      "grad_norm": 0.35117629170417786,
+      "learning_rate": 2.6476259339599907e-05,
+      "loss": 0.6658636474609375,
+      "step": 14900
+    },
+    {
+      "epoch": 1.754796443612541,
+      "grad_norm": 0.5631217956542969,
+      "learning_rate": 2.5271149674620394e-05,
+      "loss": 0.6837416839599609,
+      "step": 15000
+    },
+    {
+      "epoch": 1.754796443612541,
+      "eval_bleu": 14.543964833141102,
+      "eval_chrf++": 37.54092805856749,
+      "eval_gleu": 0.29991637010292305,
+      "eval_loss": 0.11548958718776703,
+      "eval_runtime": 1247.8238,
+      "eval_samples_per_second": 8.014,
+      "eval_steps_per_second": 1.002,
+      "step": 15000
+    },
+    {
+      "epoch": 1.7664950865699578,
+      "grad_norm": 0.3711891770362854,
+      "learning_rate": 2.4066040009640877e-05,
+      "loss": 0.6630690002441406,
+      "step": 15100
+    },
+    {
+      "epoch": 1.7781937295273749,
+      "grad_norm": 0.3181966245174408,
+      "learning_rate": 2.2860930344661367e-05,
+      "loss": 0.650764389038086,
+      "step": 15200
+    },
+    {
+      "epoch": 1.7898923724847917,
+      "grad_norm": 0.5709223747253418,
+      "learning_rate": 2.165582067968185e-05,
+      "loss": 0.8302235412597656,
+      "step": 15300
+    },
+    {
+      "epoch": 1.8015910154422086,
+      "grad_norm": 0.40639254450798035,
+      "learning_rate": 2.045071101470234e-05,
+      "loss": 0.7062226104736328,
+      "step": 15400
+    },
+    {
+      "epoch": 1.8132896583996256,
+      "grad_norm": 0.5896472930908203,
+      "learning_rate": 1.9245601349722825e-05,
+      "loss": 0.6919742584228515,
+      "step": 15500
+    },
+    {
+      "epoch": 1.8249883013570427,
+      "grad_norm": 0.5842819213867188,
+      "learning_rate": 1.804049168474331e-05,
+      "loss": 0.6742509460449219,
+      "step": 15600
+    },
+    {
+      "epoch": 1.8366869443144596,
+      "grad_norm": 1.040644645690918,
+      "learning_rate": 1.6835382019763798e-05,
+      "loss": 0.705620346069336,
+      "step": 15700
+    },
+    {
+      "epoch": 1.8483855872718764,
+      "grad_norm": 0.4445037245750427,
+      "learning_rate": 1.5630272354784285e-05,
+      "loss": 0.8352814483642578,
+      "step": 15800
+    },
+    {
+      "epoch": 1.8600842302292935,
+      "grad_norm": 0.4581546485424042,
+      "learning_rate": 1.4425162689804772e-05,
+      "loss": 0.6915709686279297,
+      "step": 15900
+    },
+    {
+      "epoch": 1.8717828731867103,
+      "grad_norm": 0.5009742379188538,
+      "learning_rate": 1.322005302482526e-05,
+      "loss": 0.7106993865966796,
+      "step": 16000
+    },
+    {
+      "epoch": 1.8717828731867103,
+      "eval_bleu": 14.54097060789849,
+      "eval_chrf++": 37.53894479733204,
+      "eval_gleu": 0.29995807718830964,
+      "eval_loss": 0.1141028106212616,
+      "eval_runtime": 1249.0528,
+      "eval_samples_per_second": 8.006,
+      "eval_steps_per_second": 1.001,
+      "step": 16000
+    },
+    {
+      "epoch": 1.8834815161441272,
+      "grad_norm": 0.63089519739151,
+      "learning_rate": 1.2014943359845747e-05,
+      "loss": 0.6426277923583984,
+      "step": 16100
+    },
+    {
+      "epoch": 1.8951801591015442,
+      "grad_norm": 0.6046837568283081,
+      "learning_rate": 1.0809833694866234e-05,
+      "loss": 0.6600284576416016,
+      "step": 16200
+    },
+    {
+      "epoch": 1.9068788020589613,
+      "grad_norm": 0.49147483706474304,
+      "learning_rate": 9.604724029886721e-06,
+      "loss": 0.7625879669189453,
+      "step": 16300
+    },
+    {
+      "epoch": 1.918577445016378,
+      "grad_norm": 0.5788199305534363,
+      "learning_rate": 8.399614364907208e-06,
+      "loss": 0.6375769424438477,
+      "step": 16400
+    },
+    {
+      "epoch": 1.930276087973795,
+      "grad_norm": 0.32121989130973816,
+      "learning_rate": 7.194504699927694e-06,
+      "loss": 0.6656421661376953,
+      "step": 16500
+    },
+    {
+      "epoch": 1.941974730931212,
+      "grad_norm": 0.4479377865791321,
+      "learning_rate": 5.989395034948181e-06,
+      "loss": 0.6696430206298828,
+      "step": 16600
+    },
+    {
+      "epoch": 1.953673373888629,
+      "grad_norm": 0.5970329642295837,
+      "learning_rate": 4.7842853699686676e-06,
+      "loss": 0.6432942962646484,
+      "step": 16700
+    },
+    {
+      "epoch": 1.9653720168460458,
+      "grad_norm": 0.7789268493652344,
+      "learning_rate": 3.5791757049891544e-06,
+      "loss": 0.6877264404296874,
+      "step": 16800
+    },
+    {
+      "epoch": 1.9770706598034629,
+      "grad_norm": 0.3332822918891907,
+      "learning_rate": 2.374066040009641e-06,
+      "loss": 0.7054035949707032,
+      "step": 16900
+    },
+    {
+      "epoch": 1.9887693027608797,
+      "grad_norm": 0.27246978878974915,
+      "learning_rate": 1.1689563750301279e-06,
+      "loss": 0.7501000213623047,
+      "step": 17000
+    },
+    {
+      "epoch": 1.9887693027608797,
+      "eval_bleu": 14.54095696567213,
+      "eval_chrf++": 37.538295161831726,
+      "eval_gleu": 0.299924999155072,
+      "eval_loss": 0.11489586532115936,
+      "eval_runtime": 1253.1514,
+      "eval_samples_per_second": 7.98,
+      "eval_steps_per_second": 0.997,
+      "step": 17000
+    }
+  ],
+  "logging_steps": 100,
+  "max_steps": 17096,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 2,
+  "save_steps": 1000,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 5.057699131283558e+16,
+  "train_batch_size": 4,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-17000/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d2f1adfeab5b878e23075d9ce65374fe908112ad4fdc3ea083b3fff413cae702
+size 5393