Instructions to use Gege24/environment_test_affine with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries
PEFT
How to use Gege24/environment_test_affine with PEFT:
```
Base model is not found.
```

How to use Gege24/environment_test_affine with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Gege24/environment_test_affine")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Gege24/environment_test_affine")
model = AutoModelForCausalLM.from_pretrained("Gege24/environment_test_affine", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Gege24/environment_test_affine with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Gege24/environment_test_affine"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Gege24/environment_test_affine",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/Gege24/environment_test_affine

SGLang

How to use Gege24/environment_test_affine with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Gege24/environment_test_affine" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Gege24/environment_test_affine",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Gege24/environment_test_affine" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Gege24/environment_test_affine",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use Gege24/environment_test_affine with Docker Model Runner:
```
docker model run hf.co/Gege24/environment_test_affine
```

Gege24 commited on Feb 8

Commit

a807cb0

verified ·

1 Parent(s): 2931b8d

Upload task output 1

Browse files

Files changed (6) hide show

config.json +3 -3
generation_config.json +10 -0
loss.txt +1 -1
model.safetensors +1 -1
trainer_state.json +491 -283
training_args.bin +2 -2

config.json CHANGED Viewed

@@ -3,7 +3,7 @@
     "Qwen2ForCausalLM"
   ],
   "attention_dropout": 0.0,
-  "bos_token_id": 151643,
   "dtype": "bfloat16",
   "eos_token_id": 151645,
   "hidden_act": "silu",
@@ -42,7 +42,7 @@
   "num_attention_heads": 14,
   "num_hidden_layers": 24,
   "num_key_value_heads": 2,
-  "pad_token_id": null,
   "rms_norm_eps": 1e-06,
   "rope_parameters": {
     "rope_theta": 1000000.0,
@@ -51,7 +51,7 @@
   "sliding_window": null,
   "tie_word_embeddings": true,
   "transformers_version": "5.1.0",
-  "use_cache": true,
   "use_sliding_window": false,
   "vocab_size": 151936
 }

     "Qwen2ForCausalLM"
   ],
   "attention_dropout": 0.0,
+  "bos_token_id": null,
   "dtype": "bfloat16",
   "eos_token_id": 151645,
   "hidden_act": "silu",
   "num_attention_heads": 14,
   "num_hidden_layers": 24,
   "num_key_value_heads": 2,
+  "pad_token_id": 151643,
   "rms_norm_eps": 1e-06,
   "rope_parameters": {
     "rope_theta": 1000000.0,
   "sliding_window": null,
   "tie_word_embeddings": true,
   "transformers_version": "5.1.0",
+  "use_cache": false,
   "use_sliding_window": false,
   "vocab_size": 151936
 }

generation_config.json CHANGED Viewed

@@ -1,3 +1,13 @@
 {
   "transformers_version": "5.1.0"
 }

 {
+  "do_sample": true,
+  "eos_token_id": [
+    151645,
+    151643
+  ],
+  "pad_token_id": 151643,
+  "repetition_penalty": 1.1,
+  "temperature": 0.7,
+  "top_k": 20,
+  "top_p": 0.8,
   "transformers_version": "5.1.0"
 }

loss.txt CHANGED Viewed

	@@ -1 +1 @@
1	- 8,-0.56


1	+ 75,-0.06899999883025884

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0c74d946e640011ac4152b0385b877dff53873056dc7d20ffcadee9b1ca11c52
 size 988097824

 version https://git-lfs.github.com/spec/v1
+oid sha256:d37254765789231f8a3a2350286dac9a3200c0359f893e954337a3ad0438489f
 size 988097824

trainer_state.json CHANGED Viewed

@@ -2,9 +2,9 @@
   "best_global_step": null,
   "best_metric": null,
   "best_model_checkpoint": null,
-  "epoch": 2.0,
   "eval_steps": 500,
-  "global_step": 8,
   "is_hyper_param_search": false,
   "is_local_process_zero": true,
   "is_world_process_zero": true,
@@ -16,30 +16,31 @@
       "clip_ratio/low_min": 0.0,
       "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
-      "completions/max_length": 3.0,
-      "completions/max_terminated_length": 3.0,
-      "completions/mean_length": 2.407738208770752,
-      "completions/mean_terminated_length": 2.407738208770752,
-      "completions/min_length": 2.0,
-      "completions/min_terminated_length": 2.0,
-      "entropy": 0.7712807655334473,
-      "epoch": 0.25,
-      "frac_reward_zero_std": 0.5297619104385376,
-      "grad_norm": 4.7248921394348145,
-      "learning_rate": 0.0,
-      "loss": 0.0255,
-      "num_tokens": 117737.0,
-      "reward": 0.4955357313156128,
-      "reward_std": 0.4984852075576782,
-      "rewards/env_game_reward/mean": 0.4955357015132904,
-      "rewards/env_game_reward/std": 0.4984852075576782,
-      "sampling/importance_sampling_ratio/max": 2.444530487060547,
-      "sampling/importance_sampling_ratio/mean": 0.9743361473083496,
-      "sampling/importance_sampling_ratio/min": 0.3661190867424011,
-      "sampling/sampling_logp_difference/max": 0.8435878753662109,
-      "sampling/sampling_logp_difference/mean": 0.10781625658273697,
-      "step": 1,
-      "step_time": 86.73120934999952
     },
     {
       "clip_ratio/high_max": 0.0,
@@ -48,292 +49,499 @@
       "clip_ratio/low_min": 0.0,
       "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
-      "completions/max_length": 41.0,
-      "completions/max_terminated_length": 41.0,
-      "completions/mean_length": 2.5892858505249023,
-      "completions/mean_terminated_length": 2.5892858505249023,
-      "completions/min_length": 2.0,
-      "completions/min_terminated_length": 2.0,
-      "entropy": 0.6681132614612579,
-      "epoch": 0.5,
-      "frac_reward_zero_std": 0.3988095223903656,
-      "grad_norm": 2.0864083766937256,
-      "learning_rate": 2.84304e-07,
-      "loss": 0.0384,
-      "num_tokens": 222599.0,
-      "reward": 0.5297619104385376,
-      "reward_std": 0.4908183515071869,
-      "rewards/env_game_reward/mean": 0.5297619104385376,
-      "rewards/env_game_reward/std": 0.4908183515071869,
-      "sampling/importance_sampling_ratio/max": 2.3313705921173096,
-      "sampling/importance_sampling_ratio/mean": 0.9879763126373291,
-      "sampling/importance_sampling_ratio/min": 0.0,
-      "sampling/sampling_logp_difference/max": 1.0128240585327148,
-      "sampling/sampling_logp_difference/mean": 0.09322669357061386,
-      "step": 2,
-      "step_time": 49.185698066999976
     },
     {
-      "clip_ratio/high_max": 0.010094599798321724,
-      "clip_ratio/high_mean": 0.005047299899160862,
-      "clip_ratio/low_mean": 0.01141490787267685,
-      "clip_ratio/low_min": 0.0053089887369424105,
-      "clip_ratio/region_mean": 0.016462208004668355,
       "completions/clipped_ratio": 0.0,
-      "completions/max_length": 9.0,
-      "completions/max_terminated_length": 9.0,
-      "completions/mean_length": 2.267857074737549,
-      "completions/mean_terminated_length": 2.267857074737549,
-      "completions/min_length": 2.0,
-      "completions/min_terminated_length": 2.0,
-      "entropy": 0.6272067576646805,
-      "epoch": 0.75,
-      "frac_reward_zero_std": 0.4583333432674408,
-      "grad_norm": 3.2909624576568604,
-      "learning_rate": 5.68608e-07,
-      "loss": 0.0251,
-      "num_tokens": 334913.0,
-      "reward": 0.5223214626312256,
-      "reward_std": 0.49499765038490295,
-      "rewards/env_game_reward/mean": 0.5223214030265808,
-      "rewards/env_game_reward/std": 0.49499762058258057,
-      "sampling/importance_sampling_ratio/max": 1.6051479578018188,
-      "sampling/importance_sampling_ratio/mean": 0.9814748764038086,
-      "sampling/importance_sampling_ratio/min": 0.0,
-      "sampling/sampling_logp_difference/max": 1.094405174255371,
-      "sampling/sampling_logp_difference/mean": 0.07474357634782791,
-      "step": 3,
-      "step_time": 74.23962842500077
     },
     {
-      "clip_ratio/high_max": 0.034161615651100874,
-      "clip_ratio/high_mean": 0.023498072754591703,
-      "clip_ratio/low_mean": 0.008893569000065327,
-      "clip_ratio/low_min": 0.005104166688397527,
-      "clip_ratio/region_mean": 0.03239164222031832,
       "completions/clipped_ratio": 0.0,
-      "completions/max_length": 3.0,
-      "completions/max_terminated_length": 3.0,
-      "completions/mean_length": 2.3035714626312256,
-      "completions/mean_terminated_length": 2.3035714626312256,
-      "completions/min_length": 2.0,
-      "completions/min_terminated_length": 2.0,
-      "entropy": 0.5872454345226288,
-      "epoch": 1.0,
-      "frac_reward_zero_std": 0.386904776096344,
-      "grad_norm": 1.5831847190856934,
-      "learning_rate": 8.529119999999999e-07,
-      "loss": 0.0144,
-      "num_tokens": 439679.0,
-      "reward": 0.5372024178504944,
-      "reward_std": 0.4834112823009491,
-      "rewards/env_game_reward/mean": 0.5372023582458496,
-      "rewards/env_game_reward/std": 0.4834113121032715,
-      "sampling/importance_sampling_ratio/max": 2.0064399242401123,
-      "sampling/importance_sampling_ratio/mean": 1.0050137042999268,
-      "sampling/importance_sampling_ratio/min": 0.48575615882873535,
-      "sampling/sampling_logp_difference/max": 0.7220797538757324,
-      "sampling/sampling_logp_difference/mean": 0.09695391356945038,
-      "step": 4,
-      "step_time": 48.50994999100112
     },
     {
-      "epoch": 1.0,
-      "eval_clip_ratio/high_max": 0.0,
-      "eval_clip_ratio/high_mean": 0.0,
-      "eval_clip_ratio/low_mean": 0.0,
-      "eval_clip_ratio/low_min": 0.0,
-      "eval_clip_ratio/region_mean": 0.0,
-      "eval_completions/clipped_ratio": 0.0,
-      "eval_completions/max_length": 2.9,
-      "eval_completions/max_terminated_length": 2.9,
-      "eval_completions/mean_length": 2.27,
-      "eval_completions/mean_terminated_length": 2.27,
-      "eval_completions/min_length": 2.0,
-      "eval_completions/min_terminated_length": 2.0,
-      "eval_entropy": 0.6556259167194366,
-      "eval_frac_reward_zero_std": 0.49,
-      "eval_loss": -0.002539175096899271,
-      "eval_num_tokens": 439679.0,
-      "eval_reward": 0.5225,
-      "eval_reward_std": 0.4914883863925934,
-      "eval_rewards/env_game_reward/mean": 0.5225,
-      "eval_rewards/env_game_reward/std": 0.4914884132146835,
-      "eval_runtime": 72.4746,
-      "eval_samples_per_second": 2.76,
-      "eval_sampling/importance_sampling_ratio/max": 1.344225935935974,
-      "eval_sampling/importance_sampling_ratio/mean": 0.9896444308757782,
-      "eval_sampling/importance_sampling_ratio/min": 0.7344249868392945,
-      "eval_sampling/sampling_logp_difference/max": 0.3614662927389145,
-      "eval_sampling/sampling_logp_difference/mean": 0.08291504085063935,
-      "eval_steps_per_second": 0.345,
-      "step": 4
     },
     {
-      "clip_ratio/high_max": 0.015843799337744713,
-      "clip_ratio/high_mean": 0.011610739515163004,
-      "clip_ratio/low_mean": 0.01242961548268795,
-      "clip_ratio/low_min": 0.0023809524718672037,
-      "clip_ratio/region_mean": 0.024040354881435633,
       "completions/clipped_ratio": 0.0,
-      "completions/max_length": 7.0,
-      "completions/max_terminated_length": 7.0,
-      "completions/mean_length": 2.372023820877075,
-      "completions/mean_terminated_length": 2.372023820877075,
-      "completions/min_length": 2.0,
-      "completions/min_terminated_length": 2.0,
-      "entropy": 0.7024529576301575,
-      "epoch": 1.25,
-      "frac_reward_zero_std": 0.4345238208770752,
-      "grad_norm": 2.5793297290802,
-      "learning_rate": 1.137216e-06,
-      "loss": 0.0003,
-      "num_tokens": 560092.0,
-      "reward": 0.5684524178504944,
-      "reward_std": 0.48845046758651733,
-      "rewards/env_game_reward/mean": 0.5684523582458496,
-      "rewards/env_game_reward/std": 0.4884504973888397,
-      "sampling/importance_sampling_ratio/max": 2.402831554412842,
-      "sampling/importance_sampling_ratio/mean": 0.9943535923957825,
-      "sampling/importance_sampling_ratio/min": 0.5057061910629272,
-      "sampling/sampling_logp_difference/max": 0.8499932289123535,
-      "sampling/sampling_logp_difference/mean": 0.0851290300488472,
-      "step": 5,
-      "step_time": 79.1233635949975
     },
     {
-      "clip_ratio/high_max": 0.02467681560665369,
-      "clip_ratio/high_mean": 0.015116185648366809,
-      "clip_ratio/low_mean": 0.008386317640542984,
-      "clip_ratio/low_min": 0.005376344081014395,
-      "clip_ratio/region_mean": 0.02350250235758722,
       "completions/clipped_ratio": 0.0,
-      "completions/max_length": 5.0,
-      "completions/max_terminated_length": 5.0,
-      "completions/mean_length": 2.136904716491699,
-      "completions/mean_terminated_length": 2.136904716491699,
-      "completions/min_length": 2.0,
-      "completions/min_terminated_length": 2.0,
-      "entropy": 0.5466470569372177,
-      "epoch": 1.5,
-      "frac_reward_zero_std": 0.380952388048172,
-      "grad_norm": 1.9452687501907349,
-      "learning_rate": 1.4215199999999998e-06,
-      "loss": 0.0011,
-      "num_tokens": 664298.0,
-      "reward": 0.4940476417541504,
-      "reward_std": 0.49621880054473877,
-      "rewards/env_game_reward/mean": 0.494047611951828,
-      "rewards/env_game_reward/std": 0.49621880054473877,
-      "sampling/importance_sampling_ratio/max": 1.6991724967956543,
-      "sampling/importance_sampling_ratio/mean": 0.9933019876480103,
-      "sampling/importance_sampling_ratio/min": 0.4511236548423767,
-      "sampling/sampling_logp_difference/max": 0.7959003448486328,
-      "sampling/sampling_logp_difference/mean": 0.048079028725624084,
-      "step": 6,
-      "step_time": 37.11783460799961
     },
     {
-      "clip_ratio/high_max": 0.019634235184639692,
-      "clip_ratio/high_mean": 0.014030600897967815,
-      "clip_ratio/low_mean": 0.005204149056226015,
-      "clip_ratio/low_min": 0.002577319508418441,
-      "clip_ratio/region_mean": 0.019234750187024474,
       "completions/clipped_ratio": 0.0,
-      "completions/max_length": 10.0,
-      "completions/max_terminated_length": 10.0,
-      "completions/mean_length": 2.282738208770752,
-      "completions/mean_terminated_length": 2.282738208770752,
-      "completions/min_length": 2.0,
-      "completions/min_terminated_length": 2.0,
-      "entropy": 0.6793178021907806,
-      "epoch": 1.75,
-      "frac_reward_zero_std": 0.5059524178504944,
-      "grad_norm": 2.815258741378784,
-      "learning_rate": 1.7058239999999999e-06,
-      "loss": 0.0239,
-      "num_tokens": 773929.0,
-      "reward": 0.4851190447807312,
-      "reward_std": 0.4990306794643402,
-      "rewards/env_game_reward/mean": 0.4851190447807312,
-      "rewards/env_game_reward/std": 0.4990306794643402,
-      "sampling/importance_sampling_ratio/max": 1.8610674142837524,
-      "sampling/importance_sampling_ratio/mean": 1.0055298805236816,
-      "sampling/importance_sampling_ratio/min": 0.0,
-      "sampling/sampling_logp_difference/max": 0.8122937679290771,
-      "sampling/sampling_logp_difference/mean": 0.07463809102773666,
-      "step": 7,
-      "step_time": 63.86528683999859
     },
     {
-      "clip_ratio/high_max": 0.01532895234413445,
-      "clip_ratio/high_mean": 0.008953135926276445,
-      "clip_ratio/low_mean": 0.009014535578899086,
-      "clip_ratio/low_min": 0.0024038462433964014,
-      "clip_ratio/region_mean": 0.017967671272344887,
       "completions/clipped_ratio": 0.0,
-      "completions/max_length": 3.0,
-      "completions/max_terminated_length": 3.0,
-      "completions/mean_length": 2.2708334922790527,
-      "completions/mean_terminated_length": 2.2708334922790527,
-      "completions/min_length": 2.0,
-      "completions/min_terminated_length": 2.0,
-      "entropy": 0.6921011656522751,
-      "epoch": 2.0,
-      "frac_reward_zero_std": 0.4523809552192688,
-      "grad_norm": 2.390941619873047,
-      "learning_rate": 1.9901279999999997e-06,
-      "loss": 0.0071,
-      "num_tokens": 883556.0,
-      "reward": 0.5595238208770752,
-      "reward_std": 0.48962223529815674,
-      "rewards/env_game_reward/mean": 0.5595238208770752,
-      "rewards/env_game_reward/std": 0.48962223529815674,
-      "sampling/importance_sampling_ratio/max": 1.963092565536499,
-      "sampling/importance_sampling_ratio/mean": 0.9806411266326904,
-      "sampling/importance_sampling_ratio/min": 0.33748432993888855,
-      "sampling/sampling_logp_difference/max": 1.0179762840270996,
-      "sampling/sampling_logp_difference/mean": 0.07029423117637634,
-      "step": 8,
-      "step_time": 61.923666292001144
     },
     {
-      "epoch": 2.0,
       "eval_clip_ratio/high_max": 0.0,
       "eval_clip_ratio/high_mean": 0.0,
       "eval_clip_ratio/low_mean": 0.0,
       "eval_clip_ratio/low_min": 0.0,
       "eval_clip_ratio/region_mean": 0.0,
       "eval_completions/clipped_ratio": 0.0,
-      "eval_completions/max_length": 2.96,
-      "eval_completions/max_terminated_length": 2.96,
-      "eval_completions/mean_length": 2.25,
-      "eval_completions/mean_terminated_length": 2.25,
-      "eval_completions/min_length": 2.0,
-      "eval_completions/min_terminated_length": 2.0,
-      "eval_entropy": 0.663043782711029,
-      "eval_frac_reward_zero_std": 0.585,
-      "eval_loss": 0.014494094997644424,
-      "eval_num_tokens": 883556.0,
-      "eval_reward": 0.56,
-      "eval_reward_std": 0.458708074092865,
-      "eval_rewards/env_game_reward/mean": 0.56,
-      "eval_rewards/env_game_reward/std": 0.4587080860137939,
-      "eval_runtime": 84.5816,
-      "eval_samples_per_second": 2.365,
-      "eval_sampling/importance_sampling_ratio/max": 1.2596182644367218,
-      "eval_sampling/importance_sampling_ratio/mean": 0.9817599618434906,
-      "eval_sampling/importance_sampling_ratio/min": 0.7732881844043732,
-      "eval_sampling/sampling_logp_difference/max": 0.30535031914710997,
-      "eval_sampling/sampling_logp_difference/mean": 0.06819972261786461,
-      "eval_steps_per_second": 0.296,
-      "step": 8
     }
   ],
-  "logging_steps": 1.0,
-  "max_steps": 40,
-  "num_input_tokens_seen": 883556,
-  "num_train_epochs": 10,
   "save_steps": 500,
   "stateful_callbacks": {
     "TrainerControl": {
@@ -348,7 +556,7 @@
     }
   },
   "total_flos": 0.0,
-  "train_batch_size": 42,
   "trial_name": null,
   "trial_params": null
 }

   "best_global_step": null,
   "best_metric": null,
   "best_model_checkpoint": null,
+  "epoch": 0.01875,
   "eval_steps": 500,
+  "global_step": 75,
   "is_hyper_param_search": false,
   "is_local_process_zero": true,
   "is_world_process_zero": true,
       "clip_ratio/low_min": 0.0,
       "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
+      "completions/max_length": 374.4,
+      "completions/max_terminated_length": 374.4,
+      "completions/mean_length": 290.6960021972656,
+      "completions/mean_terminated_length": 290.6960021972656,
+      "completions/min_length": 167.6,
+      "completions/min_terminated_length": 167.6,
+      "entropy": 0.7587062597274781,
+      "epoch": 0.00125,
+      "frac_reward_zero_std": 0.6159999966621399,
+      "grad_norm": 0.32421875,
+      "kl": 0.007210364751517773,
+      "learning_rate": 1.137216e-06,
+      "loss": -0.000457207765430212,
+      "num_tokens": 211069.0,
+      "reward": 0.06548000425100327,
+      "reward_std": 0.0959968164563179,
+      "rewards/env_goofspiel_reward/mean": 0.06548000574111938,
+      "rewards/env_goofspiel_reward/std": 0.20242175161838533,
+      "sampling/importance_sampling_ratio/max": 1.9353477716445924,
+      "sampling/importance_sampling_ratio/mean": 1.0085526347160338,
+      "sampling/importance_sampling_ratio/min": 0.5233797252178192,
+      "sampling/sampling_logp_difference/max": 0.6646340131759644,
+      "sampling/sampling_logp_difference/mean": 0.06287899985909462,
+      "step": 5,
+      "step_time": 5.862163845000214
     },
     {
       "clip_ratio/high_max": 0.0,
       "clip_ratio/low_min": 0.0,
       "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
+      "completions/max_length": 373.8,
+      "completions/max_terminated_length": 373.8,
+      "completions/mean_length": 285.77599182128904,
+      "completions/mean_terminated_length": 285.77599182128904,
+      "completions/min_length": 187.0,
+      "completions/min_terminated_length": 187.0,
+      "entropy": 0.7223453521728516,
+      "epoch": 0.0025,
+      "frac_reward_zero_std": 0.6879999876022339,
+      "grad_norm": 0.373046875,
+      "kl": 0.01190796154551208,
+      "learning_rate": 2.5587359999999995e-06,
+      "loss": 0.0004954038187861443,
+      "num_tokens": 419291.0,
+      "reward": 0.06636000201106071,
+      "reward_std": 0.08932172805070877,
+      "rewards/env_goofspiel_reward/mean": 0.06636000350117684,
+      "rewards/env_goofspiel_reward/std": 0.20822030901908875,
+      "sampling/importance_sampling_ratio/max": 1.9151880025863648,
+      "sampling/importance_sampling_ratio/mean": 1.00549418926239,
+      "sampling/importance_sampling_ratio/min": 0.5084045708179474,
+      "sampling/sampling_logp_difference/max": 0.8484642028808593,
+      "sampling/sampling_logp_difference/mean": 0.05378681421279907,
+      "step": 10,
+      "step_time": 5.392790380800034
     },
     {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
+      "completions/max_length": 374.0,
+      "completions/max_terminated_length": 374.0,
+      "completions/mean_length": 286.59998779296876,
+      "completions/mean_terminated_length": 286.59998779296876,
+      "completions/min_length": 186.4,
+      "completions/min_terminated_length": 186.4,
+      "entropy": 0.7013472616672516,
+      "epoch": 0.00375,
+      "frac_reward_zero_std": 0.743999981880188,
+      "grad_norm": 0.25,
+      "kl": 0.03683878714218736,
+      "learning_rate": 3.9802559999999995e-06,
+      "loss": 0.00018892403459176422,
+      "num_tokens": 629381.0,
+      "reward": 0.05708000063896179,
+      "reward_std": 0.0819678172469139,
+      "rewards/env_goofspiel_reward/mean": 0.05708000287413597,
+      "rewards/env_goofspiel_reward/std": 0.19145022630691527,
+      "sampling/importance_sampling_ratio/max": 1.9665297031402589,
+      "sampling/importance_sampling_ratio/mean": 1.0253857135772706,
+      "sampling/importance_sampling_ratio/min": 0.538357138633728,
+      "sampling/sampling_logp_difference/max": 0.7756662368774414,
+      "sampling/sampling_logp_difference/mean": 0.06448477879166603,
+      "step": 15,
+      "step_time": 5.349944851799956
     },
     {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
+      "completions/max_length": 374.8,
+      "completions/max_terminated_length": 374.8,
+      "completions/mean_length": 291.7519897460937,
+      "completions/mean_terminated_length": 291.7519897460937,
+      "completions/min_length": 199.6,
+      "completions/min_terminated_length": 199.6,
+      "entropy": 0.7047547340393067,
+      "epoch": 0.005,
+      "frac_reward_zero_std": 0.7519999742507935,
+      "grad_norm": 0.294921875,
+      "kl": 0.08839112929999829,
+      "learning_rate": 5.401775999999999e-06,
+      "loss": -2.657829609233886e-05,
+      "num_tokens": 840556.0,
+      "reward": 0.06196000054478645,
+      "reward_std": 0.07529272958636284,
+      "rewards/env_goofspiel_reward/mean": 0.061960003525018695,
+      "rewards/env_goofspiel_reward/std": 0.19518478214740753,
+      "sampling/importance_sampling_ratio/max": 1.6097611427307128,
+      "sampling/importance_sampling_ratio/mean": 0.9887367606163024,
+      "sampling/importance_sampling_ratio/min": 0.46161189675331116,
+      "sampling/sampling_logp_difference/max": 0.6100110828876495,
+      "sampling/sampling_logp_difference/mean": 0.058672596514225,
+      "step": 20,
+      "step_time": 5.242961023999942
     },
     {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 374.2,
+      "completions/max_terminated_length": 374.2,
+      "completions/mean_length": 287.9799865722656,
+      "completions/mean_terminated_length": 287.9799865722656,
+      "completions/min_length": 194.4,
+      "completions/min_terminated_length": 194.4,
+      "entropy": 0.6883363842964172,
+      "epoch": 0.00625,
+      "frac_reward_zero_std": 0.7599999785423279,
+      "grad_norm": 0.1826171875,
+      "kl": 0.13179944828152657,
+      "learning_rate": 6.8232959999999994e-06,
+      "loss": 6.652346346527337e-05,
+      "num_tokens": 1049402.0,
+      "reward": 0.07416000291705131,
+      "reward_std": 0.10555689632892609,
+      "rewards/env_goofspiel_reward/mean": 0.07416000291705131,
+      "rewards/env_goofspiel_reward/std": 0.22879809141159058,
+      "sampling/importance_sampling_ratio/max": 1.9118820905685425,
+      "sampling/importance_sampling_ratio/mean": 0.9868301272392273,
+      "sampling/importance_sampling_ratio/min": 0.6072056829929352,
+      "sampling/sampling_logp_difference/max": 0.5817384719848633,
+      "sampling/sampling_logp_difference/mean": 0.05620769709348679,
+      "step": 25,
+      "step_time": 5.260266781999962
     },
     {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
+      "completions/max_length": 416.8,
+      "completions/max_terminated_length": 416.8,
+      "completions/mean_length": 299.07598876953125,
+      "completions/mean_terminated_length": 299.07598876953125,
+      "completions/min_length": 212.0,
+      "completions/min_terminated_length": 212.0,
+      "entropy": 0.4900937914848328,
+      "epoch": 0.0075,
+      "frac_reward_zero_std": 0.7599999785423279,
+      "grad_norm": 0.1318359375,
+      "kl": 0.13062527999281884,
+      "learning_rate": 8.244816e-06,
+      "loss": 0.00041568251326680184,
+      "num_tokens": 1263196.0,
+      "reward": 0.07428000047802925,
+      "reward_std": 0.10527405217289924,
+      "rewards/env_goofspiel_reward/mean": 0.07428000047802925,
+      "rewards/env_goofspiel_reward/std": 0.21391310691833496,
+      "sampling/importance_sampling_ratio/max": 1.9750086545944214,
+      "sampling/importance_sampling_ratio/mean": 1.0017020225524902,
+      "sampling/importance_sampling_ratio/min": 0.4652911275625229,
+      "sampling/sampling_logp_difference/max": 0.7616503953933715,
+      "sampling/sampling_logp_difference/mean": 0.048386485874652864,
+      "step": 30,
+      "step_time": 5.606105185600154
+    },
+    {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 374.0,
+      "completions/max_terminated_length": 374.0,
+      "completions/mean_length": 290.9440002441406,
+      "completions/mean_terminated_length": 290.9440002441406,
+      "completions/min_length": 212.0,
+      "completions/min_terminated_length": 212.0,
+      "entropy": 0.2889633044600487,
+      "epoch": 0.00875,
+      "frac_reward_zero_std": 0.8479999780654908,
+      "grad_norm": 0.0859375,
+      "kl": 0.22455788254737855,
+      "learning_rate": 9.666336e-06,
+      "loss": 6.903421599417925e-05,
+      "num_tokens": 1474071.0,
+      "reward": 0.052800000086426734,
+      "reward_std": 0.06788224689662456,
+      "rewards/env_goofspiel_reward/mean": 0.052800000086426734,
+      "rewards/env_goofspiel_reward/std": 0.16736633479595184,
+      "sampling/importance_sampling_ratio/max": 1.6834668874740601,
+      "sampling/importance_sampling_ratio/mean": 0.9958889007568359,
+      "sampling/importance_sampling_ratio/min": 0.43778104782104493,
+      "sampling/sampling_logp_difference/max": 0.8263626098632812,
+      "sampling/sampling_logp_difference/mean": 0.0358995582908392,
+      "step": 35,
+      "step_time": 5.237710429800063
+    },
+    {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 374.0,
+      "completions/max_terminated_length": 374.0,
+      "completions/mean_length": 286.0199951171875,
+      "completions/mean_terminated_length": 286.0199951171875,
+      "completions/min_length": 212.0,
+      "completions/min_terminated_length": 212.0,
+      "entropy": 0.24612685889005662,
+      "epoch": 0.01,
+      "frac_reward_zero_std": 0.8159999847412109,
+      "grad_norm": 0.32421875,
+      "kl": 0.1633337877690792,
+      "learning_rate": 9.950637941994321e-06,
+      "loss": -2.846699208021164e-05,
+      "num_tokens": 1681137.0,
+      "reward": 0.060000001639127734,
+      "reward_std": 0.08485281020402909,
+      "rewards/env_goofspiel_reward/mean": 0.060000001639127734,
+      "rewards/env_goofspiel_reward/std": 0.19129492342472076,
+      "sampling/importance_sampling_ratio/max": 1.5720022439956665,
+      "sampling/importance_sampling_ratio/mean": 0.9784366488456726,
+      "sampling/importance_sampling_ratio/min": 0.47974646687507627,
+      "sampling/sampling_logp_difference/max": 0.702510929107666,
+      "sampling/sampling_logp_difference/mean": 0.03313286602497101,
+      "step": 40,
+      "step_time": 5.238652371199805
     },
     {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 660.4,
+      "completions/max_terminated_length": 660.4,
+      "completions/mean_length": 489.1719970703125,
+      "completions/mean_terminated_length": 489.1719970703125,
+      "completions/min_length": 322.4,
+      "completions/min_terminated_length": 322.4,
+      "entropy": 0.3432160258293152,
+      "epoch": 0.01125,
+      "frac_reward_zero_std": 0.7599999785423279,
+      "grad_norm": 0.2255859375,
+      "kl": 0.3002031177282333,
+      "learning_rate": 9.950629581350144e-06,
+      "loss": 0.0002033085562288761,
+      "num_tokens": 1938183.0,
+      "reward": 0.03768000081181526,
+      "reward_std": 0.05008201580494642,
+      "rewards/env_goofspiel_reward/mean": 0.03768000081181526,
+      "rewards/env_goofspiel_reward/std": 0.12525621727108954,
+      "sampling/importance_sampling_ratio/max": 1.7067772150039673,
+      "sampling/importance_sampling_ratio/mean": 1.0024658203125,
+      "sampling/importance_sampling_ratio/min": 0.5572002470493317,
+      "sampling/sampling_logp_difference/max": 0.6115247011184692,
+      "sampling/sampling_logp_difference/mean": 0.03118431307375431,
+      "step": 45,
+      "step_time": 7.8333522611999795
+    },
+    {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
+      "completions/max_length": 731.6,
+      "completions/max_terminated_length": 731.6,
+      "completions/mean_length": 558.283984375,
+      "completions/mean_terminated_length": 558.283984375,
+      "completions/min_length": 408.0,
+      "completions/min_terminated_length": 408.0,
+      "entropy": 0.29817005395889284,
+      "epoch": 0.0125,
+      "frac_reward_zero_std": 0.8399999737739563,
+      "grad_norm": 0.14453125,
+      "kl": 0.14909197837114335,
+      "learning_rate": 9.950614789456512e-06,
+      "loss": -3.2902939710766074e-05,
+      "num_tokens": 2214781.0,
+      "reward": 0.03273333106189966,
+      "reward_std": 0.04195500072091818,
+      "rewards/env_goofspiel_reward/mean": 0.032733332738280295,
+      "rewards/env_goofspiel_reward/std": 0.12340526506304741,
+      "sampling/importance_sampling_ratio/max": 1.7580672979354859,
+      "sampling/importance_sampling_ratio/mean": 1.0121817111968994,
+      "sampling/importance_sampling_ratio/min": 0.5544978082180023,
+      "sampling/sampling_logp_difference/max": 0.6947145342826844,
+      "sampling/sampling_logp_difference/mean": 0.02995888851583004,
+      "step": 50,
+      "step_time": 8.399313552200056
     },
     {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
+      "completions/max_length": 737.0,
+      "completions/max_terminated_length": 737.0,
+      "completions/mean_length": 563.09599609375,
+      "completions/mean_terminated_length": 563.09599609375,
+      "completions/min_length": 408.0,
+      "completions/min_terminated_length": 408.0,
+      "entropy": 0.3130415454506874,
+      "epoch": 0.01375,
+      "frac_reward_zero_std": 0.8319999814033509,
+      "grad_norm": 0.12451171875,
+      "kl": 0.17116529867053032,
+      "learning_rate": 9.95059356633892e-06,
+      "loss": 0.00011836685007438064,
+      "num_tokens": 2492933.0,
+      "reward": 0.0414799977093935,
+      "reward_std": 0.04919577315449715,
+      "rewards/env_goofspiel_reward/mean": 0.0414799977093935,
+      "rewards/env_goofspiel_reward/std": 0.13337331116199494,
+      "sampling/importance_sampling_ratio/max": 1.614890694618225,
+      "sampling/importance_sampling_ratio/mean": 0.9976115822792053,
+      "sampling/importance_sampling_ratio/min": 0.5176251292228699,
+      "sampling/sampling_logp_difference/max": 0.5567813754081726,
+      "sampling/sampling_logp_difference/mean": 0.030348184704780578,
+      "step": 55,
+      "step_time": 8.462650469800156
     },
     {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 731.8,
+      "completions/max_terminated_length": 731.8,
+      "completions/mean_length": 561.4599853515625,
+      "completions/mean_terminated_length": 561.4599853515625,
+      "completions/min_length": 408.0,
+      "completions/min_terminated_length": 408.0,
+      "entropy": 0.3217264384031296,
+      "epoch": 0.015,
+      "frac_reward_zero_std": 0.8239999771118164,
+      "grad_norm": 0.103515625,
+      "kl": 0.16943022534251212,
+      "learning_rate": 9.950565912033946e-06,
+      "loss": 0.00016170007875189186,
+      "num_tokens": 2768999.0,
+      "reward": 0.046799997240304946,
+      "reward_std": 0.06128258481621742,
+      "rewards/env_goofspiel_reward/mean": 0.046799997240304946,
+      "rewards/env_goofspiel_reward/std": 0.1459730952978134,
+      "sampling/importance_sampling_ratio/max": 1.6248928308486938,
+      "sampling/importance_sampling_ratio/mean": 0.994913375377655,
+      "sampling/importance_sampling_ratio/min": 0.5438100695610046,
+      "sampling/sampling_logp_difference/max": 0.5243477821350098,
+      "sampling/sampling_logp_difference/mean": 0.02915378250181675,
+      "step": 60,
+      "step_time": 8.311450370799957
+    },
+    {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 936.2,
+      "completions/max_terminated_length": 936.2,
+      "completions/mean_length": 718.1879760742188,
+      "completions/mean_terminated_length": 718.1879760742188,
+      "completions/min_length": 517.2,
+      "completions/min_terminated_length": 517.2,
+      "entropy": 0.3693429589271545,
+      "epoch": 0.01625,
+      "frac_reward_zero_std": 0.8319999694824218,
+      "grad_norm": 0.10400390625,
+      "kl": 0.16856326386332512,
+      "learning_rate": 9.950531826589252e-06,
+      "loss": 9.133372223004698e-05,
+      "num_tokens": 3085009.0,
+      "reward": 0.03046666570007801,
+      "reward_std": 0.04365205764770508,
+      "rewards/env_goofspiel_reward/mean": 0.030466666072607042,
+      "rewards/env_goofspiel_reward/std": 0.1246792048215866,
+      "sampling/importance_sampling_ratio/max": 2.0000662088394163,
+      "sampling/importance_sampling_ratio/mean": 0.9988593339920044,
+      "sampling/importance_sampling_ratio/min": 0.5936131238937378,
+      "sampling/sampling_logp_difference/max": 0.661067008972168,
+      "sampling/sampling_logp_difference/mean": 0.029154302552342415,
+      "step": 65,
+      "step_time": 10.795809616799943
+    },
+    {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
+      "completions/clipped_ratio": 0.0,
+      "completions/max_length": 1074.6,
+      "completions/max_terminated_length": 1074.6,
+      "completions/mean_length": 809.1799682617187,
+      "completions/mean_terminated_length": 809.1799682617187,
+      "completions/min_length": 590.0,
+      "completions/min_terminated_length": 590.0,
+      "entropy": 0.3258677929639816,
+      "epoch": 0.0175,
+      "frac_reward_zero_std": 0.8239999771118164,
+      "grad_norm": 0.232421875,
+      "kl": 0.1824295423924923,
+      "learning_rate": 9.950491310063582e-06,
+      "loss": 0.00022613720502704382,
+      "num_tokens": 3421737.0,
+      "reward": 0.039453331381082535,
+      "reward_std": 0.048102113604545596,
+      "rewards/env_goofspiel_reward/mean": 0.03945333361625671,
+      "rewards/env_goofspiel_reward/std": 0.12717084884643554,
+      "sampling/importance_sampling_ratio/max": 1.7261427879333495,
+      "sampling/importance_sampling_ratio/mean": 1.0054854035377503,
+      "sampling/importance_sampling_ratio/min": 0.6340943217277527,
+      "sampling/sampling_logp_difference/max": 0.4532318115234375,
+      "sampling/sampling_logp_difference/mean": 0.02659378871321678,
+      "step": 70,
+      "step_time": 12.004160757599857
+    },
+    {
+      "clip_ratio/high_max": 0.0,
+      "clip_ratio/high_mean": 0.0,
+      "clip_ratio/low_mean": 0.0,
+      "clip_ratio/low_min": 0.0,
+      "clip_ratio/region_mean": 0.0,
       "completions/clipped_ratio": 0.0,
+      "completions/max_length": 1074.0,
+      "completions/max_terminated_length": 1074.0,
+      "completions/mean_length": 813.3439697265625,
+      "completions/mean_terminated_length": 813.3439697265625,
+      "completions/min_length": 590.0,
+      "completions/min_terminated_length": 590.0,
+      "entropy": 0.29610189199447634,
+      "epoch": 0.01875,
+      "frac_reward_zero_std": 0.8639999747276306,
+      "grad_norm": 0.1201171875,
+      "kl": 0.17389494478702544,
+      "learning_rate": 9.950444362526773e-06,
+      "loss": -2.63441979768686e-06,
+      "num_tokens": 3760662.0,
+      "reward": 0.03491999926045537,
+      "reward_std": 0.041691013239324094,
+      "rewards/env_goofspiel_reward/mean": 0.03492000075057149,
+      "rewards/env_goofspiel_reward/std": 0.12171182483434677,
+      "sampling/importance_sampling_ratio/max": 1.5990596771240235,
+      "sampling/importance_sampling_ratio/mean": 1.0042136073112489,
+      "sampling/importance_sampling_ratio/min": 0.5866354703903198,
+      "sampling/sampling_logp_difference/max": 0.49382131099700927,
+      "sampling/sampling_logp_difference/mean": 0.024137656763195993,
+      "step": 75,
+      "step_time": 11.794954787200004
     },
     {
+      "epoch": 0.01875,
       "eval_clip_ratio/high_max": 0.0,
       "eval_clip_ratio/high_mean": 0.0,
       "eval_clip_ratio/low_mean": 0.0,
       "eval_clip_ratio/low_min": 0.0,
       "eval_clip_ratio/region_mean": 0.0,
       "eval_completions/clipped_ratio": 0.0,
+      "eval_completions/max_length": 895.0,
+      "eval_completions/max_terminated_length": 895.0,
+      "eval_completions/mean_length": 806.55,
+      "eval_completions/mean_terminated_length": 806.55,
+      "eval_completions/min_length": 725.8,
+      "eval_completions/min_terminated_length": 725.8,
+      "eval_entropy": 0.3078053116798401,
+      "eval_frac_reward_zero_std": 0.6,
+      "eval_kl": 0.5635438948869705,
+      "eval_loss": 0.0008250019163824618,
+      "eval_num_tokens": 3760662.0,
+      "eval_reward": 0.06899999883025884,
+      "eval_reward_std": 0.10040915999561548,
+      "eval_rewards/env_goofspiel_reward/mean": 0.06899999883025884,
+      "eval_rewards/env_goofspiel_reward/std": 0.11241451688110829,
+      "eval_runtime": 3.5242,
+      "eval_samples_per_second": 2.838,
+      "eval_sampling/importance_sampling_ratio/max": 1.2238447427749635,
+      "eval_sampling/importance_sampling_ratio/mean": 0.9734418511390686,
+      "eval_sampling/importance_sampling_ratio/min": 0.7944899320602417,
+      "eval_sampling/sampling_logp_difference/max": 0.2762513041496277,
+      "eval_sampling/sampling_logp_difference/mean": 0.028397564217448233,
+      "eval_steps_per_second": 0.851,
+      "step": 75
     }
   ],
+  "logging_steps": 5,
+  "max_steps": 12000,
+  "num_input_tokens_seen": 3760662,
+  "num_train_epochs": 3,
   "save_steps": 500,
   "stateful_callbacks": {
     "TrainerControl": {
     }
   },
   "total_flos": 0.0,
+  "train_batch_size": 25,
   "trial_name": null,
   "trial_params": null
 }

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c032b79691ec0f0ef3021b1a710ed25323ffa7544442b5a3dae4d76703d8ce5d
-size 7889

 version https://git-lfs.github.com/spec/v1
+oid sha256:8c53ec641d35398511966f6bbf25ac001ca90c58e99dcc4975f403287921d176
+size 7185