aakritil commited on
Commit
2bb6f58
·
verified ·
1 Parent(s): e23cef2

aakritil/llama2b_reg_dpo_trainer

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .config/.last_opt_in_prompt.yaml +1 -0
  2. .config/.last_survey_prompt.yaml +1 -0
  3. .config/.last_update_check.json +1 -0
  4. .config/active_config +1 -0
  5. .config/config_sentinel +0 -0
  6. .config/configurations/config_default +6 -0
  7. .config/default_configs.db +0 -0
  8. .config/gce +1 -0
  9. .config/hidden_gcloud_config_universe_descriptor_data_cache_configs.db +0 -0
  10. .config/logs/2024.11.25/19.12.20.690274.log +764 -0
  11. .config/logs/2024.11.25/19.12.42.183555.log +5 -0
  12. .config/logs/2024.11.25/19.12.55.136430.log +152 -0
  13. .config/logs/2024.11.25/19.12.56.407212.log +5 -0
  14. .config/logs/2024.11.25/19.13.09.316504.log +8 -0
  15. .config/logs/2024.11.25/19.13.10.119162.log +8 -0
  16. .gitattributes +2 -0
  17. README.md +68 -0
  18. adapter_config.json +29 -0
  19. adapter_model.safetensors +3 -0
  20. dpo_train_dataset/data-00000-of-00001.arrow +3 -0
  21. dpo_train_dataset/dataset_info.json +20 -0
  22. dpo_train_dataset/state.json +13 -0
  23. drive/MyDrive/Colab Notebooks/Copy of Fang CS329x-HW2-Student.ipynb +0 -0
  24. drive/MyDrive/Colab Notebooks/Untitled0.ipynb +0 -0
  25. drive/MyDrive/checkpoint-348/README.md +202 -0
  26. drive/MyDrive/checkpoint-348/adapter_config.json +29 -0
  27. drive/MyDrive/checkpoint-348/adapter_model.safetensors +3 -0
  28. drive/MyDrive/checkpoint-348/optimizer.pt +3 -0
  29. drive/MyDrive/checkpoint-348/rng_state.pth +3 -0
  30. drive/MyDrive/checkpoint-348/scheduler.pt +3 -0
  31. drive/MyDrive/checkpoint-348/special_tokens_map.json +24 -0
  32. drive/MyDrive/checkpoint-348/tokenizer.json +0 -0
  33. drive/MyDrive/checkpoint-348/tokenizer.model +3 -0
  34. drive/MyDrive/checkpoint-348/tokenizer_config.json +42 -0
  35. drive/MyDrive/checkpoint-348/trainer_state.json +1338 -0
  36. drive/MyDrive/checkpoint-348/training_args.bin +3 -0
  37. drive/MyDrive/dpo_model/config.json +45 -0
  38. drive/MyDrive/dpo_model/generation_config.json +10 -0
  39. drive/MyDrive/dpo_model/model.safetensors +3 -0
  40. sample_data/README.md +19 -0
  41. sample_data/anscombe.json +49 -0
  42. sample_data/california_housing_test.csv +0 -0
  43. sample_data/california_housing_train.csv +0 -0
  44. sample_data/mnist_test.csv +3 -0
  45. sample_data/mnist_train_small.csv +3 -0
  46. special_tokens_map.json +24 -0
  47. tokenizer.json +0 -0
  48. tokenizer.model +3 -0
  49. tokenizer/special_tokens_map.json +24 -0
  50. tokenizer/tokenizer.json +0 -0
.config/.last_opt_in_prompt.yaml ADDED
@@ -0,0 +1 @@
 
 
1
+ {}
.config/.last_survey_prompt.yaml ADDED
@@ -0,0 +1 @@
 
 
1
+ last_prompt_time: 1732561974.427224
.config/.last_update_check.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"last_update_check_time": 1732561975.8211122, "last_update_check_revision": 20241115154308, "notifications": [], "last_nag_times": {}}
.config/active_config ADDED
@@ -0,0 +1 @@
 
 
1
+ default
.config/config_sentinel ADDED
File without changes
.config/configurations/config_default ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ [component_manager]
2
+ disable_update_check = true
3
+
4
+ [compute]
5
+ gce_metadata_read_timeout_sec = 0
6
+
.config/default_configs.db ADDED
Binary file (12.3 kB). View file
 
.config/gce ADDED
@@ -0,0 +1 @@
 
 
1
+ False
.config/hidden_gcloud_config_universe_descriptor_data_cache_configs.db ADDED
Binary file (12.3 kB). View file
 
.config/logs/2024.11.25/19.12.20.690274.log ADDED
@@ -0,0 +1,764 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2024-11-25 19:12:32,717 DEBUG root Loaded Command Group: ['gcloud', 'components']
2
+ 2024-11-25 19:12:32,721 DEBUG root Loaded Command Group: ['gcloud', 'components', 'update']
3
+ 2024-11-25 19:12:32,724 DEBUG root Running [gcloud.components.update] with arguments: [--compile-python: "True", --quiet: "True", COMPONENT-IDS:6: "['core', 'gcloud-deps', 'bq', 'gcloud', 'gcloud-crc32c', 'gsutil']"]
4
+ 2024-11-25 19:12:32,725 INFO ___FILE_ONLY___ Beginning update. This process may take several minutes.
5
+
6
+ 2024-11-25 19:12:32,762 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
7
+ 2024-11-25 19:12:32,827 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components-2.json HTTP/1.1" 200 227816
8
+ 2024-11-25 19:12:32,850 INFO ___FILE_ONLY___
9
+
10
+ 2024-11-25 19:12:32,851 INFO ___FILE_ONLY___
11
+ Your current Google Cloud CLI version is: 502.0.0
12
+
13
+ 2024-11-25 19:12:32,851 INFO ___FILE_ONLY___ Installing components from version: 502.0.0
14
+
15
+ 2024-11-25 19:12:32,851 INFO ___FILE_ONLY___
16
+
17
+ 2024-11-25 19:12:32,851 DEBUG root Chosen display Format:table[box,title="These components will be removed."](details.display_name:label=Name:align=left,version.version_string:label=Version:align=right,data.size.size(zero="",min=1048576):label=Size:align=right)
18
+ 2024-11-25 19:12:32,852 DEBUG root Chosen display Format:table[box,title="These components will be updated."](details.display_name:label=Name:align=left,version.version_string:label=Version:align=right,data.size.size(zero="",min=1048576):label=Size:align=right)
19
+ 2024-11-25 19:12:32,853 DEBUG root Chosen display Format:table[box,title="These components will be installed."](details.display_name:label=Name:align=left,version.version_string:label=Version:align=right,data.size.size(zero="",min=1048576):label=Size:align=right)
20
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___ ┌─────────────────────────────────────────────────────────────────────────────┐
21
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___
22
+
23
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___ │ These components will be installed. │
24
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___
25
+
26
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___ ├─────────────────────────────────────────────────────┬────────────┬──────────┤
27
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___
28
+
29
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___ │ Name │ Version │ Size │
30
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___
31
+
32
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___ ├─────────────────────────────────────────────────────┼────────────┼──────────┤
33
+ 2024-11-25 19:12:32,901 INFO ___FILE_ONLY___
34
+
35
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___ │
36
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___ BigQuery Command Line Tool
37
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___
38
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___ │
39
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___ 2.1.9
40
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___
41
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___ │
42
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___ 1.7 MiB
43
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___
44
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___ │
45
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___
46
+
47
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___ │
48
+ 2024-11-25 19:12:32,902 INFO ___FILE_ONLY___ BigQuery Command Line Tool (Platform Specific)
49
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___
50
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___ │
51
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___ 2.1.8
52
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___
53
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___ │
54
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___ < 1 MiB
55
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___
56
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___ │
57
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___
58
+
59
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___ │
60
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___ Bundled Python 3.11 (Platform Specific)
61
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___
62
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___ │
63
+ 2024-11-25 19:12:32,903 INFO ___FILE_ONLY___ 3.11.9
64
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___
65
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___ │
66
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___ 74.4 MiB
67
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___
68
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___ │
69
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___
70
+
71
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___ │
72
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___ Cloud Storage Command Line Tool
73
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___
74
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___ │
75
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___ 5.31
76
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___
77
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___ │
78
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___ 11.3 MiB
79
+ 2024-11-25 19:12:32,904 INFO ___FILE_ONLY___
80
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___ │
81
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___
82
+
83
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___ │
84
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___ Cloud Storage Command Line Tool (Platform Specific)
85
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___
86
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___ │
87
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___ 5.30
88
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___
89
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___ │
90
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___ < 1 MiB
91
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___
92
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___ │
93
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___
94
+
95
+ 2024-11-25 19:12:32,905 INFO ___FILE_ONLY___ │
96
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___ Google Cloud CLI Core Libraries (Platform Specific)
97
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___
98
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___ │
99
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___ 2024.08.30
100
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___
101
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___ │
102
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___ < 1 MiB
103
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___
104
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___ │
105
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___
106
+
107
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___ │
108
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___ Google Cloud CRC32C Hash Tool (Platform Specific)
109
+ 2024-11-25 19:12:32,906 INFO ___FILE_ONLY___
110
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ │
111
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ 1.0.0
112
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___
113
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ │
114
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ 1.3 MiB
115
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___
116
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ │
117
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___
118
+
119
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ │
120
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ gcloud cli dependencies (Platform Specific)
121
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___
122
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ │
123
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ 2021.04.16
124
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___
125
+ 2024-11-25 19:12:32,907 INFO ___FILE_ONLY___ │
126
+ 2024-11-25 19:12:32,908 INFO ___FILE_ONLY___ < 1 MiB
127
+ 2024-11-25 19:12:32,908 INFO ___FILE_ONLY___
128
+ 2024-11-25 19:12:32,908 INFO ___FILE_ONLY___ │
129
+ 2024-11-25 19:12:32,908 INFO ___FILE_ONLY___
130
+
131
+ 2024-11-25 19:12:32,908 INFO ___FILE_ONLY___ └─────────────────────────────────────────────────────┴────────────┴──────────┘
132
+ 2024-11-25 19:12:32,908 INFO ___FILE_ONLY___
133
+
134
+ 2024-11-25 19:12:32,908 INFO ___FILE_ONLY___
135
+
136
+ 2024-11-25 19:12:32,912 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
137
+ 2024-11-25 19:12:32,977 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/RELEASE_NOTES HTTP/1.1" 200 1314602
138
+ 2024-11-25 19:12:33,046 INFO ___FILE_ONLY___ For the latest full release notes, please visit:
139
+ https://cloud.google.com/sdk/release_notes
140
+
141
+
142
+ 2024-11-25 19:12:33,046 INFO ___FILE_ONLY___ Performing in place update...
143
+
144
+
145
+ 2024-11-25 19:12:33,049 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
146
+
147
+ 2024-11-25 19:12:33,049 INFO ___FILE_ONLY___ ╠═ Downloading: BigQuery Command Line Tool ═╣
148
+
149
+ 2024-11-25 19:12:33,049 INFO ___FILE_ONLY___ ╚
150
+ 2024-11-25 19:12:33,053 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
151
+ 2024-11-25 19:12:33,116 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-bq-20241011151610.tar.gz HTTP/1.1" 200 1831026
152
+ 2024-11-25 19:12:33,130 INFO ___FILE_ONLY___ ═
153
+ 2024-11-25 19:12:33,130 INFO ___FILE_ONLY___ ═
154
+ 2024-11-25 19:12:33,130 INFO ___FILE_ONLY___ ═
155
+ 2024-11-25 19:12:33,130 INFO ___FILE_ONLY___ ═
156
+ 2024-11-25 19:12:33,130 INFO ___FILE_ONLY___ ═
157
+ 2024-11-25 19:12:33,130 INFO ___FILE_ONLY___ ═
158
+ 2024-11-25 19:12:33,131 INFO ___FILE_ONLY___ ═
159
+ 2024-11-25 19:12:33,131 INFO ___FILE_ONLY___ ═
160
+ 2024-11-25 19:12:33,131 INFO ___FILE_ONLY___ ═
161
+ 2024-11-25 19:12:33,131 INFO ___FILE_ONLY___ ═
162
+ 2024-11-25 19:12:33,131 INFO ___FILE_ONLY___ ═
163
+ 2024-11-25 19:12:33,131 INFO ___FILE_ONLY___ ═
164
+ 2024-11-25 19:12:33,131 INFO ___FILE_ONLY___ ═
165
+ 2024-11-25 19:12:33,131 INFO ___FILE_ONLY___ ═
166
+ 2024-11-25 19:12:33,132 INFO ___FILE_ONLY___ ═
167
+ 2024-11-25 19:12:33,132 INFO ___FILE_ONLY___ ═
168
+ 2024-11-25 19:12:33,132 INFO ___FILE_ONLY___ ═
169
+ 2024-11-25 19:12:33,132 INFO ___FILE_ONLY___ ═
170
+ 2024-11-25 19:12:33,132 INFO ___FILE_ONLY___ ═
171
+ 2024-11-25 19:12:33,132 INFO ___FILE_ONLY___ ═
172
+ 2024-11-25 19:12:33,132 INFO ___FILE_ONLY___ ═
173
+ 2024-11-25 19:12:33,132 INFO ___FILE_ONLY___ ═
174
+ 2024-11-25 19:12:33,132 INFO ___FILE_ONLY___ ═
175
+ 2024-11-25 19:12:33,133 INFO ___FILE_ONLY___ ═
176
+ 2024-11-25 19:12:33,133 INFO ___FILE_ONLY___ ═
177
+ 2024-11-25 19:12:33,133 INFO ___FILE_ONLY___ ═
178
+ 2024-11-25 19:12:33,133 INFO ___FILE_ONLY___ ═
179
+ 2024-11-25 19:12:33,133 INFO ___FILE_ONLY___ ═
180
+ 2024-11-25 19:12:33,133 INFO ___FILE_ONLY___ ═
181
+ 2024-11-25 19:12:33,133 INFO ___FILE_ONLY___ ═
182
+ 2024-11-25 19:12:33,133 INFO ___FILE_ONLY___ ═
183
+ 2024-11-25 19:12:33,134 INFO ___FILE_ONLY___ ═
184
+ 2024-11-25 19:12:33,134 INFO ___FILE_ONLY___ ═
185
+ 2024-11-25 19:12:33,134 INFO ___FILE_ONLY___ ═
186
+ 2024-11-25 19:12:33,134 INFO ___FILE_ONLY___ ═
187
+ 2024-11-25 19:12:33,134 INFO ___FILE_ONLY___ ═
188
+ 2024-11-25 19:12:33,134 INFO ___FILE_ONLY___ ═
189
+ 2024-11-25 19:12:33,134 INFO ___FILE_ONLY___ ═
190
+ 2024-11-25 19:12:33,134 INFO ___FILE_ONLY___ ═
191
+ 2024-11-25 19:12:33,134 INFO ___FILE_ONLY___ ═
192
+ 2024-11-25 19:12:33,135 INFO ___FILE_ONLY___ ═
193
+ 2024-11-25 19:12:33,135 INFO ___FILE_ONLY___ ═
194
+ 2024-11-25 19:12:33,135 INFO ___FILE_ONLY___ ═
195
+ 2024-11-25 19:12:33,135 INFO ___FILE_ONLY___ ═
196
+ 2024-11-25 19:12:33,135 INFO ___FILE_ONLY___ ═
197
+ 2024-11-25 19:12:33,135 INFO ___FILE_ONLY___ ═
198
+ 2024-11-25 19:12:33,135 INFO ___FILE_ONLY___ ═
199
+ 2024-11-25 19:12:33,135 INFO ___FILE_ONLY___ ═
200
+ 2024-11-25 19:12:33,136 INFO ___FILE_ONLY___ ═
201
+ 2024-11-25 19:12:33,136 INFO ___FILE_ONLY___ ═
202
+ 2024-11-25 19:12:33,136 INFO ___FILE_ONLY___ ═
203
+ 2024-11-25 19:12:33,136 INFO ___FILE_ONLY___ ═
204
+ 2024-11-25 19:12:33,136 INFO ___FILE_ONLY___ ═
205
+ 2024-11-25 19:12:33,136 INFO ___FILE_ONLY___ ═
206
+ 2024-11-25 19:12:33,136 INFO ___FILE_ONLY___ ═
207
+ 2024-11-25 19:12:33,136 INFO ___FILE_ONLY___ ═
208
+ 2024-11-25 19:12:33,136 INFO ___FILE_ONLY___ ═
209
+ 2024-11-25 19:12:33,137 INFO ___FILE_ONLY___ ═
210
+ 2024-11-25 19:12:33,137 INFO ___FILE_ONLY___ ═
211
+ 2024-11-25 19:12:33,137 INFO ___FILE_ONLY___ ═
212
+ 2024-11-25 19:12:33,137 INFO ___FILE_ONLY___ ╝
213
+
214
+ 2024-11-25 19:12:33,139 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
215
+
216
+ 2024-11-25 19:12:33,139 INFO ___FILE_ONLY___ ╠═ Downloading: BigQuery Command Line Tool (Platform Spe... ═╣
217
+
218
+ 2024-11-25 19:12:33,140 INFO ___FILE_ONLY___ ╚
219
+ 2024-11-25 19:12:33,143 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
220
+ 2024-11-25 19:12:33,203 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-bq-nix-20240830134514.tar.gz HTTP/1.1" 200 1914
221
+ 2024-11-25 19:12:33,204 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
222
+ 2024-11-25 19:12:33,205 INFO ___FILE_ONLY___ ╝
223
+
224
+ 2024-11-25 19:12:33,207 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
225
+
226
+ 2024-11-25 19:12:33,207 INFO ___FILE_ONLY___ ╠═ Downloading: Bundled Python 3.11 ═╣
227
+
228
+ 2024-11-25 19:12:33,207 INFO ___FILE_ONLY___ ╚
229
+ 2024-11-25 19:12:33,207 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
230
+ 2024-11-25 19:12:33,207 INFO ___FILE_ONLY___ ╝
231
+
232
+ 2024-11-25 19:12:33,209 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
233
+
234
+ 2024-11-25 19:12:33,209 INFO ___FILE_ONLY___ ╠═ Downloading: Bundled Python 3.11 (Platform Specific) ═╣
235
+
236
+ 2024-11-25 19:12:33,209 INFO ___FILE_ONLY___ ╚
237
+ 2024-11-25 19:12:33,213 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
238
+ 2024-11-25 19:12:33,279 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-bundled-python3-unix-linux-x86_64-20240920144119.tar.gz HTTP/1.1" 200 78001783
239
+ 2024-11-25 19:12:33,595 INFO ___FILE_ONLY___ ═
240
+ 2024-11-25 19:12:33,597 INFO ___FILE_ONLY___ ═
241
+ 2024-11-25 19:12:33,599 INFO ___FILE_ONLY___ ═
242
+ 2024-11-25 19:12:33,601 INFO ___FILE_ONLY___ ═
243
+ 2024-11-25 19:12:33,603 INFO ___FILE_ONLY___ ═
244
+ 2024-11-25 19:12:33,605 INFO ___FILE_ONLY___ ═
245
+ 2024-11-25 19:12:33,606 INFO ___FILE_ONLY___ ═
246
+ 2024-11-25 19:12:33,608 INFO ___FILE_ONLY___ ═
247
+ 2024-11-25 19:12:33,610 INFO ___FILE_ONLY___ ═
248
+ 2024-11-25 19:12:33,612 INFO ___FILE_ONLY___ ═
249
+ 2024-11-25 19:12:33,614 INFO ___FILE_ONLY___ ═
250
+ 2024-11-25 19:12:33,615 INFO ___FILE_ONLY___ ═
251
+ 2024-11-25 19:12:33,617 INFO ___FILE_ONLY___ ═
252
+ 2024-11-25 19:12:33,619 INFO ___FILE_ONLY___ ═
253
+ 2024-11-25 19:12:33,621 INFO ___FILE_ONLY___ ═
254
+ 2024-11-25 19:12:33,623 INFO ___FILE_ONLY___ ═
255
+ 2024-11-25 19:12:33,624 INFO ___FILE_ONLY___ ═
256
+ 2024-11-25 19:12:33,626 INFO ___FILE_ONLY___ ═
257
+ 2024-11-25 19:12:33,628 INFO ___FILE_ONLY___ ═
258
+ 2024-11-25 19:12:33,630 INFO ___FILE_ONLY___ ═
259
+ 2024-11-25 19:12:33,632 INFO ___FILE_ONLY___ ═
260
+ 2024-11-25 19:12:33,634 INFO ___FILE_ONLY___ ═
261
+ 2024-11-25 19:12:33,635 INFO ___FILE_ONLY___ ═
262
+ 2024-11-25 19:12:33,637 INFO ___FILE_ONLY___ ═
263
+ 2024-11-25 19:12:33,639 INFO ___FILE_ONLY___ ═
264
+ 2024-11-25 19:12:33,641 INFO ___FILE_ONLY___ ═
265
+ 2024-11-25 19:12:33,643 INFO ___FILE_ONLY___ ═
266
+ 2024-11-25 19:12:33,644 INFO ___FILE_ONLY___ ═
267
+ 2024-11-25 19:12:33,646 INFO ___FILE_ONLY___ ═
268
+ 2024-11-25 19:12:33,648 INFO ___FILE_ONLY___ ═
269
+ 2024-11-25 19:12:33,650 INFO ___FILE_ONLY___ ═
270
+ 2024-11-25 19:12:33,652 INFO ___FILE_ONLY___ ═
271
+ 2024-11-25 19:12:33,653 INFO ___FILE_ONLY___ ═
272
+ 2024-11-25 19:12:33,655 INFO ___FILE_ONLY___ ═
273
+ 2024-11-25 19:12:33,657 INFO ___FILE_ONLY___ ═
274
+ 2024-11-25 19:12:33,659 INFO ___FILE_ONLY___ ═
275
+ 2024-11-25 19:12:33,660 INFO ___FILE_ONLY___ ═
276
+ 2024-11-25 19:12:33,662 INFO ___FILE_ONLY___ ═
277
+ 2024-11-25 19:12:33,664 INFO ___FILE_ONLY___ ═
278
+ 2024-11-25 19:12:33,666 INFO ___FILE_ONLY___ ═
279
+ 2024-11-25 19:12:33,668 INFO ___FILE_ONLY___ ═
280
+ 2024-11-25 19:12:33,669 INFO ___FILE_ONLY___ ═
281
+ 2024-11-25 19:12:33,671 INFO ___FILE_ONLY___ ═
282
+ 2024-11-25 19:12:33,673 INFO ___FILE_ONLY___ ═
283
+ 2024-11-25 19:12:33,675 INFO ___FILE_ONLY___ ═
284
+ 2024-11-25 19:12:33,676 INFO ___FILE_ONLY___ ═
285
+ 2024-11-25 19:12:33,678 INFO ___FILE_ONLY___ ═
286
+ 2024-11-25 19:12:33,680 INFO ___FILE_ONLY___ ═
287
+ 2024-11-25 19:12:33,682 INFO ___FILE_ONLY___ ═
288
+ 2024-11-25 19:12:33,683 INFO ___FILE_ONLY___ ═
289
+ 2024-11-25 19:12:33,685 INFO ___FILE_ONLY___ ═
290
+ 2024-11-25 19:12:33,687 INFO ___FILE_ONLY___ ═
291
+ 2024-11-25 19:12:33,689 INFO ___FILE_ONLY___ ═
292
+ 2024-11-25 19:12:33,691 INFO ___FILE_ONLY___ ═
293
+ 2024-11-25 19:12:33,693 INFO ___FILE_ONLY___ ═
294
+ 2024-11-25 19:12:33,694 INFO ___FILE_ONLY___ ═
295
+ 2024-11-25 19:12:33,696 INFO ___FILE_ONLY___ ═
296
+ 2024-11-25 19:12:33,698 INFO ___FILE_ONLY___ ═
297
+ 2024-11-25 19:12:33,701 INFO ___FILE_ONLY___ ═
298
+ 2024-11-25 19:12:33,703 INFO ___FILE_ONLY___ ═
299
+ 2024-11-25 19:12:33,703 INFO ___FILE_ONLY___ ╝
300
+
301
+ 2024-11-25 19:12:33,706 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
302
+
303
+ 2024-11-25 19:12:33,706 INFO ___FILE_ONLY___ ╠═ Downloading: Cloud Storage Command Line Tool ═╣
304
+
305
+ 2024-11-25 19:12:33,706 INFO ___FILE_ONLY___ ╚
306
+ 2024-11-25 19:12:33,717 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
307
+ 2024-11-25 19:12:33,779 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-gsutil-20241011151610.tar.gz HTTP/1.1" 200 11831021
308
+ 2024-11-25 19:12:33,829 INFO ___FILE_ONLY___ ═
309
+ 2024-11-25 19:12:33,830 INFO ___FILE_ONLY___ ═
310
+ 2024-11-25 19:12:33,830 INFO ___FILE_ONLY___ ═
311
+ 2024-11-25 19:12:33,831 INFO ___FILE_ONLY___ ═
312
+ 2024-11-25 19:12:33,831 INFO ___FILE_ONLY___ ═
313
+ 2024-11-25 19:12:33,831 INFO ___FILE_ONLY___ ═
314
+ 2024-11-25 19:12:33,832 INFO ___FILE_ONLY___ ═
315
+ 2024-11-25 19:12:33,832 INFO ___FILE_ONLY___ ═
316
+ 2024-11-25 19:12:33,832 INFO ___FILE_ONLY___ ═
317
+ 2024-11-25 19:12:33,833 INFO ___FILE_ONLY___ ═
318
+ 2024-11-25 19:12:33,833 INFO ___FILE_ONLY___ ═
319
+ 2024-11-25 19:12:33,833 INFO ___FILE_ONLY___ ═
320
+ 2024-11-25 19:12:33,834 INFO ___FILE_ONLY___ ═
321
+ 2024-11-25 19:12:33,834 INFO ___FILE_ONLY___ ═
322
+ 2024-11-25 19:12:33,834 INFO ___FILE_ONLY___ ═
323
+ 2024-11-25 19:12:33,835 INFO ___FILE_ONLY___ ═
324
+ 2024-11-25 19:12:33,835 INFO ___FILE_ONLY___ ═
325
+ 2024-11-25 19:12:33,836 INFO ___FILE_ONLY___ ═
326
+ 2024-11-25 19:12:33,836 INFO ___FILE_ONLY___ ═
327
+ 2024-11-25 19:12:33,836 INFO ___FILE_ONLY___ ═
328
+ 2024-11-25 19:12:33,837 INFO ___FILE_ONLY___ ═
329
+ 2024-11-25 19:12:33,837 INFO ___FILE_ONLY___ ═
330
+ 2024-11-25 19:12:33,837 INFO ___FILE_ONLY___ ═
331
+ 2024-11-25 19:12:33,838 INFO ___FILE_ONLY___ ═
332
+ 2024-11-25 19:12:33,838 INFO ___FILE_ONLY___ ═
333
+ 2024-11-25 19:12:33,838 INFO ___FILE_ONLY___ ═
334
+ 2024-11-25 19:12:33,839 INFO ___FILE_ONLY___ ═
335
+ 2024-11-25 19:12:33,839 INFO ___FILE_ONLY___ ═
336
+ 2024-11-25 19:12:33,839 INFO ___FILE_ONLY___ ═
337
+ 2024-11-25 19:12:33,840 INFO ___FILE_ONLY___ ═
338
+ 2024-11-25 19:12:33,840 INFO ___FILE_ONLY___ ═
339
+ 2024-11-25 19:12:33,841 INFO ___FILE_ONLY___ ═
340
+ 2024-11-25 19:12:33,841 INFO ___FILE_ONLY___ ═
341
+ 2024-11-25 19:12:33,841 INFO ___FILE_ONLY___ ═
342
+ 2024-11-25 19:12:33,842 INFO ___FILE_ONLY___ ═
343
+ 2024-11-25 19:12:33,842 INFO ___FILE_ONLY___ ═
344
+ 2024-11-25 19:12:33,842 INFO ___FILE_ONLY___ ═
345
+ 2024-11-25 19:12:33,843 INFO ___FILE_ONLY___ ═
346
+ 2024-11-25 19:12:33,843 INFO ___FILE_ONLY___ ═
347
+ 2024-11-25 19:12:33,843 INFO ___FILE_ONLY___ ═
348
+ 2024-11-25 19:12:33,844 INFO ___FILE_ONLY___ ═
349
+ 2024-11-25 19:12:33,844 INFO ___FILE_ONLY___ ═
350
+ 2024-11-25 19:12:33,844 INFO ___FILE_ONLY___ ═
351
+ 2024-11-25 19:12:33,845 INFO ___FILE_ONLY___ ═
352
+ 2024-11-25 19:12:33,845 INFO ___FILE_ONLY___ ═
353
+ 2024-11-25 19:12:33,845 INFO ___FILE_ONLY___ ═
354
+ 2024-11-25 19:12:33,846 INFO ___FILE_ONLY___ ═
355
+ 2024-11-25 19:12:33,846 INFO ___FILE_ONLY___ ═
356
+ 2024-11-25 19:12:33,847 INFO ___FILE_ONLY___ ═
357
+ 2024-11-25 19:12:33,847 INFO ___FILE_ONLY___ ═
358
+ 2024-11-25 19:12:33,847 INFO ___FILE_ONLY___ ═
359
+ 2024-11-25 19:12:33,848 INFO ___FILE_ONLY___ ═
360
+ 2024-11-25 19:12:33,848 INFO ___FILE_ONLY___ ═
361
+ 2024-11-25 19:12:33,848 INFO ___FILE_ONLY___ ═
362
+ 2024-11-25 19:12:33,849 INFO ___FILE_ONLY___ ═
363
+ 2024-11-25 19:12:33,849 INFO ___FILE_ONLY___ ═
364
+ 2024-11-25 19:12:33,849 INFO ___FILE_ONLY___ ═
365
+ 2024-11-25 19:12:33,850 INFO ___FILE_ONLY___ ═
366
+ 2024-11-25 19:12:33,850 INFO ___FILE_ONLY___ ═
367
+ 2024-11-25 19:12:33,850 INFO ___FILE_ONLY___ ═
368
+ 2024-11-25 19:12:33,851 INFO ___FILE_ONLY___ ╝
369
+
370
+ 2024-11-25 19:12:33,853 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
371
+
372
+ 2024-11-25 19:12:33,853 INFO ___FILE_ONLY___ ╠═ Downloading: Cloud Storage Command Line Tool (Platfor... ═╣
373
+
374
+ 2024-11-25 19:12:33,853 INFO ___FILE_ONLY___ ╚
375
+ 2024-11-25 19:12:33,857 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
376
+ 2024-11-25 19:12:33,922 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-gsutil-nix-20240830134514.tar.gz HTTP/1.1" 200 1928
377
+ 2024-11-25 19:12:33,923 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
378
+ 2024-11-25 19:12:33,923 INFO ___FILE_ONLY___ ╝
379
+
380
+ 2024-11-25 19:12:33,925 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
381
+
382
+ 2024-11-25 19:12:33,925 INFO ___FILE_ONLY___ ╠═ Downloading: Default set of gcloud commands ═╣
383
+
384
+ 2024-11-25 19:12:33,925 INFO ___FILE_ONLY___ ╚
385
+ 2024-11-25 19:12:33,926 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
386
+ 2024-11-25 19:12:33,926 INFO ___FILE_ONLY___ ╝
387
+
388
+ 2024-11-25 19:12:33,928 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
389
+
390
+ 2024-11-25 19:12:33,928 INFO ___FILE_ONLY___ ╠═ Downloading: Google Cloud CLI Core Libraries (Platfor... ═╣
391
+
392
+ 2024-11-25 19:12:33,928 INFO ___FILE_ONLY___ ╚
393
+ 2024-11-25 19:12:33,932 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
394
+ 2024-11-25 19:12:33,998 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-core-nix-20240830134514.tar.gz HTTP/1.1" 200 2306
395
+ 2024-11-25 19:12:33,999 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
396
+ 2024-11-25 19:12:33,999 INFO ___FILE_ONLY___ ╝
397
+
398
+ 2024-11-25 19:12:34,001 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
399
+
400
+ 2024-11-25 19:12:34,001 INFO ___FILE_ONLY___ ╠═ Downloading: Google Cloud CRC32C Hash Tool ═╣
401
+
402
+ 2024-11-25 19:12:34,001 INFO ___FILE_ONLY___ ╚
403
+ 2024-11-25 19:12:34,001 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
404
+ 2024-11-25 19:12:34,002 INFO ___FILE_ONLY___ ╝
405
+
406
+ 2024-11-25 19:12:34,004 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
407
+
408
+ 2024-11-25 19:12:34,004 INFO ___FILE_ONLY___ ╠═ Downloading: Google Cloud CRC32C Hash Tool (Platform ... ═╣
409
+
410
+ 2024-11-25 19:12:34,004 INFO ___FILE_ONLY___ ╚
411
+ 2024-11-25 19:12:34,008 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
412
+ 2024-11-25 19:12:34,074 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-gcloud-crc32c-linux-x86_64-20240712142834.tar.gz HTTP/1.1" 200 1350263
413
+ 2024-11-25 19:12:34,085 INFO ___FILE_ONLY___ ═
414
+ 2024-11-25 19:12:34,085 INFO ___FILE_ONLY___ ═
415
+ 2024-11-25 19:12:34,086 INFO ___FILE_ONLY___ ═
416
+ 2024-11-25 19:12:34,086 INFO ___FILE_ONLY___ ═
417
+ 2024-11-25 19:12:34,086 INFO ___FILE_ONLY___ ═
418
+ 2024-11-25 19:12:34,086 INFO ___FILE_ONLY___ ═
419
+ 2024-11-25 19:12:34,086 INFO ___FILE_ONLY___ ═
420
+ 2024-11-25 19:12:34,086 INFO ___FILE_ONLY___ ═
421
+ 2024-11-25 19:12:34,086 INFO ___FILE_ONLY___ ═
422
+ 2024-11-25 19:12:34,086 INFO ___FILE_ONLY___ ═
423
+ 2024-11-25 19:12:34,086 INFO ___FILE_ONLY___ ═
424
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
425
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
426
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
427
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
428
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
429
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
430
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
431
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
432
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
433
+ 2024-11-25 19:12:34,087 INFO ___FILE_ONLY___ ═
434
+ 2024-11-25 19:12:34,088 INFO ___FILE_ONLY___ ═
435
+ 2024-11-25 19:12:34,088 INFO ___FILE_ONLY___ ═
436
+ 2024-11-25 19:12:34,088 INFO ___FILE_ONLY___ ═
437
+ 2024-11-25 19:12:34,088 INFO ___FILE_ONLY___ ═
438
+ 2024-11-25 19:12:34,088 INFO ___FILE_ONLY___ ═
439
+ 2024-11-25 19:12:34,088 INFO ___FILE_ONLY___ ═
440
+ 2024-11-25 19:12:34,088 INFO ___FILE_ONLY___ ═
441
+ 2024-11-25 19:12:34,088 INFO ___FILE_ONLY___ ═
442
+ 2024-11-25 19:12:34,088 INFO ___FILE_ONLY___ ═
443
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
444
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
445
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
446
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
447
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
448
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
449
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
450
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
451
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
452
+ 2024-11-25 19:12:34,089 INFO ___FILE_ONLY___ ═
453
+ 2024-11-25 19:12:34,090 INFO ___FILE_ONLY___ ═
454
+ 2024-11-25 19:12:34,090 INFO ___FILE_ONLY___ ═
455
+ 2024-11-25 19:12:34,090 INFO ___FILE_ONLY___ ═
456
+ 2024-11-25 19:12:34,090 INFO ___FILE_ONLY___ ═
457
+ 2024-11-25 19:12:34,090 INFO ___FILE_ONLY___ ═
458
+ 2024-11-25 19:12:34,090 INFO ___FILE_ONLY___ ═
459
+ 2024-11-25 19:12:34,090 INFO ___FILE_ONLY___ ═
460
+ 2024-11-25 19:12:34,090 INFO ___FILE_ONLY___ ═
461
+ 2024-11-25 19:12:34,090 INFO ___FILE_ONLY___ ═
462
+ 2024-11-25 19:12:34,091 INFO ___FILE_ONLY___ ═
463
+ 2024-11-25 19:12:34,091 INFO ___FILE_ONLY___ ═
464
+ 2024-11-25 19:12:34,091 INFO ___FILE_ONLY___ ═
465
+ 2024-11-25 19:12:34,091 INFO ___FILE_ONLY___ ═
466
+ 2024-11-25 19:12:34,091 INFO ___FILE_ONLY___ ═
467
+ 2024-11-25 19:12:34,091 INFO ___FILE_ONLY___ ═
468
+ 2024-11-25 19:12:34,091 INFO ___FILE_ONLY___ ═
469
+ 2024-11-25 19:12:34,091 INFO ___FILE_ONLY___ ═
470
+ 2024-11-25 19:12:34,091 INFO ___FILE_ONLY___ ═
471
+ 2024-11-25 19:12:34,092 INFO ___FILE_ONLY___ ═
472
+ 2024-11-25 19:12:34,092 INFO ___FILE_ONLY___ ═
473
+ 2024-11-25 19:12:34,092 INFO ___FILE_ONLY___ ╝
474
+
475
+ 2024-11-25 19:12:34,094 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
476
+
477
+ 2024-11-25 19:12:34,094 INFO ___FILE_ONLY___ ╠═ Downloading: gcloud cli dependencies (Platform Specific) ═╣
478
+
479
+ 2024-11-25 19:12:34,094 INFO ___FILE_ONLY___ ╚
480
+ 2024-11-25 19:12:34,098 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
481
+ 2024-11-25 19:12:34,164 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-gcloud-deps-linux-x86_64-20210416153011.tar.gz HTTP/1.1" 200 104
482
+ 2024-11-25 19:12:34,165 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
483
+ 2024-11-25 19:12:34,165 INFO ___FILE_ONLY___ ╝
484
+
485
+ 2024-11-25 19:12:34,168 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
486
+
487
+ 2024-11-25 19:12:34,168 INFO ___FILE_ONLY___ ╠═ Installing: BigQuery Command Line Tool ═╣
488
+
489
+ 2024-11-25 19:12:34,168 INFO ___FILE_ONLY___ ╚
490
+ 2024-11-25 19:12:34,302 INFO ___FILE_ONLY___ ═
491
+ 2024-11-25 19:12:34,305 INFO ___FILE_ONLY___ ═
492
+ 2024-11-25 19:12:34,308 INFO ___FILE_ONLY___ ═
493
+ 2024-11-25 19:12:34,311 INFO ___FILE_ONLY___ ═
494
+ 2024-11-25 19:12:34,314 INFO ___FILE_ONLY___ ═
495
+ 2024-11-25 19:12:34,316 INFO ___FILE_ONLY___ ═
496
+ 2024-11-25 19:12:34,319 INFO ___FILE_ONLY___ ═
497
+ 2024-11-25 19:12:34,322 INFO ___FILE_ONLY___ ═
498
+ 2024-11-25 19:12:34,325 INFO ___FILE_ONLY___ ═
499
+ 2024-11-25 19:12:34,328 INFO ___FILE_ONLY___ ═
500
+ 2024-11-25 19:12:34,330 INFO ___FILE_ONLY___ ═
501
+ 2024-11-25 19:12:34,333 INFO ___FILE_ONLY___ ═
502
+ 2024-11-25 19:12:34,335 INFO ___FILE_ONLY___ ═
503
+ 2024-11-25 19:12:34,338 INFO ___FILE_ONLY___ ═
504
+ 2024-11-25 19:12:34,341 INFO ___FILE_ONLY___ ═
505
+ 2024-11-25 19:12:34,344 INFO ___FILE_ONLY___ ═
506
+ 2024-11-25 19:12:34,346 INFO ___FILE_ONLY___ ═
507
+ 2024-11-25 19:12:34,350 INFO ___FILE_ONLY___ ═
508
+ 2024-11-25 19:12:34,353 INFO ___FILE_ONLY___ ═
509
+ 2024-11-25 19:12:34,356 INFO ___FILE_ONLY___ ═
510
+ 2024-11-25 19:12:34,359 INFO ___FILE_ONLY___ ═
511
+ 2024-11-25 19:12:34,361 INFO ___FILE_ONLY___ ═
512
+ 2024-11-25 19:12:34,363 INFO ___FILE_ONLY___ ═
513
+ 2024-11-25 19:12:34,366 INFO ___FILE_ONLY___ ═
514
+ 2024-11-25 19:12:34,369 INFO ___FILE_ONLY___ ═
515
+ 2024-11-25 19:12:34,371 INFO ___FILE_ONLY___ ═
516
+ 2024-11-25 19:12:34,374 INFO ___FILE_ONLY___ ═
517
+ 2024-11-25 19:12:34,377 INFO ___FILE_ONLY___ ═
518
+ 2024-11-25 19:12:34,381 INFO ___FILE_ONLY___ ═
519
+ 2024-11-25 19:12:34,383 INFO ___FILE_ONLY___ ═
520
+ 2024-11-25 19:12:34,386 INFO ___FILE_ONLY___ ═
521
+ 2024-11-25 19:12:34,389 INFO ___FILE_ONLY___ ═
522
+ 2024-11-25 19:12:34,392 INFO ___FILE_ONLY___ ═
523
+ 2024-11-25 19:12:34,396 INFO ___FILE_ONLY___ ═
524
+ 2024-11-25 19:12:34,406 INFO ___FILE_ONLY___ ═
525
+ 2024-11-25 19:12:34,408 INFO ___FILE_ONLY___ ═
526
+ 2024-11-25 19:12:34,411 INFO ___FILE_ONLY___ ═
527
+ 2024-11-25 19:12:34,416 INFO ___FILE_ONLY___ ═
528
+ 2024-11-25 19:12:34,419 INFO ___FILE_ONLY___ ═
529
+ 2024-11-25 19:12:34,422 INFO ___FILE_ONLY___ ═
530
+ 2024-11-25 19:12:34,424 INFO ___FILE_ONLY___ ═
531
+ 2024-11-25 19:12:34,427 INFO ___FILE_ONLY___ ═
532
+ 2024-11-25 19:12:34,432 INFO ___FILE_ONLY___ ═
533
+ 2024-11-25 19:12:34,435 INFO ___FILE_ONLY___ ═
534
+ 2024-11-25 19:12:34,437 INFO ___FILE_ONLY___ ═
535
+ 2024-11-25 19:12:34,440 INFO ___FILE_ONLY___ ═
536
+ 2024-11-25 19:12:34,443 INFO ___FILE_ONLY___ ═
537
+ 2024-11-25 19:12:34,445 INFO ___FILE_ONLY___ ═
538
+ 2024-11-25 19:12:34,448 INFO ___FILE_ONLY___ ═
539
+ 2024-11-25 19:12:34,451 INFO ___FILE_ONLY___ ═
540
+ 2024-11-25 19:12:34,453 INFO ___FILE_ONLY___ ═
541
+ 2024-11-25 19:12:34,455 INFO ___FILE_ONLY___ ═
542
+ 2024-11-25 19:12:34,457 INFO ___FILE_ONLY___ ═
543
+ 2024-11-25 19:12:34,460 INFO ___FILE_ONLY___ ═
544
+ 2024-11-25 19:12:34,463 INFO ___FILE_ONLY___ ═
545
+ 2024-11-25 19:12:34,465 INFO ___FILE_ONLY___ ═
546
+ 2024-11-25 19:12:34,468 INFO ___FILE_ONLY___ ═
547
+ 2024-11-25 19:12:34,471 INFO ___FILE_ONLY___ ═
548
+ 2024-11-25 19:12:34,473 INFO ___FILE_ONLY___ ═
549
+ 2024-11-25 19:12:34,476 INFO ___FILE_ONLY___ ═
550
+ 2024-11-25 19:12:34,476 INFO ___FILE_ONLY___ ╝
551
+
552
+ 2024-11-25 19:12:34,497 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
553
+
554
+ 2024-11-25 19:12:34,497 INFO ___FILE_ONLY___ ╠═ Installing: BigQuery Command Line Tool (Platform Spec... ═╣
555
+
556
+ 2024-11-25 19:12:34,497 INFO ___FILE_ONLY___ ╚
557
+ 2024-11-25 19:12:34,498 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
558
+ 2024-11-25 19:12:34,499 INFO ___FILE_ONLY___ ╝
559
+
560
+ 2024-11-25 19:12:34,507 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
561
+
562
+ 2024-11-25 19:12:34,507 INFO ___FILE_ONLY___ ╠═ Installing: Bundled Python 3.11 ═╣
563
+
564
+ 2024-11-25 19:12:34,507 INFO ___FILE_ONLY___ ╚
565
+ 2024-11-25 19:12:34,513 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
566
+ 2024-11-25 19:12:34,514 INFO ___FILE_ONLY___ ╝
567
+
568
+ 2024-11-25 19:12:34,516 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
569
+
570
+ 2024-11-25 19:12:34,516 INFO ___FILE_ONLY___ ╠═ Installing: Bundled Python 3.11 (Platform Specific) ═╣
571
+
572
+ 2024-11-25 19:12:34,516 INFO ___FILE_ONLY___ ╚
573
+ 2024-11-25 19:12:36,827 INFO ___FILE_ONLY___ ═
574
+ 2024-11-25 19:12:36,845 INFO ___FILE_ONLY___ ═
575
+ 2024-11-25 19:12:36,862 INFO ___FILE_ONLY___ ═
576
+ 2024-11-25 19:12:36,876 INFO ___FILE_ONLY___ ═
577
+ 2024-11-25 19:12:36,891 INFO ___FILE_ONLY___ ═
578
+ 2024-11-25 19:12:36,906 INFO ___FILE_ONLY___ ═
579
+ 2024-11-25 19:12:36,921 INFO ___FILE_ONLY___ ═
580
+ 2024-11-25 19:12:36,936 INFO ___FILE_ONLY___ ═
581
+ 2024-11-25 19:12:36,951 INFO ___FILE_ONLY___ ═
582
+ 2024-11-25 19:12:36,966 INFO ___FILE_ONLY___ ═
583
+ 2024-11-25 19:12:36,981 INFO ___FILE_ONLY___ ═
584
+ 2024-11-25 19:12:36,995 INFO ___FILE_ONLY___ ═
585
+ 2024-11-25 19:12:37,010 INFO ___FILE_ONLY___ ═
586
+ 2024-11-25 19:12:37,025 INFO ___FILE_ONLY___ ═
587
+ 2024-11-25 19:12:37,040 INFO ___FILE_ONLY___ ═
588
+ 2024-11-25 19:12:37,056 INFO ___FILE_ONLY___ ═
589
+ 2024-11-25 19:12:37,071 INFO ___FILE_ONLY___ ═
590
+ 2024-11-25 19:12:37,086 INFO ___FILE_ONLY___ ═
591
+ 2024-11-25 19:12:37,101 INFO ___FILE_ONLY___ ═
592
+ 2024-11-25 19:12:37,116 INFO ___FILE_ONLY___ ═
593
+ 2024-11-25 19:12:37,131 INFO ___FILE_ONLY___ ═
594
+ 2024-11-25 19:12:37,146 INFO ___FILE_ONLY___ ═
595
+ 2024-11-25 19:12:37,161 INFO ___FILE_ONLY___ ═
596
+ 2024-11-25 19:12:37,177 INFO ___FILE_ONLY___ ═
597
+ 2024-11-25 19:12:37,192 INFO ___FILE_ONLY___ ═
598
+ 2024-11-25 19:12:37,208 INFO ___FILE_ONLY___ ═
599
+ 2024-11-25 19:12:37,223 INFO ___FILE_ONLY___ ═
600
+ 2024-11-25 19:12:37,238 INFO ___FILE_ONLY___ ═
601
+ 2024-11-25 19:12:37,254 INFO ___FILE_ONLY___ ═
602
+ 2024-11-25 19:12:37,268 INFO ___FILE_ONLY___ ═
603
+ 2024-11-25 19:12:37,283 INFO ___FILE_ONLY___ ═
604
+ 2024-11-25 19:12:37,298 INFO ___FILE_ONLY___ ═
605
+ 2024-11-25 19:12:37,312 INFO ___FILE_ONLY___ ═
606
+ 2024-11-25 19:12:37,327 INFO ___FILE_ONLY___ ═
607
+ 2024-11-25 19:12:37,342 INFO ___FILE_ONLY___ ═
608
+ 2024-11-25 19:12:37,357 INFO ___FILE_ONLY___ ═
609
+ 2024-11-25 19:12:38,155 INFO ___FILE_ONLY___ ═
610
+ 2024-11-25 19:12:38,185 INFO ___FILE_ONLY___ ═
611
+ 2024-11-25 19:12:38,211 INFO ___FILE_ONLY___ ═
612
+ 2024-11-25 19:12:38,235 INFO ___FILE_ONLY___ ═
613
+ 2024-11-25 19:12:38,259 INFO ___FILE_ONLY___ ═
614
+ 2024-11-25 19:12:38,407 INFO ___FILE_ONLY___ ═
615
+ 2024-11-25 19:12:38,439 INFO ___FILE_ONLY___ ═
616
+ 2024-11-25 19:12:38,460 INFO ___FILE_ONLY___ ═
617
+ 2024-11-25 19:12:38,479 INFO ___FILE_ONLY___ ═
618
+ 2024-11-25 19:12:38,500 INFO ___FILE_ONLY___ ═
619
+ 2024-11-25 19:12:38,533 INFO ___FILE_ONLY___ ═
620
+ 2024-11-25 19:12:38,557 INFO ___FILE_ONLY___ ═
621
+ 2024-11-25 19:12:38,578 INFO ___FILE_ONLY___ ═
622
+ 2024-11-25 19:12:38,595 INFO ___FILE_ONLY___ ═
623
+ 2024-11-25 19:12:38,696 INFO ___FILE_ONLY___ ═
624
+ 2024-11-25 19:12:38,718 INFO ___FILE_ONLY___ ═
625
+ 2024-11-25 19:12:38,741 INFO ___FILE_ONLY___ ═
626
+ 2024-11-25 19:12:38,762 INFO ___FILE_ONLY___ ═
627
+ 2024-11-25 19:12:38,812 INFO ___FILE_ONLY___ ═
628
+ 2024-11-25 19:12:39,248 INFO ___FILE_ONLY___ ═
629
+ 2024-11-25 19:12:39,272 INFO ___FILE_ONLY___ ═
630
+ 2024-11-25 19:12:39,297 INFO ___FILE_ONLY___ ═
631
+ 2024-11-25 19:12:39,317 INFO ___FILE_ONLY___ ═
632
+ 2024-11-25 19:12:39,719 INFO ___FILE_ONLY___ ═
633
+ 2024-11-25 19:12:39,719 INFO ___FILE_ONLY___ ╝
634
+
635
+ 2024-11-25 19:12:39,837 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
636
+
637
+ 2024-11-25 19:12:39,838 INFO ___FILE_ONLY___ ╠═ Installing: Cloud Storage Command Line Tool ═╣
638
+
639
+ 2024-11-25 19:12:39,838 INFO ___FILE_ONLY___ ╚
640
+ 2024-11-25 19:12:40,563 INFO ___FILE_ONLY___ ═
641
+ 2024-11-25 19:12:40,580 INFO ___FILE_ONLY___ ═
642
+ 2024-11-25 19:12:40,604 INFO ___FILE_ONLY___ ═
643
+ 2024-11-25 19:12:40,626 INFO ___FILE_ONLY___ ═
644
+ 2024-11-25 19:12:40,642 INFO ___FILE_ONLY___ ═
645
+ 2024-11-25 19:12:40,653 INFO ___FILE_ONLY___ ═
646
+ 2024-11-25 19:12:40,665 INFO ___FILE_ONLY___ ═
647
+ 2024-11-25 19:12:40,678 INFO ___FILE_ONLY___ ═
648
+ 2024-11-25 19:12:40,690 INFO ___FILE_ONLY___ ═
649
+ 2024-11-25 19:12:40,702 INFO ___FILE_ONLY___ ═
650
+ 2024-11-25 19:12:40,716 INFO ___FILE_ONLY___ ═
651
+ 2024-11-25 19:12:40,729 INFO ___FILE_ONLY___ ═
652
+ 2024-11-25 19:12:40,742 INFO ___FILE_ONLY___ ═
653
+ 2024-11-25 19:12:40,754 INFO ___FILE_ONLY___ ═
654
+ 2024-11-25 19:12:40,769 INFO ___FILE_ONLY___ ═
655
+ 2024-11-25 19:12:40,783 INFO ___FILE_ONLY___ ═
656
+ 2024-11-25 19:12:40,799 INFO ___FILE_ONLY___ ═
657
+ 2024-11-25 19:12:40,815 INFO ___FILE_ONLY___ ═
658
+ 2024-11-25 19:12:40,828 INFO ___FILE_ONLY___ ═
659
+ 2024-11-25 19:12:40,844 INFO ___FILE_ONLY___ ═
660
+ 2024-11-25 19:12:40,860 INFO ___FILE_ONLY___ ═
661
+ 2024-11-25 19:12:40,877 INFO ___FILE_ONLY___ ═
662
+ 2024-11-25 19:12:40,891 INFO ___FILE_ONLY___ ═
663
+ 2024-11-25 19:12:40,904 INFO ___FILE_ONLY___ ═
664
+ 2024-11-25 19:12:40,921 INFO ___FILE_ONLY___ ═
665
+ 2024-11-25 19:12:40,938 INFO ___FILE_ONLY___ ═
666
+ 2024-11-25 19:12:40,957 INFO ___FILE_ONLY___ ═
667
+ 2024-11-25 19:12:40,978 INFO ___FILE_ONLY___ ═
668
+ 2024-11-25 19:12:41,002 INFO ___FILE_ONLY___ ═
669
+ 2024-11-25 19:12:41,017 INFO ___FILE_ONLY___ ═
670
+ 2024-11-25 19:12:41,028 INFO ___FILE_ONLY___ ═
671
+ 2024-11-25 19:12:41,042 INFO ___FILE_ONLY___ ═
672
+ 2024-11-25 19:12:41,053 INFO ___FILE_ONLY___ ═
673
+ 2024-11-25 19:12:41,064 INFO ___FILE_ONLY___ ═
674
+ 2024-11-25 19:12:41,078 INFO ___FILE_ONLY___ ═
675
+ 2024-11-25 19:12:41,092 INFO ___FILE_ONLY___ ═
676
+ 2024-11-25 19:12:41,104 INFO ___FILE_ONLY___ ═
677
+ 2024-11-25 19:12:41,116 INFO ___FILE_ONLY___ ═
678
+ 2024-11-25 19:12:41,129 INFO ___FILE_ONLY___ ═
679
+ 2024-11-25 19:12:41,142 INFO ___FILE_ONLY___ ═
680
+ 2024-11-25 19:12:41,183 INFO ___FILE_ONLY___ ═
681
+ 2024-11-25 19:12:41,200 INFO ___FILE_ONLY___ ═
682
+ 2024-11-25 19:12:41,213 INFO ___FILE_ONLY___ ═
683
+ 2024-11-25 19:12:41,227 INFO ___FILE_ONLY___ ═
684
+ 2024-11-25 19:12:41,239 INFO ___FILE_ONLY___ ═
685
+ 2024-11-25 19:12:41,250 INFO ___FILE_ONLY___ ═
686
+ 2024-11-25 19:12:41,262 INFO ___FILE_ONLY___ ═
687
+ 2024-11-25 19:12:41,275 INFO ___FILE_ONLY___ ═
688
+ 2024-11-25 19:12:41,296 INFO ___FILE_ONLY___ ═
689
+ 2024-11-25 19:12:41,309 INFO ___FILE_ONLY___ ═
690
+ 2024-11-25 19:12:41,321 INFO ___FILE_ONLY___ ═
691
+ 2024-11-25 19:12:41,331 INFO ___FILE_ONLY___ ═
692
+ 2024-11-25 19:12:41,348 INFO ___FILE_ONLY___ ═
693
+ 2024-11-25 19:12:41,362 INFO ___FILE_ONLY___ ═
694
+ 2024-11-25 19:12:41,377 INFO ___FILE_ONLY___ ═
695
+ 2024-11-25 19:12:41,396 INFO ___FILE_ONLY___ ═
696
+ 2024-11-25 19:12:41,409 INFO ___FILE_ONLY___ ═
697
+ 2024-11-25 19:12:41,423 INFO ___FILE_ONLY___ ═
698
+ 2024-11-25 19:12:41,434 INFO ___FILE_ONLY___ ═
699
+ 2024-11-25 19:12:41,446 INFO ___FILE_ONLY___ ═
700
+ 2024-11-25 19:12:41,446 INFO ___FILE_ONLY___ ╝
701
+
702
+ 2024-11-25 19:12:41,524 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
703
+
704
+ 2024-11-25 19:12:41,524 INFO ___FILE_ONLY___ ╠═ Installing: Cloud Storage Command Line Tool (Platform... ═╣
705
+
706
+ 2024-11-25 19:12:41,524 INFO ___FILE_ONLY___ ╚
707
+ 2024-11-25 19:12:41,525 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
708
+ 2024-11-25 19:12:41,525 INFO ___FILE_ONLY___ ╝
709
+
710
+ 2024-11-25 19:12:41,534 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
711
+
712
+ 2024-11-25 19:12:41,534 INFO ___FILE_ONLY___ ╠═ Installing: Default set of gcloud commands ═╣
713
+
714
+ 2024-11-25 19:12:41,534 INFO ___FILE_ONLY___ ╚
715
+ 2024-11-25 19:12:41,540 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
716
+ 2024-11-25 19:12:41,540 INFO ___FILE_ONLY___ ╝
717
+
718
+ 2024-11-25 19:12:41,542 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
719
+
720
+ 2024-11-25 19:12:41,542 INFO ___FILE_ONLY___ ╠═ Installing: Google Cloud CLI Core Libraries (Platform... ═╣
721
+
722
+ 2024-11-25 19:12:41,542 INFO ___FILE_ONLY___ ╚
723
+ 2024-11-25 19:12:41,544 INFO ___FILE_ONLY___ ══════════════════════════════
724
+ 2024-11-25 19:12:41,544 INFO ___FILE_ONLY___ ══════════════════════════════
725
+ 2024-11-25 19:12:41,544 INFO ___FILE_ONLY___ ╝
726
+
727
+ 2024-11-25 19:12:41,553 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
728
+
729
+ 2024-11-25 19:12:41,553 INFO ___FILE_ONLY___ ╠═ Installing: Google Cloud CRC32C Hash Tool ═╣
730
+
731
+ 2024-11-25 19:12:41,553 INFO ___FILE_ONLY___ ╚
732
+ 2024-11-25 19:12:41,559 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
733
+ 2024-11-25 19:12:41,559 INFO ___FILE_ONLY___ ╝
734
+
735
+ 2024-11-25 19:12:41,562 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
736
+
737
+ 2024-11-25 19:12:41,562 INFO ___FILE_ONLY___ ╠═ Installing: Google Cloud CRC32C Hash Tool (Platform S... ═╣
738
+
739
+ 2024-11-25 19:12:41,562 INFO ___FILE_ONLY___ ╚
740
+ 2024-11-25 19:12:41,600 INFO ___FILE_ONLY___ ══════════════════════════════
741
+ 2024-11-25 19:12:41,600 INFO ___FILE_ONLY___ ══════════════════════════════
742
+ 2024-11-25 19:12:41,600 INFO ___FILE_ONLY___ ╝
743
+
744
+ 2024-11-25 19:12:41,609 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
745
+
746
+ 2024-11-25 19:12:41,610 INFO ___FILE_ONLY___ ╠═ Installing: gcloud cli dependencies (Platform Specific) ═╣
747
+
748
+ 2024-11-25 19:12:41,610 INFO ___FILE_ONLY___ ╚
749
+ 2024-11-25 19:12:41,610 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
750
+ 2024-11-25 19:12:41,610 INFO ___FILE_ONLY___ ╝
751
+
752
+ 2024-11-25 19:12:41,622 DEBUG root Updating notification cache...
753
+ 2024-11-25 19:12:41,623 INFO ___FILE_ONLY___
754
+
755
+ 2024-11-25 19:12:41,625 INFO ___FILE_ONLY___ Performing post processing steps...
756
+ 2024-11-25 19:12:41,625 DEBUG root Executing command: ['/tools/google-cloud-sdk/bin/gcloud', 'components', 'post-process']
757
+ 2024-11-25 19:12:54,324 DEBUG ___FILE_ONLY___
758
+ 2024-11-25 19:12:54,324 DEBUG ___FILE_ONLY___
759
+ 2024-11-25 19:12:54,421 INFO ___FILE_ONLY___
760
+ Update done!
761
+
762
+
763
+ 2024-11-25 19:12:54,425 DEBUG root Chosen display Format:none
764
+ 2024-11-25 19:12:54,426 INFO root Display format: "none"
.config/logs/2024.11.25/19.12.42.183555.log ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ 2024-11-25 19:12:42,184 DEBUG root Loaded Command Group: ['gcloud', 'components']
2
+ 2024-11-25 19:12:42,187 DEBUG root Loaded Command Group: ['gcloud', 'components', 'post_process']
3
+ 2024-11-25 19:12:42,190 DEBUG root Running [gcloud.components.post-process] with arguments: []
4
+ 2024-11-25 19:12:54,188 DEBUG root Chosen display Format:none
5
+ 2024-11-25 19:12:54,189 INFO root Display format: "none"
.config/logs/2024.11.25/19.12.55.136430.log ADDED
@@ -0,0 +1,152 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2024-11-25 19:12:55,137 DEBUG root Loaded Command Group: ['gcloud', 'components']
2
+ 2024-11-25 19:12:55,140 DEBUG root Loaded Command Group: ['gcloud', 'components', 'update']
3
+ 2024-11-25 19:12:55,143 DEBUG root Running [gcloud.components.update] with arguments: [--quiet: "True", COMPONENT-IDS:8: "['gcloud', 'core', 'bq', 'gsutil', 'compute', 'preview', 'alpha', 'beta']"]
4
+ 2024-11-25 19:12:55,144 INFO ___FILE_ONLY___ Beginning update. This process may take several minutes.
5
+
6
+ 2024-11-25 19:12:55,155 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
7
+ 2024-11-25 19:12:55,222 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components-2.json HTTP/1.1" 200 227816
8
+ 2024-11-25 19:12:55,247 WARNING root Component [compute] no longer exists.
9
+ 2024-11-25 19:12:55,248 INFO ___FILE_ONLY___
10
+
11
+ 2024-11-25 19:12:55,249 INFO ___FILE_ONLY___
12
+ Your current Google Cloud CLI version is: 502.0.0
13
+
14
+ 2024-11-25 19:12:55,249 INFO ___FILE_ONLY___ Installing components from version: 502.0.0
15
+
16
+ 2024-11-25 19:12:55,249 INFO ___FILE_ONLY___
17
+
18
+ 2024-11-25 19:12:55,249 DEBUG root Chosen display Format:table[box,title="These components will be removed."](details.display_name:label=Name:align=left,version.version_string:label=Version:align=right,data.size.size(zero="",min=1048576):label=Size:align=right)
19
+ 2024-11-25 19:12:55,250 DEBUG root Chosen display Format:table[box,title="These components will be updated."](details.display_name:label=Name:align=left,version.version_string:label=Version:align=right,data.size.size(zero="",min=1048576):label=Size:align=right)
20
+ 2024-11-25 19:12:55,251 DEBUG root Chosen display Format:table[box,title="These components will be installed."](details.display_name:label=Name:align=left,version.version_string:label=Version:align=right,data.size.size(zero="",min=1048576):label=Size:align=right)
21
+ 2024-11-25 19:12:55,272 INFO ___FILE_ONLY___ ┌────────────────────────────────────────────────┐
22
+ 2024-11-25 19:12:55,272 INFO ___FILE_ONLY___
23
+
24
+ 2024-11-25 19:12:55,272 INFO ___FILE_ONLY___ │ These components will be installed. │
25
+ 2024-11-25 19:12:55,272 INFO ___FILE_ONLY___
26
+
27
+ 2024-11-25 19:12:55,272 INFO ___FILE_ONLY___ ├─────────────────────────┬────────────┬─────────┤
28
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___
29
+
30
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___ │ Name │ Version │ Size │
31
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___
32
+
33
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___ ├─────────────────────────┼────────────┼─────────┤
34
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___
35
+
36
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___ │
37
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___ gcloud Alpha Commands
38
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___
39
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___ │
40
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___ 2024.11.15
41
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___
42
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___ │
43
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___ < 1 MiB
44
+ 2024-11-25 19:12:55,273 INFO ___FILE_ONLY___
45
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___ │
46
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___
47
+
48
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___ │
49
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___ gcloud Beta Commands
50
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___
51
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___ │
52
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___ 2024.11.15
53
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___
54
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___ │
55
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___ < 1 MiB
56
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___
57
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___ │
58
+ 2024-11-25 19:12:55,274 INFO ___FILE_ONLY___
59
+
60
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___ │
61
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___ gcloud Preview Commands
62
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___
63
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___ │
64
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___
65
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___
66
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___ │
67
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___ < 1 MiB
68
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___
69
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___ │
70
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___
71
+
72
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___ └─────────────────────────┴──��─────────┴─────────┘
73
+ 2024-11-25 19:12:55,275 INFO ___FILE_ONLY___
74
+
75
+ 2024-11-25 19:12:55,276 INFO ___FILE_ONLY___
76
+
77
+ 2024-11-25 19:12:55,279 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
78
+ 2024-11-25 19:12:55,346 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/RELEASE_NOTES HTTP/1.1" 200 1314602
79
+ 2024-11-25 19:12:55,420 INFO ___FILE_ONLY___ For the latest full release notes, please visit:
80
+ https://cloud.google.com/sdk/release_notes
81
+
82
+
83
+ 2024-11-25 19:12:55,421 INFO ___FILE_ONLY___ Performing in place update...
84
+
85
+
86
+ 2024-11-25 19:12:55,423 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
87
+
88
+ 2024-11-25 19:12:55,423 INFO ___FILE_ONLY___ ╠═ Downloading: gcloud Alpha Commands ═╣
89
+
90
+ 2024-11-25 19:12:55,423 INFO ___FILE_ONLY___ ╚
91
+ 2024-11-25 19:12:55,427 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
92
+ 2024-11-25 19:12:55,493 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-alpha-20241115154308.tar.gz HTTP/1.1" 200 800
93
+ 2024-11-25 19:12:55,494 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
94
+ 2024-11-25 19:12:55,494 INFO ___FILE_ONLY___ ╝
95
+
96
+ 2024-11-25 19:12:55,496 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
97
+
98
+ 2024-11-25 19:12:55,496 INFO ___FILE_ONLY___ ╠═ Downloading: gcloud Beta Commands ═╣
99
+
100
+ 2024-11-25 19:12:55,496 INFO ___FILE_ONLY___ ╚
101
+ 2024-11-25 19:12:55,500 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
102
+ 2024-11-25 19:12:55,564 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-beta-20241115154308.tar.gz HTTP/1.1" 200 797
103
+ 2024-11-25 19:12:55,565 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
104
+ 2024-11-25 19:12:55,565 INFO ___FILE_ONLY___ ╝
105
+
106
+ 2024-11-25 19:12:55,567 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
107
+
108
+ 2024-11-25 19:12:55,568 INFO ___FILE_ONLY___ ╠═ Downloading: gcloud Preview Commands ═╣
109
+
110
+ 2024-11-25 19:12:55,568 INFO ___FILE_ONLY___ ╚
111
+ 2024-11-25 19:12:55,571 DEBUG urllib3.connectionpool Starting new HTTPS connection (1): dl.google.com:443
112
+ 2024-11-25 19:12:55,737 DEBUG urllib3.connectionpool https://dl.google.com:443 "GET /dl/cloudsdk/channels/rapid/components/google-cloud-sdk-preview-20241115154308.tar.gz HTTP/1.1" 200 823
113
+ 2024-11-25 19:12:55,739 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
114
+ 2024-11-25 19:12:55,739 INFO ___FILE_ONLY___ ╝
115
+
116
+ 2024-11-25 19:12:55,743 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
117
+
118
+ 2024-11-25 19:12:55,743 INFO ___FILE_ONLY___ ╠═ Installing: gcloud Alpha Commands ═╣
119
+
120
+ 2024-11-25 19:12:55,744 INFO ___FILE_ONLY___ ╚
121
+ 2024-11-25 19:12:55,745 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
122
+ 2024-11-25 19:12:55,746 INFO ___FILE_ONLY___ ╝
123
+
124
+ 2024-11-25 19:12:55,775 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
125
+
126
+ 2024-11-25 19:12:55,775 INFO ___FILE_ONLY___ ╠═ Installing: gcloud Beta Commands ═╣
127
+
128
+ 2024-11-25 19:12:55,776 INFO ___FILE_ONLY___ ╚
129
+ 2024-11-25 19:12:55,777 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
130
+ 2024-11-25 19:12:55,778 INFO ___FILE_ONLY___ ╝
131
+
132
+ 2024-11-25 19:12:55,794 INFO ___FILE_ONLY___ ╔════════════════════════════════════════════════════════════╗
133
+
134
+ 2024-11-25 19:12:55,794 INFO ___FILE_ONLY___ ╠═ Installing: gcloud Preview Commands ═╣
135
+
136
+ 2024-11-25 19:12:55,795 INFO ___FILE_ONLY___ ╚
137
+ 2024-11-25 19:12:55,797 INFO ___FILE_ONLY___ ════════════════════════════════════════════════════════════
138
+ 2024-11-25 19:12:55,797 INFO ___FILE_ONLY___ ╝
139
+
140
+ 2024-11-25 19:12:55,820 DEBUG root Updating notification cache...
141
+ 2024-11-25 19:12:55,822 INFO ___FILE_ONLY___
142
+
143
+ 2024-11-25 19:12:55,826 INFO ___FILE_ONLY___ Performing post processing steps...
144
+ 2024-11-25 19:12:55,827 DEBUG root Executing command: ['/tools/google-cloud-sdk/bin/gcloud', 'components', 'post-process']
145
+ 2024-11-25 19:13:08,459 DEBUG ___FILE_ONLY___
146
+ 2024-11-25 19:13:08,459 DEBUG ___FILE_ONLY___
147
+ 2024-11-25 19:13:08,603 INFO ___FILE_ONLY___
148
+ Update done!
149
+
150
+
151
+ 2024-11-25 19:13:08,607 DEBUG root Chosen display Format:none
152
+ 2024-11-25 19:13:08,607 INFO root Display format: "none"
.config/logs/2024.11.25/19.12.56.407212.log ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ 2024-11-25 19:12:56,408 DEBUG root Loaded Command Group: ['gcloud', 'components']
2
+ 2024-11-25 19:12:56,410 DEBUG root Loaded Command Group: ['gcloud', 'components', 'post_process']
3
+ 2024-11-25 19:12:56,413 DEBUG root Running [gcloud.components.post-process] with arguments: []
4
+ 2024-11-25 19:13:08,321 DEBUG root Chosen display Format:none
5
+ 2024-11-25 19:13:08,322 INFO root Display format: "none"
.config/logs/2024.11.25/19.13.09.316504.log ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ 2024-11-25 19:13:09,318 DEBUG root Loaded Command Group: ['gcloud', 'config']
2
+ 2024-11-25 19:13:09,378 DEBUG root Loaded Command Group: ['gcloud', 'config', 'set']
3
+ 2024-11-25 19:13:09,381 DEBUG root Running [gcloud.config.set] with arguments: [SECTION/PROPERTY: "component_manager/disable_update_check", VALUE: "true"]
4
+ 2024-11-25 19:13:09,382 INFO ___FILE_ONLY___ Updated property [component_manager/disable_update_check].
5
+
6
+ 2024-11-25 19:13:09,383 DEBUG root Chosen display Format:default
7
+ 2024-11-25 19:13:09,384 INFO root Display format: "default"
8
+ 2024-11-25 19:13:09,385 DEBUG root SDK update checks are disabled.
.config/logs/2024.11.25/19.13.10.119162.log ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ 2024-11-25 19:13:10,121 DEBUG root Loaded Command Group: ['gcloud', 'config']
2
+ 2024-11-25 19:13:10,181 DEBUG root Loaded Command Group: ['gcloud', 'config', 'set']
3
+ 2024-11-25 19:13:10,184 DEBUG root Running [gcloud.config.set] with arguments: [SECTION/PROPERTY: "compute/gce_metadata_read_timeout_sec", VALUE: "0"]
4
+ 2024-11-25 19:13:10,185 INFO ___FILE_ONLY___ Updated property [compute/gce_metadata_read_timeout_sec].
5
+
6
+ 2024-11-25 19:13:10,186 DEBUG root Chosen display Format:default
7
+ 2024-11-25 19:13:10,187 INFO root Display format: "default"
8
+ 2024-11-25 19:13:10,188 DEBUG root SDK update checks are disabled.
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ sample_data/mnist_test.csv filter=lfs diff=lfs merge=lfs -text
37
+ sample_data/mnist_train_small.csv filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: meta-llama/Llama-2-7b-hf
3
+ library_name: transformers
4
+ model_name: ''
5
+ tags:
6
+ - generated_from_trainer
7
+ - trl
8
+ - dpo
9
+ licence: license
10
+ ---
11
+
12
+ # Model Card for
13
+
14
+ This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf).
15
+ It has been trained using [TRL](https://github.com/huggingface/trl).
16
+
17
+ ## Quick start
18
+
19
+ ```python
20
+ from transformers import pipeline
21
+
22
+ question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
23
+ generator = pipeline("text-generation", model="aakritil/content", device="cuda")
24
+ output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
25
+ print(output["generated_text"])
26
+ ```
27
+
28
+ ## Training procedure
29
+
30
+
31
+
32
+ This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
33
+
34
+ ### Framework versions
35
+
36
+ - TRL: 0.12.1
37
+ - Transformers: 4.46.2
38
+ - Pytorch: 2.5.1+cu121
39
+ - Datasets: 2.21.0
40
+ - Tokenizers: 0.20.3
41
+
42
+ ## Citations
43
+
44
+ Cite DPO as:
45
+
46
+ ```bibtex
47
+ @inproceedings{rafailov2023direct,
48
+ title = {{Direct Preference Optimization: Your Language Model is Secretly a Reward Model}},
49
+ author = {Rafael Rafailov and Archit Sharma and Eric Mitchell and Christopher D. Manning and Stefano Ermon and Chelsea Finn},
50
+ year = 2023,
51
+ booktitle = {Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023},
52
+ url = {http://papers.nips.cc/paper_files/paper/2023/hash/a85b405ed65c6477a4fe8302b5e06ce7-Abstract-Conference.html},
53
+ editor = {Alice Oh and Tristan Naumann and Amir Globerson and Kate Saenko and Moritz Hardt and Sergey Levine},
54
+ }
55
+ ```
56
+
57
+ Cite TRL as:
58
+
59
+ ```bibtex
60
+ @misc{vonwerra2022trl,
61
+ title = {{TRL: Transformer Reinforcement Learning}},
62
+ author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
63
+ year = 2020,
64
+ journal = {GitHub repository},
65
+ publisher = {GitHub},
66
+ howpublished = {\url{https://github.com/huggingface/trl}}
67
+ }
68
+ ```
adapter_config.json ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "meta-llama/Llama-2-7b-hf",
5
+ "bias": "none",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layer_replication": null,
10
+ "layers_pattern": null,
11
+ "layers_to_transform": null,
12
+ "loftq_config": {},
13
+ "lora_alpha": 16,
14
+ "lora_dropout": 0.1,
15
+ "megatron_config": null,
16
+ "megatron_core": "megatron.core",
17
+ "modules_to_save": null,
18
+ "peft_type": "LORA",
19
+ "r": 8,
20
+ "rank_pattern": {},
21
+ "revision": null,
22
+ "target_modules": [
23
+ "q_proj",
24
+ "v_proj"
25
+ ],
26
+ "task_type": "CAUSAL_LM",
27
+ "use_dora": false,
28
+ "use_rslora": false
29
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d4c60355cb6f7d794eb429d216ab3395ecd09dccb2b401d5eb5425a643a1618
3
+ size 16794200
dpo_train_dataset/data-00000-of-00001.arrow ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b55ddd46b92554f952e6f97c98a7de53f02e008f43ffbf3c4e9756a8e0ce907
3
+ size 1224400
dpo_train_dataset/dataset_info.json ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "citation": "",
3
+ "description": "",
4
+ "features": {
5
+ "prompt": {
6
+ "dtype": "string",
7
+ "_type": "Value"
8
+ },
9
+ "chosen": {
10
+ "dtype": "string",
11
+ "_type": "Value"
12
+ },
13
+ "rejected": {
14
+ "dtype": "string",
15
+ "_type": "Value"
16
+ }
17
+ },
18
+ "homepage": "",
19
+ "license": ""
20
+ }
dpo_train_dataset/state.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_data_files": [
3
+ {
4
+ "filename": "data-00000-of-00001.arrow"
5
+ }
6
+ ],
7
+ "_fingerprint": "04b1b0a0cfd028e7",
8
+ "_format_columns": null,
9
+ "_format_kwargs": {},
10
+ "_format_type": null,
11
+ "_output_all_columns": false,
12
+ "_split": null
13
+ }
drive/MyDrive/Colab Notebooks/Copy of Fang CS329x-HW2-Student.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
drive/MyDrive/Colab Notebooks/Untitled0.ipynb ADDED
The diff for this file is too large to render. See raw diff
 
drive/MyDrive/checkpoint-348/README.md ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: meta-llama/Llama-2-7b-hf
3
+ library_name: peft
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.10.0
drive/MyDrive/checkpoint-348/adapter_config.json ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "meta-llama/Llama-2-7b-hf",
5
+ "bias": "none",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layer_replication": null,
10
+ "layers_pattern": null,
11
+ "layers_to_transform": null,
12
+ "loftq_config": {},
13
+ "lora_alpha": 16,
14
+ "lora_dropout": 0.1,
15
+ "megatron_config": null,
16
+ "megatron_core": "megatron.core",
17
+ "modules_to_save": null,
18
+ "peft_type": "LORA",
19
+ "r": 8,
20
+ "rank_pattern": {},
21
+ "revision": null,
22
+ "target_modules": [
23
+ "q_proj",
24
+ "v_proj"
25
+ ],
26
+ "task_type": "CAUSAL_LM",
27
+ "use_dora": false,
28
+ "use_rslora": false
29
+ }
drive/MyDrive/checkpoint-348/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d4c60355cb6f7d794eb429d216ab3395ecd09dccb2b401d5eb5425a643a1618
3
+ size 16794200
drive/MyDrive/checkpoint-348/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:796edf87ecfa938a0ad5d829054edb8727abf6d527ffb521c48f64f59181ea28
3
+ size 8671034
drive/MyDrive/checkpoint-348/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d138cfe3a4adf21f048848ee35837c9a757a0a3616ff7adbb45b69aac247435
3
+ size 14244
drive/MyDrive/checkpoint-348/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4a5529fa9f22a90d491e4cbf35a1a6b8ea92aa306fd7ae54e4b371e7881013d9
3
+ size 1064
drive/MyDrive/checkpoint-348/special_tokens_map.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "</s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": "</s>",
17
+ "unk_token": {
18
+ "content": "<unk>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ }
24
+ }
drive/MyDrive/checkpoint-348/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
drive/MyDrive/checkpoint-348/tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
3
+ size 499723
drive/MyDrive/checkpoint-348/tokenizer_config.json ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": true,
3
+ "add_eos_token": false,
4
+ "add_prefix_space": null,
5
+ "added_tokens_decoder": {
6
+ "0": {
7
+ "content": "<unk>",
8
+ "lstrip": false,
9
+ "normalized": false,
10
+ "rstrip": false,
11
+ "single_word": false,
12
+ "special": true
13
+ },
14
+ "1": {
15
+ "content": "<s>",
16
+ "lstrip": false,
17
+ "normalized": false,
18
+ "rstrip": false,
19
+ "single_word": false,
20
+ "special": true
21
+ },
22
+ "2": {
23
+ "content": "</s>",
24
+ "lstrip": false,
25
+ "normalized": false,
26
+ "rstrip": false,
27
+ "single_word": false,
28
+ "special": true
29
+ }
30
+ },
31
+ "bos_token": "<s>",
32
+ "clean_up_tokenization_spaces": false,
33
+ "eos_token": "</s>",
34
+ "legacy": false,
35
+ "model_max_length": 1000000000000000019884624838656,
36
+ "pad_token": "</s>",
37
+ "padding_side": "right",
38
+ "sp_model_kwargs": {},
39
+ "tokenizer_class": "LlamaTokenizer",
40
+ "unk_token": "<unk>",
41
+ "use_default_system_prompt": false
42
+ }
drive/MyDrive/checkpoint-348/trainer_state.json ADDED
@@ -0,0 +1,1338 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 3.977142857142857,
5
+ "eval_steps": 500,
6
+ "global_step": 348,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.045714285714285714,
13
+ "grad_norm": 9.729541778564453,
14
+ "learning_rate": 2.2857142857142858e-05,
15
+ "logits/chosen": NaN,
16
+ "logits/rejected": NaN,
17
+ "logps/chosen": -191.5949249267578,
18
+ "logps/rejected": -178.94993591308594,
19
+ "loss": 0.6932,
20
+ "rewards/accuracies": 0.15625,
21
+ "rewards/chosen": 0.00019290449563413858,
22
+ "rewards/margins": -6.33835734333843e-05,
23
+ "rewards/rejected": 0.0002562880690675229,
24
+ "step": 4
25
+ },
26
+ {
27
+ "epoch": 0.09142857142857143,
28
+ "grad_norm": 9.54272174835205,
29
+ "learning_rate": 4.5714285714285716e-05,
30
+ "logits/chosen": -0.7379971146583557,
31
+ "logits/rejected": -0.7608282566070557,
32
+ "logps/chosen": -318.36737060546875,
33
+ "logps/rejected": -172.83837890625,
34
+ "loss": 0.6918,
35
+ "rewards/accuracies": 0.6875,
36
+ "rewards/chosen": 0.003367400262504816,
37
+ "rewards/margins": 0.0027868689503520727,
38
+ "rewards/rejected": 0.0005805314285680652,
39
+ "step": 8
40
+ },
41
+ {
42
+ "epoch": 0.13714285714285715,
43
+ "grad_norm": 9.01282024383545,
44
+ "learning_rate": 6.857142857142858e-05,
45
+ "logits/chosen": NaN,
46
+ "logits/rejected": NaN,
47
+ "logps/chosen": -212.95884704589844,
48
+ "logps/rejected": -170.42819213867188,
49
+ "loss": 0.6875,
50
+ "rewards/accuracies": 0.71875,
51
+ "rewards/chosen": 0.012343340553343296,
52
+ "rewards/margins": 0.011433703824877739,
53
+ "rewards/rejected": 0.0009096383582800627,
54
+ "step": 12
55
+ },
56
+ {
57
+ "epoch": 0.18285714285714286,
58
+ "grad_norm": 6.08139181137085,
59
+ "learning_rate": 9.142857142857143e-05,
60
+ "logits/chosen": NaN,
61
+ "logits/rejected": NaN,
62
+ "logps/chosen": -237.0392608642578,
63
+ "logps/rejected": -140.843994140625,
64
+ "loss": 0.6786,
65
+ "rewards/accuracies": 0.78125,
66
+ "rewards/chosen": 0.019704176113009453,
67
+ "rewards/margins": 0.02994394302368164,
68
+ "rewards/rejected": -0.010239768773317337,
69
+ "step": 16
70
+ },
71
+ {
72
+ "epoch": 0.22857142857142856,
73
+ "grad_norm": 12.110494613647461,
74
+ "learning_rate": 0.00011428571428571428,
75
+ "logits/chosen": NaN,
76
+ "logits/rejected": NaN,
77
+ "logps/chosen": -238.46463012695312,
78
+ "logps/rejected": -191.14645385742188,
79
+ "loss": 0.661,
80
+ "rewards/accuracies": 0.78125,
81
+ "rewards/chosen": 0.06102071329951286,
82
+ "rewards/margins": 0.06703755259513855,
83
+ "rewards/rejected": -0.00601684395223856,
84
+ "step": 20
85
+ },
86
+ {
87
+ "epoch": 0.2742857142857143,
88
+ "grad_norm": 15.145161628723145,
89
+ "learning_rate": 0.00013714285714285716,
90
+ "logits/chosen": NaN,
91
+ "logits/rejected": NaN,
92
+ "logps/chosen": -263.39276123046875,
93
+ "logps/rejected": -203.8231658935547,
94
+ "loss": 0.639,
95
+ "rewards/accuracies": 0.84375,
96
+ "rewards/chosen": 0.1136322170495987,
97
+ "rewards/margins": 0.11692351847887039,
98
+ "rewards/rejected": -0.0032912972383201122,
99
+ "step": 24
100
+ },
101
+ {
102
+ "epoch": 0.32,
103
+ "grad_norm": 15.971263885498047,
104
+ "learning_rate": 0.00016,
105
+ "logits/chosen": NaN,
106
+ "logits/rejected": NaN,
107
+ "logps/chosen": -315.7078857421875,
108
+ "logps/rejected": -146.5008544921875,
109
+ "loss": 0.6162,
110
+ "rewards/accuracies": 0.78125,
111
+ "rewards/chosen": 0.19662690162658691,
112
+ "rewards/margins": 0.1738075613975525,
113
+ "rewards/rejected": 0.022819330915808678,
114
+ "step": 28
115
+ },
116
+ {
117
+ "epoch": 0.3657142857142857,
118
+ "grad_norm": 20.183231353759766,
119
+ "learning_rate": 0.00018285714285714286,
120
+ "logits/chosen": NaN,
121
+ "logits/rejected": NaN,
122
+ "logps/chosen": -294.2346496582031,
123
+ "logps/rejected": -153.24160766601562,
124
+ "loss": 0.5742,
125
+ "rewards/accuracies": 0.75,
126
+ "rewards/chosen": 0.2808985710144043,
127
+ "rewards/margins": 0.28646522760391235,
128
+ "rewards/rejected": -0.005566636100411415,
129
+ "step": 32
130
+ },
131
+ {
132
+ "epoch": 0.4114285714285714,
133
+ "grad_norm": 21.948104858398438,
134
+ "learning_rate": 0.00019936102236421725,
135
+ "logits/chosen": NaN,
136
+ "logits/rejected": NaN,
137
+ "logps/chosen": -258.82904052734375,
138
+ "logps/rejected": -166.54611206054688,
139
+ "loss": 0.5684,
140
+ "rewards/accuracies": 0.625,
141
+ "rewards/chosen": 0.3410307466983795,
142
+ "rewards/margins": 0.33058807253837585,
143
+ "rewards/rejected": 0.010442652739584446,
144
+ "step": 36
145
+ },
146
+ {
147
+ "epoch": 0.45714285714285713,
148
+ "grad_norm": 19.31505584716797,
149
+ "learning_rate": 0.00019680511182108628,
150
+ "logits/chosen": -0.8340643644332886,
151
+ "logits/rejected": -0.8946108222007751,
152
+ "logps/chosen": -280.0050964355469,
153
+ "logps/rejected": -182.23654174804688,
154
+ "loss": 0.4948,
155
+ "rewards/accuracies": 0.875,
156
+ "rewards/chosen": 0.5975265502929688,
157
+ "rewards/margins": 0.6292851567268372,
158
+ "rewards/rejected": -0.03175865486264229,
159
+ "step": 40
160
+ },
161
+ {
162
+ "epoch": 0.5028571428571429,
163
+ "grad_norm": 38.077674865722656,
164
+ "learning_rate": 0.00019424920127795528,
165
+ "logits/chosen": NaN,
166
+ "logits/rejected": NaN,
167
+ "logps/chosen": -242.5420379638672,
168
+ "logps/rejected": -165.37367248535156,
169
+ "loss": 0.4782,
170
+ "rewards/accuracies": 0.78125,
171
+ "rewards/chosen": 0.7896119356155396,
172
+ "rewards/margins": 0.6563507318496704,
173
+ "rewards/rejected": 0.13326111435890198,
174
+ "step": 44
175
+ },
176
+ {
177
+ "epoch": 0.5485714285714286,
178
+ "grad_norm": 23.51544761657715,
179
+ "learning_rate": 0.00019169329073482429,
180
+ "logits/chosen": NaN,
181
+ "logits/rejected": NaN,
182
+ "logps/chosen": -215.16128540039062,
183
+ "logps/rejected": -155.5576629638672,
184
+ "loss": 0.414,
185
+ "rewards/accuracies": 0.90625,
186
+ "rewards/chosen": 0.8685276508331299,
187
+ "rewards/margins": 0.8956663012504578,
188
+ "rewards/rejected": -0.027138609439134598,
189
+ "step": 48
190
+ },
191
+ {
192
+ "epoch": 0.5942857142857143,
193
+ "grad_norm": 31.693307876586914,
194
+ "learning_rate": 0.0001891373801916933,
195
+ "logits/chosen": NaN,
196
+ "logits/rejected": NaN,
197
+ "logps/chosen": -284.3824462890625,
198
+ "logps/rejected": -146.8328857421875,
199
+ "loss": 0.4731,
200
+ "rewards/accuracies": 0.75,
201
+ "rewards/chosen": 0.7844900488853455,
202
+ "rewards/margins": 0.7386621236801147,
203
+ "rewards/rejected": 0.045827917754650116,
204
+ "step": 52
205
+ },
206
+ {
207
+ "epoch": 0.64,
208
+ "grad_norm": 62.286956787109375,
209
+ "learning_rate": 0.00018658146964856232,
210
+ "logits/chosen": NaN,
211
+ "logits/rejected": NaN,
212
+ "logps/chosen": -324.68414306640625,
213
+ "logps/rejected": -158.55052185058594,
214
+ "loss": 0.4529,
215
+ "rewards/accuracies": 0.6875,
216
+ "rewards/chosen": 1.036560297012329,
217
+ "rewards/margins": 1.0899850130081177,
218
+ "rewards/rejected": -0.05342472344636917,
219
+ "step": 56
220
+ },
221
+ {
222
+ "epoch": 0.6857142857142857,
223
+ "grad_norm": 34.29658508300781,
224
+ "learning_rate": 0.00018402555910543132,
225
+ "logits/chosen": NaN,
226
+ "logits/rejected": NaN,
227
+ "logps/chosen": -266.7518615722656,
228
+ "logps/rejected": -208.8983612060547,
229
+ "loss": 0.3165,
230
+ "rewards/accuracies": 0.8125,
231
+ "rewards/chosen": 0.8459180593490601,
232
+ "rewards/margins": 1.586979627609253,
233
+ "rewards/rejected": -0.7410615682601929,
234
+ "step": 60
235
+ },
236
+ {
237
+ "epoch": 0.7314285714285714,
238
+ "grad_norm": 22.293718338012695,
239
+ "learning_rate": 0.00018146964856230032,
240
+ "logits/chosen": NaN,
241
+ "logits/rejected": NaN,
242
+ "logps/chosen": -260.175537109375,
243
+ "logps/rejected": -140.4886932373047,
244
+ "loss": 0.4188,
245
+ "rewards/accuracies": 0.71875,
246
+ "rewards/chosen": 0.5953944325447083,
247
+ "rewards/margins": 1.1207698583602905,
248
+ "rewards/rejected": -0.525375485420227,
249
+ "step": 64
250
+ },
251
+ {
252
+ "epoch": 0.7771428571428571,
253
+ "grad_norm": 29.842836380004883,
254
+ "learning_rate": 0.00017891373801916932,
255
+ "logits/chosen": NaN,
256
+ "logits/rejected": NaN,
257
+ "logps/chosen": -191.6659698486328,
258
+ "logps/rejected": -188.1643829345703,
259
+ "loss": 0.4504,
260
+ "rewards/accuracies": 0.71875,
261
+ "rewards/chosen": 0.519951581954956,
262
+ "rewards/margins": 1.0750960111618042,
263
+ "rewards/rejected": -0.5551444292068481,
264
+ "step": 68
265
+ },
266
+ {
267
+ "epoch": 0.8228571428571428,
268
+ "grad_norm": 22.95765495300293,
269
+ "learning_rate": 0.00017635782747603835,
270
+ "logits/chosen": NaN,
271
+ "logits/rejected": NaN,
272
+ "logps/chosen": -251.21548461914062,
273
+ "logps/rejected": -263.4191589355469,
274
+ "loss": 0.2434,
275
+ "rewards/accuracies": 0.9375,
276
+ "rewards/chosen": 0.7837429642677307,
277
+ "rewards/margins": 1.9659894704818726,
278
+ "rewards/rejected": -1.182246446609497,
279
+ "step": 72
280
+ },
281
+ {
282
+ "epoch": 0.8685714285714285,
283
+ "grad_norm": 36.607723236083984,
284
+ "learning_rate": 0.00017380191693290735,
285
+ "logits/chosen": NaN,
286
+ "logits/rejected": NaN,
287
+ "logps/chosen": -264.87799072265625,
288
+ "logps/rejected": -164.2783203125,
289
+ "loss": 0.3611,
290
+ "rewards/accuracies": 0.75,
291
+ "rewards/chosen": 0.374313622713089,
292
+ "rewards/margins": 1.7166688442230225,
293
+ "rewards/rejected": -1.3423552513122559,
294
+ "step": 76
295
+ },
296
+ {
297
+ "epoch": 0.9142857142857143,
298
+ "grad_norm": 36.1689567565918,
299
+ "learning_rate": 0.00017124600638977638,
300
+ "logits/chosen": NaN,
301
+ "logits/rejected": NaN,
302
+ "logps/chosen": -271.47064208984375,
303
+ "logps/rejected": -264.6214599609375,
304
+ "loss": 0.2544,
305
+ "rewards/accuracies": 0.875,
306
+ "rewards/chosen": 0.4015069603919983,
307
+ "rewards/margins": 2.162703037261963,
308
+ "rewards/rejected": -1.7611961364746094,
309
+ "step": 80
310
+ },
311
+ {
312
+ "epoch": 0.96,
313
+ "grad_norm": 56.92383575439453,
314
+ "learning_rate": 0.00016869009584664536,
315
+ "logits/chosen": NaN,
316
+ "logits/rejected": NaN,
317
+ "logps/chosen": -280.0853271484375,
318
+ "logps/rejected": -271.6772766113281,
319
+ "loss": 0.2838,
320
+ "rewards/accuracies": 0.84375,
321
+ "rewards/chosen": 0.2982442378997803,
322
+ "rewards/margins": 2.493306875228882,
323
+ "rewards/rejected": -2.1950626373291016,
324
+ "step": 84
325
+ },
326
+ {
327
+ "epoch": 1.0057142857142858,
328
+ "grad_norm": 29.9643497467041,
329
+ "learning_rate": 0.0001661341853035144,
330
+ "logits/chosen": NaN,
331
+ "logits/rejected": NaN,
332
+ "logps/chosen": -266.5316467285156,
333
+ "logps/rejected": -181.1546173095703,
334
+ "loss": 0.2052,
335
+ "rewards/accuracies": 0.875,
336
+ "rewards/chosen": 0.5022339224815369,
337
+ "rewards/margins": 2.6957812309265137,
338
+ "rewards/rejected": -2.193547010421753,
339
+ "step": 88
340
+ },
341
+ {
342
+ "epoch": 1.0514285714285714,
343
+ "grad_norm": 27.335933685302734,
344
+ "learning_rate": 0.0001635782747603834,
345
+ "logits/chosen": NaN,
346
+ "logits/rejected": NaN,
347
+ "logps/chosen": -234.8162078857422,
348
+ "logps/rejected": -178.24375915527344,
349
+ "loss": 0.1396,
350
+ "rewards/accuracies": 0.9375,
351
+ "rewards/chosen": 0.7748296856880188,
352
+ "rewards/margins": 2.9161019325256348,
353
+ "rewards/rejected": -2.1412723064422607,
354
+ "step": 92
355
+ },
356
+ {
357
+ "epoch": 1.0971428571428572,
358
+ "grad_norm": 8.942264556884766,
359
+ "learning_rate": 0.00016102236421725242,
360
+ "logits/chosen": NaN,
361
+ "logits/rejected": NaN,
362
+ "logps/chosen": -233.2910919189453,
363
+ "logps/rejected": -179.97129821777344,
364
+ "loss": 0.1361,
365
+ "rewards/accuracies": 0.9375,
366
+ "rewards/chosen": 1.129379153251648,
367
+ "rewards/margins": 3.637566328048706,
368
+ "rewards/rejected": -2.5081870555877686,
369
+ "step": 96
370
+ },
371
+ {
372
+ "epoch": 1.1428571428571428,
373
+ "grad_norm": 20.588306427001953,
374
+ "learning_rate": 0.00015846645367412142,
375
+ "logits/chosen": NaN,
376
+ "logits/rejected": NaN,
377
+ "logps/chosen": -222.8678741455078,
378
+ "logps/rejected": -157.59368896484375,
379
+ "loss": 0.1604,
380
+ "rewards/accuracies": 0.90625,
381
+ "rewards/chosen": 1.250205159187317,
382
+ "rewards/margins": 3.2522096633911133,
383
+ "rewards/rejected": -2.002004623413086,
384
+ "step": 100
385
+ },
386
+ {
387
+ "epoch": 1.1885714285714286,
388
+ "grad_norm": 9.417901992797852,
389
+ "learning_rate": 0.00015591054313099042,
390
+ "logits/chosen": NaN,
391
+ "logits/rejected": NaN,
392
+ "logps/chosen": -223.03469848632812,
393
+ "logps/rejected": -164.5848388671875,
394
+ "loss": 0.1148,
395
+ "rewards/accuracies": 0.90625,
396
+ "rewards/chosen": 1.3484156131744385,
397
+ "rewards/margins": 3.837554454803467,
398
+ "rewards/rejected": -2.4891388416290283,
399
+ "step": 104
400
+ },
401
+ {
402
+ "epoch": 1.2342857142857142,
403
+ "grad_norm": 13.386661529541016,
404
+ "learning_rate": 0.00015335463258785942,
405
+ "logits/chosen": NaN,
406
+ "logits/rejected": NaN,
407
+ "logps/chosen": -243.3107147216797,
408
+ "logps/rejected": -269.83856201171875,
409
+ "loss": 0.0796,
410
+ "rewards/accuracies": 0.96875,
411
+ "rewards/chosen": 1.3695310354232788,
412
+ "rewards/margins": 4.65057373046875,
413
+ "rewards/rejected": -3.28104305267334,
414
+ "step": 108
415
+ },
416
+ {
417
+ "epoch": 1.28,
418
+ "grad_norm": 6.952698230743408,
419
+ "learning_rate": 0.00015079872204472845,
420
+ "logits/chosen": -0.8169791102409363,
421
+ "logits/rejected": -1.029231071472168,
422
+ "logps/chosen": -263.39453125,
423
+ "logps/rejected": -199.8799285888672,
424
+ "loss": 0.0387,
425
+ "rewards/accuracies": 1.0,
426
+ "rewards/chosen": 1.1781620979309082,
427
+ "rewards/margins": 4.557692527770996,
428
+ "rewards/rejected": -3.379530429840088,
429
+ "step": 112
430
+ },
431
+ {
432
+ "epoch": 1.3257142857142856,
433
+ "grad_norm": 8.539137840270996,
434
+ "learning_rate": 0.00014824281150159745,
435
+ "logits/chosen": NaN,
436
+ "logits/rejected": NaN,
437
+ "logps/chosen": -283.40386962890625,
438
+ "logps/rejected": -248.05551147460938,
439
+ "loss": 0.1084,
440
+ "rewards/accuracies": 0.90625,
441
+ "rewards/chosen": 1.1177380084991455,
442
+ "rewards/margins": 4.677387237548828,
443
+ "rewards/rejected": -3.559649705886841,
444
+ "step": 116
445
+ },
446
+ {
447
+ "epoch": 1.3714285714285714,
448
+ "grad_norm": 18.487228393554688,
449
+ "learning_rate": 0.00014568690095846646,
450
+ "logits/chosen": NaN,
451
+ "logits/rejected": NaN,
452
+ "logps/chosen": -272.1732177734375,
453
+ "logps/rejected": -196.45614624023438,
454
+ "loss": 0.1468,
455
+ "rewards/accuracies": 0.84375,
456
+ "rewards/chosen": 1.3658459186553955,
457
+ "rewards/margins": 4.759303092956543,
458
+ "rewards/rejected": -3.3934574127197266,
459
+ "step": 120
460
+ },
461
+ {
462
+ "epoch": 1.4171428571428573,
463
+ "grad_norm": 31.59523582458496,
464
+ "learning_rate": 0.00014313099041533546,
465
+ "logits/chosen": NaN,
466
+ "logits/rejected": NaN,
467
+ "logps/chosen": -289.93524169921875,
468
+ "logps/rejected": -226.3542938232422,
469
+ "loss": 0.1106,
470
+ "rewards/accuracies": 0.96875,
471
+ "rewards/chosen": 0.8534113168716431,
472
+ "rewards/margins": 4.326902389526367,
473
+ "rewards/rejected": -3.4734907150268555,
474
+ "step": 124
475
+ },
476
+ {
477
+ "epoch": 1.4628571428571429,
478
+ "grad_norm": 22.807483673095703,
479
+ "learning_rate": 0.0001405750798722045,
480
+ "logits/chosen": NaN,
481
+ "logits/rejected": NaN,
482
+ "logps/chosen": -215.40234375,
483
+ "logps/rejected": -209.85098266601562,
484
+ "loss": 0.0704,
485
+ "rewards/accuracies": 0.96875,
486
+ "rewards/chosen": 1.3758734464645386,
487
+ "rewards/margins": 4.276954174041748,
488
+ "rewards/rejected": -2.90108060836792,
489
+ "step": 128
490
+ },
491
+ {
492
+ "epoch": 1.5085714285714285,
493
+ "grad_norm": 55.56698226928711,
494
+ "learning_rate": 0.0001380191693290735,
495
+ "logits/chosen": NaN,
496
+ "logits/rejected": NaN,
497
+ "logps/chosen": -263.39739990234375,
498
+ "logps/rejected": -191.40892028808594,
499
+ "loss": 0.1477,
500
+ "rewards/accuracies": 0.875,
501
+ "rewards/chosen": 1.2295846939086914,
502
+ "rewards/margins": 4.052473068237305,
503
+ "rewards/rejected": -2.8228886127471924,
504
+ "step": 132
505
+ },
506
+ {
507
+ "epoch": 1.5542857142857143,
508
+ "grad_norm": 5.410626411437988,
509
+ "learning_rate": 0.0001354632587859425,
510
+ "logits/chosen": NaN,
511
+ "logits/rejected": NaN,
512
+ "logps/chosen": -250.39862060546875,
513
+ "logps/rejected": -169.7389678955078,
514
+ "loss": 0.0811,
515
+ "rewards/accuracies": 0.90625,
516
+ "rewards/chosen": 2.030120849609375,
517
+ "rewards/margins": 4.691845417022705,
518
+ "rewards/rejected": -2.661724090576172,
519
+ "step": 136
520
+ },
521
+ {
522
+ "epoch": 1.6,
523
+ "grad_norm": 2.478210210800171,
524
+ "learning_rate": 0.0001329073482428115,
525
+ "logits/chosen": NaN,
526
+ "logits/rejected": NaN,
527
+ "logps/chosen": -202.17880249023438,
528
+ "logps/rejected": -235.31553649902344,
529
+ "loss": 0.0554,
530
+ "rewards/accuracies": 0.9375,
531
+ "rewards/chosen": 1.5112950801849365,
532
+ "rewards/margins": 5.312258720397949,
533
+ "rewards/rejected": -3.800963878631592,
534
+ "step": 140
535
+ },
536
+ {
537
+ "epoch": 1.6457142857142857,
538
+ "grad_norm": 12.282026290893555,
539
+ "learning_rate": 0.00013035143769968052,
540
+ "logits/chosen": NaN,
541
+ "logits/rejected": NaN,
542
+ "logps/chosen": -256.1723937988281,
543
+ "logps/rejected": -190.2920684814453,
544
+ "loss": 0.1364,
545
+ "rewards/accuracies": 0.90625,
546
+ "rewards/chosen": 0.9841121435165405,
547
+ "rewards/margins": 4.532729625701904,
548
+ "rewards/rejected": -3.5486178398132324,
549
+ "step": 144
550
+ },
551
+ {
552
+ "epoch": 1.6914285714285713,
553
+ "grad_norm": 0.7443946003913879,
554
+ "learning_rate": 0.00012779552715654952,
555
+ "logits/chosen": NaN,
556
+ "logits/rejected": NaN,
557
+ "logps/chosen": -190.3223114013672,
558
+ "logps/rejected": -232.26467895507812,
559
+ "loss": 0.1134,
560
+ "rewards/accuracies": 0.875,
561
+ "rewards/chosen": 1.4249160289764404,
562
+ "rewards/margins": 5.272634506225586,
563
+ "rewards/rejected": -3.8477184772491455,
564
+ "step": 148
565
+ },
566
+ {
567
+ "epoch": 1.737142857142857,
568
+ "grad_norm": 0.9860565662384033,
569
+ "learning_rate": 0.00012523961661341855,
570
+ "logits/chosen": NaN,
571
+ "logits/rejected": NaN,
572
+ "logps/chosen": -280.0784606933594,
573
+ "logps/rejected": -178.75973510742188,
574
+ "loss": 0.1469,
575
+ "rewards/accuracies": 0.84375,
576
+ "rewards/chosen": 1.374025821685791,
577
+ "rewards/margins": 5.189028739929199,
578
+ "rewards/rejected": -3.8150031566619873,
579
+ "step": 152
580
+ },
581
+ {
582
+ "epoch": 1.782857142857143,
583
+ "grad_norm": 11.089580535888672,
584
+ "learning_rate": 0.00012268370607028753,
585
+ "logits/chosen": NaN,
586
+ "logits/rejected": NaN,
587
+ "logps/chosen": -309.3710021972656,
588
+ "logps/rejected": -288.64410400390625,
589
+ "loss": 0.071,
590
+ "rewards/accuracies": 0.9375,
591
+ "rewards/chosen": 0.8088248372077942,
592
+ "rewards/margins": 6.306546211242676,
593
+ "rewards/rejected": -5.4977216720581055,
594
+ "step": 156
595
+ },
596
+ {
597
+ "epoch": 1.8285714285714287,
598
+ "grad_norm": 0.6896222829818726,
599
+ "learning_rate": 0.00012012779552715656,
600
+ "logits/chosen": -1.1236371994018555,
601
+ "logits/rejected": -1.1221413612365723,
602
+ "logps/chosen": -247.50177001953125,
603
+ "logps/rejected": -255.9164581298828,
604
+ "loss": 0.0608,
605
+ "rewards/accuracies": 0.96875,
606
+ "rewards/chosen": 1.0703375339508057,
607
+ "rewards/margins": 6.536956787109375,
608
+ "rewards/rejected": -5.466619491577148,
609
+ "step": 160
610
+ },
611
+ {
612
+ "epoch": 1.8742857142857143,
613
+ "grad_norm": 8.98990535736084,
614
+ "learning_rate": 0.00011757188498402556,
615
+ "logits/chosen": NaN,
616
+ "logits/rejected": NaN,
617
+ "logps/chosen": -215.19583129882812,
618
+ "logps/rejected": -233.2379608154297,
619
+ "loss": 0.1398,
620
+ "rewards/accuracies": 0.84375,
621
+ "rewards/chosen": 1.2311248779296875,
622
+ "rewards/margins": 5.066349506378174,
623
+ "rewards/rejected": -3.8352248668670654,
624
+ "step": 164
625
+ },
626
+ {
627
+ "epoch": 1.92,
628
+ "grad_norm": 16.68961524963379,
629
+ "learning_rate": 0.00011501597444089457,
630
+ "logits/chosen": NaN,
631
+ "logits/rejected": NaN,
632
+ "logps/chosen": -312.2574768066406,
633
+ "logps/rejected": -231.15431213378906,
634
+ "loss": 0.11,
635
+ "rewards/accuracies": 0.90625,
636
+ "rewards/chosen": 1.1968990564346313,
637
+ "rewards/margins": 5.266256332397461,
638
+ "rewards/rejected": -4.069357395172119,
639
+ "step": 168
640
+ },
641
+ {
642
+ "epoch": 1.9657142857142857,
643
+ "grad_norm": 1.3579024076461792,
644
+ "learning_rate": 0.00011246006389776358,
645
+ "logits/chosen": NaN,
646
+ "logits/rejected": NaN,
647
+ "logps/chosen": -305.48406982421875,
648
+ "logps/rejected": -181.08071899414062,
649
+ "loss": 0.1175,
650
+ "rewards/accuracies": 0.875,
651
+ "rewards/chosen": 1.1569255590438843,
652
+ "rewards/margins": 4.935606956481934,
653
+ "rewards/rejected": -3.7786810398101807,
654
+ "step": 172
655
+ },
656
+ {
657
+ "epoch": 2.0114285714285716,
658
+ "grad_norm": 0.5345720052719116,
659
+ "learning_rate": 0.0001099041533546326,
660
+ "logits/chosen": NaN,
661
+ "logits/rejected": NaN,
662
+ "logps/chosen": -209.57493591308594,
663
+ "logps/rejected": -274.29595947265625,
664
+ "loss": 0.0498,
665
+ "rewards/accuracies": 0.9375,
666
+ "rewards/chosen": 1.321765661239624,
667
+ "rewards/margins": 6.712408542633057,
668
+ "rewards/rejected": -5.390643119812012,
669
+ "step": 176
670
+ },
671
+ {
672
+ "epoch": 2.057142857142857,
673
+ "grad_norm": 2.9336695671081543,
674
+ "learning_rate": 0.0001073482428115016,
675
+ "logits/chosen": NaN,
676
+ "logits/rejected": NaN,
677
+ "logps/chosen": -300.12738037109375,
678
+ "logps/rejected": -247.28753662109375,
679
+ "loss": 0.0481,
680
+ "rewards/accuracies": 0.9375,
681
+ "rewards/chosen": 2.2360713481903076,
682
+ "rewards/margins": 6.878186225891113,
683
+ "rewards/rejected": -4.642114639282227,
684
+ "step": 180
685
+ },
686
+ {
687
+ "epoch": 2.1028571428571428,
688
+ "grad_norm": 0.23953957855701447,
689
+ "learning_rate": 0.00010479233226837062,
690
+ "logits/chosen": NaN,
691
+ "logits/rejected": NaN,
692
+ "logps/chosen": -275.3216552734375,
693
+ "logps/rejected": -312.7816162109375,
694
+ "loss": 0.0474,
695
+ "rewards/accuracies": 0.9375,
696
+ "rewards/chosen": 0.4861125349998474,
697
+ "rewards/margins": 7.128695487976074,
698
+ "rewards/rejected": -6.64258337020874,
699
+ "step": 184
700
+ },
701
+ {
702
+ "epoch": 2.1485714285714286,
703
+ "grad_norm": 1.1941184997558594,
704
+ "learning_rate": 0.00010223642172523961,
705
+ "logits/chosen": NaN,
706
+ "logits/rejected": NaN,
707
+ "logps/chosen": -179.19110107421875,
708
+ "logps/rejected": -240.98788452148438,
709
+ "loss": 0.0466,
710
+ "rewards/accuracies": 0.9375,
711
+ "rewards/chosen": 1.1594161987304688,
712
+ "rewards/margins": 8.421497344970703,
713
+ "rewards/rejected": -7.262081146240234,
714
+ "step": 188
715
+ },
716
+ {
717
+ "epoch": 2.1942857142857144,
718
+ "grad_norm": 1.1224029064178467,
719
+ "learning_rate": 9.968051118210863e-05,
720
+ "logits/chosen": NaN,
721
+ "logits/rejected": NaN,
722
+ "logps/chosen": -256.90692138671875,
723
+ "logps/rejected": -187.83580017089844,
724
+ "loss": 0.114,
725
+ "rewards/accuracies": 0.84375,
726
+ "rewards/chosen": 0.700792133808136,
727
+ "rewards/margins": 6.588268756866455,
728
+ "rewards/rejected": -5.887476444244385,
729
+ "step": 192
730
+ },
731
+ {
732
+ "epoch": 2.24,
733
+ "grad_norm": 0.10384131222963333,
734
+ "learning_rate": 9.712460063897764e-05,
735
+ "logits/chosen": NaN,
736
+ "logits/rejected": NaN,
737
+ "logps/chosen": -240.05372619628906,
738
+ "logps/rejected": -221.209716796875,
739
+ "loss": 0.0878,
740
+ "rewards/accuracies": 0.875,
741
+ "rewards/chosen": 1.4040710926055908,
742
+ "rewards/margins": 6.949329853057861,
743
+ "rewards/rejected": -5.54525899887085,
744
+ "step": 196
745
+ },
746
+ {
747
+ "epoch": 2.2857142857142856,
748
+ "grad_norm": 0.09286891669034958,
749
+ "learning_rate": 9.456869009584664e-05,
750
+ "logits/chosen": -0.8439121246337891,
751
+ "logits/rejected": -0.8557687401771545,
752
+ "logps/chosen": -268.4107666015625,
753
+ "logps/rejected": -287.407958984375,
754
+ "loss": 0.0051,
755
+ "rewards/accuracies": 1.0,
756
+ "rewards/chosen": 1.4993197917938232,
757
+ "rewards/margins": 8.422232627868652,
758
+ "rewards/rejected": -6.922913551330566,
759
+ "step": 200
760
+ },
761
+ {
762
+ "epoch": 2.3314285714285714,
763
+ "grad_norm": 0.9010165929794312,
764
+ "learning_rate": 9.201277955271566e-05,
765
+ "logits/chosen": NaN,
766
+ "logits/rejected": NaN,
767
+ "logps/chosen": -270.5591125488281,
768
+ "logps/rejected": -280.8585510253906,
769
+ "loss": 0.0576,
770
+ "rewards/accuracies": 0.9375,
771
+ "rewards/chosen": 1.2924140691757202,
772
+ "rewards/margins": 9.145613670349121,
773
+ "rewards/rejected": -7.853200435638428,
774
+ "step": 204
775
+ },
776
+ {
777
+ "epoch": 2.3771428571428572,
778
+ "grad_norm": 2.572065591812134,
779
+ "learning_rate": 8.945686900958466e-05,
780
+ "logits/chosen": -0.8399416208267212,
781
+ "logits/rejected": -0.9658093452453613,
782
+ "logps/chosen": -277.0357666015625,
783
+ "logps/rejected": -281.85369873046875,
784
+ "loss": 0.0013,
785
+ "rewards/accuracies": 1.0,
786
+ "rewards/chosen": 1.1569018363952637,
787
+ "rewards/margins": 8.929794311523438,
788
+ "rewards/rejected": -7.772891998291016,
789
+ "step": 208
790
+ },
791
+ {
792
+ "epoch": 2.422857142857143,
793
+ "grad_norm": 0.09240057319402695,
794
+ "learning_rate": 8.690095846645368e-05,
795
+ "logits/chosen": -0.9032736420631409,
796
+ "logits/rejected": -1.0178804397583008,
797
+ "logps/chosen": -296.9342041015625,
798
+ "logps/rejected": -282.25433349609375,
799
+ "loss": 0.0024,
800
+ "rewards/accuracies": 1.0,
801
+ "rewards/chosen": 0.5577135682106018,
802
+ "rewards/margins": 8.976801872253418,
803
+ "rewards/rejected": -8.419088363647461,
804
+ "step": 212
805
+ },
806
+ {
807
+ "epoch": 2.4685714285714284,
808
+ "grad_norm": 0.6668811440467834,
809
+ "learning_rate": 8.434504792332268e-05,
810
+ "logits/chosen": NaN,
811
+ "logits/rejected": NaN,
812
+ "logps/chosen": -226.7338104248047,
813
+ "logps/rejected": -203.0109100341797,
814
+ "loss": 0.066,
815
+ "rewards/accuracies": 0.90625,
816
+ "rewards/chosen": 0.8103513717651367,
817
+ "rewards/margins": 8.133030891418457,
818
+ "rewards/rejected": -7.32267951965332,
819
+ "step": 216
820
+ },
821
+ {
822
+ "epoch": 2.5142857142857142,
823
+ "grad_norm": 0.0593394860625267,
824
+ "learning_rate": 8.17891373801917e-05,
825
+ "logits/chosen": NaN,
826
+ "logits/rejected": NaN,
827
+ "logps/chosen": -303.2545471191406,
828
+ "logps/rejected": -261.12567138671875,
829
+ "loss": 0.0247,
830
+ "rewards/accuracies": 0.96875,
831
+ "rewards/chosen": 1.732958436012268,
832
+ "rewards/margins": 10.343001365661621,
833
+ "rewards/rejected": -8.610042572021484,
834
+ "step": 220
835
+ },
836
+ {
837
+ "epoch": 2.56,
838
+ "grad_norm": 2.342472553253174,
839
+ "learning_rate": 7.923322683706071e-05,
840
+ "logits/chosen": NaN,
841
+ "logits/rejected": NaN,
842
+ "logps/chosen": -211.95657348632812,
843
+ "logps/rejected": -243.17343139648438,
844
+ "loss": 0.1104,
845
+ "rewards/accuracies": 0.84375,
846
+ "rewards/chosen": 0.8941321969032288,
847
+ "rewards/margins": 7.801623344421387,
848
+ "rewards/rejected": -6.907491207122803,
849
+ "step": 224
850
+ },
851
+ {
852
+ "epoch": 2.605714285714286,
853
+ "grad_norm": 1.0987083911895752,
854
+ "learning_rate": 7.667731629392971e-05,
855
+ "logits/chosen": NaN,
856
+ "logits/rejected": NaN,
857
+ "logps/chosen": -309.615966796875,
858
+ "logps/rejected": -240.02651977539062,
859
+ "loss": 0.0247,
860
+ "rewards/accuracies": 0.96875,
861
+ "rewards/chosen": 1.5686383247375488,
862
+ "rewards/margins": 8.230088233947754,
863
+ "rewards/rejected": -6.661448955535889,
864
+ "step": 228
865
+ },
866
+ {
867
+ "epoch": 2.6514285714285712,
868
+ "grad_norm": 0.5238648653030396,
869
+ "learning_rate": 7.412140575079873e-05,
870
+ "logits/chosen": NaN,
871
+ "logits/rejected": NaN,
872
+ "logps/chosen": -178.031494140625,
873
+ "logps/rejected": -187.8708953857422,
874
+ "loss": 0.0689,
875
+ "rewards/accuracies": 0.90625,
876
+ "rewards/chosen": 1.1489320993423462,
877
+ "rewards/margins": 8.070334434509277,
878
+ "rewards/rejected": -6.9214019775390625,
879
+ "step": 232
880
+ },
881
+ {
882
+ "epoch": 2.697142857142857,
883
+ "grad_norm": 0.6709648966789246,
884
+ "learning_rate": 7.156549520766773e-05,
885
+ "logits/chosen": NaN,
886
+ "logits/rejected": NaN,
887
+ "logps/chosen": -319.14190673828125,
888
+ "logps/rejected": -232.24835205078125,
889
+ "loss": 0.0232,
890
+ "rewards/accuracies": 0.96875,
891
+ "rewards/chosen": 1.610769510269165,
892
+ "rewards/margins": 8.165452003479004,
893
+ "rewards/rejected": -6.554682731628418,
894
+ "step": 236
895
+ },
896
+ {
897
+ "epoch": 2.742857142857143,
898
+ "grad_norm": 0.08443068712949753,
899
+ "learning_rate": 6.900958466453674e-05,
900
+ "logits/chosen": NaN,
901
+ "logits/rejected": NaN,
902
+ "logps/chosen": -184.30429077148438,
903
+ "logps/rejected": -262.72845458984375,
904
+ "loss": 0.069,
905
+ "rewards/accuracies": 0.90625,
906
+ "rewards/chosen": 1.0201094150543213,
907
+ "rewards/margins": 8.405547142028809,
908
+ "rewards/rejected": -7.385438442230225,
909
+ "step": 240
910
+ },
911
+ {
912
+ "epoch": 2.7885714285714287,
913
+ "grad_norm": 0.962510347366333,
914
+ "learning_rate": 6.645367412140575e-05,
915
+ "logits/chosen": NaN,
916
+ "logits/rejected": NaN,
917
+ "logps/chosen": -253.1976776123047,
918
+ "logps/rejected": -213.32867431640625,
919
+ "loss": 0.0908,
920
+ "rewards/accuracies": 0.875,
921
+ "rewards/chosen": 0.9948629140853882,
922
+ "rewards/margins": 8.913736343383789,
923
+ "rewards/rejected": -7.918873310089111,
924
+ "step": 244
925
+ },
926
+ {
927
+ "epoch": 2.8342857142857145,
928
+ "grad_norm": 0.09702732414007187,
929
+ "learning_rate": 6.389776357827476e-05,
930
+ "logits/chosen": -0.919600248336792,
931
+ "logits/rejected": -1.0969903469085693,
932
+ "logps/chosen": -262.49688720703125,
933
+ "logps/rejected": -316.8937072753906,
934
+ "loss": 0.0016,
935
+ "rewards/accuracies": 1.0,
936
+ "rewards/chosen": 1.6478074789047241,
937
+ "rewards/margins": 10.203094482421875,
938
+ "rewards/rejected": -8.55528736114502,
939
+ "step": 248
940
+ },
941
+ {
942
+ "epoch": 2.88,
943
+ "grad_norm": 1.1994304656982422,
944
+ "learning_rate": 6.134185303514376e-05,
945
+ "logits/chosen": NaN,
946
+ "logits/rejected": NaN,
947
+ "logps/chosen": -232.12115478515625,
948
+ "logps/rejected": -297.3643798828125,
949
+ "loss": 0.0235,
950
+ "rewards/accuracies": 0.96875,
951
+ "rewards/chosen": 0.6859785318374634,
952
+ "rewards/margins": 10.150031089782715,
953
+ "rewards/rejected": -9.4640531539917,
954
+ "step": 252
955
+ },
956
+ {
957
+ "epoch": 2.9257142857142857,
958
+ "grad_norm": 0.09092514961957932,
959
+ "learning_rate": 5.878594249201278e-05,
960
+ "logits/chosen": NaN,
961
+ "logits/rejected": NaN,
962
+ "logps/chosen": -253.23870849609375,
963
+ "logps/rejected": -259.6832580566406,
964
+ "loss": 0.0227,
965
+ "rewards/accuracies": 0.96875,
966
+ "rewards/chosen": 0.6735504865646362,
967
+ "rewards/margins": 9.920062065124512,
968
+ "rewards/rejected": -9.246511459350586,
969
+ "step": 256
970
+ },
971
+ {
972
+ "epoch": 2.9714285714285715,
973
+ "grad_norm": 0.5308630466461182,
974
+ "learning_rate": 5.623003194888179e-05,
975
+ "logits/chosen": NaN,
976
+ "logits/rejected": NaN,
977
+ "logps/chosen": -197.1396026611328,
978
+ "logps/rejected": -211.8688507080078,
979
+ "loss": 0.1108,
980
+ "rewards/accuracies": 0.84375,
981
+ "rewards/chosen": 1.3177775144577026,
982
+ "rewards/margins": 8.077342987060547,
983
+ "rewards/rejected": -6.759566307067871,
984
+ "step": 260
985
+ },
986
+ {
987
+ "epoch": 3.0171428571428573,
988
+ "grad_norm": 0.019223162904381752,
989
+ "learning_rate": 5.36741214057508e-05,
990
+ "logits/chosen": NaN,
991
+ "logits/rejected": NaN,
992
+ "logps/chosen": -236.93826293945312,
993
+ "logps/rejected": -194.27305603027344,
994
+ "loss": 0.0887,
995
+ "rewards/accuracies": 0.875,
996
+ "rewards/chosen": 1.6951510906219482,
997
+ "rewards/margins": 8.964152336120605,
998
+ "rewards/rejected": -7.269002437591553,
999
+ "step": 264
1000
+ },
1001
+ {
1002
+ "epoch": 3.0628571428571427,
1003
+ "grad_norm": 0.024787016212940216,
1004
+ "learning_rate": 5.1118210862619806e-05,
1005
+ "logits/chosen": NaN,
1006
+ "logits/rejected": NaN,
1007
+ "logps/chosen": -200.06399536132812,
1008
+ "logps/rejected": -265.58721923828125,
1009
+ "loss": 0.0869,
1010
+ "rewards/accuracies": 0.875,
1011
+ "rewards/chosen": 0.28237906098365784,
1012
+ "rewards/margins": 9.305129051208496,
1013
+ "rewards/rejected": -9.022750854492188,
1014
+ "step": 268
1015
+ },
1016
+ {
1017
+ "epoch": 3.1085714285714285,
1018
+ "grad_norm": 0.02963140606880188,
1019
+ "learning_rate": 4.856230031948882e-05,
1020
+ "logits/chosen": NaN,
1021
+ "logits/rejected": NaN,
1022
+ "logps/chosen": -273.082275390625,
1023
+ "logps/rejected": -252.20896911621094,
1024
+ "loss": 0.0218,
1025
+ "rewards/accuracies": 0.96875,
1026
+ "rewards/chosen": 1.426784634590149,
1027
+ "rewards/margins": 10.334057807922363,
1028
+ "rewards/rejected": -8.90727424621582,
1029
+ "step": 272
1030
+ },
1031
+ {
1032
+ "epoch": 3.1542857142857144,
1033
+ "grad_norm": 0.02248663455247879,
1034
+ "learning_rate": 4.600638977635783e-05,
1035
+ "logits/chosen": NaN,
1036
+ "logits/rejected": NaN,
1037
+ "logps/chosen": -226.61148071289062,
1038
+ "logps/rejected": -308.6155700683594,
1039
+ "loss": 0.0434,
1040
+ "rewards/accuracies": 0.9375,
1041
+ "rewards/chosen": -0.20196402072906494,
1042
+ "rewards/margins": 11.114026069641113,
1043
+ "rewards/rejected": -11.315988540649414,
1044
+ "step": 276
1045
+ },
1046
+ {
1047
+ "epoch": 3.2,
1048
+ "grad_norm": 0.1719914972782135,
1049
+ "learning_rate": 4.345047923322684e-05,
1050
+ "logits/chosen": NaN,
1051
+ "logits/rejected": NaN,
1052
+ "logps/chosen": -273.6976013183594,
1053
+ "logps/rejected": -253.73367309570312,
1054
+ "loss": 0.0438,
1055
+ "rewards/accuracies": 0.9375,
1056
+ "rewards/chosen": 0.6315146684646606,
1057
+ "rewards/margins": 11.08044147491455,
1058
+ "rewards/rejected": -10.448925018310547,
1059
+ "step": 280
1060
+ },
1061
+ {
1062
+ "epoch": 3.2457142857142856,
1063
+ "grad_norm": 0.07747913151979446,
1064
+ "learning_rate": 4.089456869009585e-05,
1065
+ "logits/chosen": -1.1313278675079346,
1066
+ "logits/rejected": -1.0815073251724243,
1067
+ "logps/chosen": -281.3612060546875,
1068
+ "logps/rejected": -231.41818237304688,
1069
+ "loss": 0.0004,
1070
+ "rewards/accuracies": 1.0,
1071
+ "rewards/chosen": 0.41760969161987305,
1072
+ "rewards/margins": 10.470647811889648,
1073
+ "rewards/rejected": -10.053038597106934,
1074
+ "step": 284
1075
+ },
1076
+ {
1077
+ "epoch": 3.2914285714285714,
1078
+ "grad_norm": 0.019036294892430305,
1079
+ "learning_rate": 3.8338658146964856e-05,
1080
+ "logits/chosen": NaN,
1081
+ "logits/rejected": NaN,
1082
+ "logps/chosen": -256.3636169433594,
1083
+ "logps/rejected": -321.89471435546875,
1084
+ "loss": 0.0219,
1085
+ "rewards/accuracies": 0.96875,
1086
+ "rewards/chosen": 0.9431450366973877,
1087
+ "rewards/margins": 11.828181266784668,
1088
+ "rewards/rejected": -10.88503646850586,
1089
+ "step": 288
1090
+ },
1091
+ {
1092
+ "epoch": 3.337142857142857,
1093
+ "grad_norm": 0.5823835730552673,
1094
+ "learning_rate": 3.5782747603833865e-05,
1095
+ "logits/chosen": NaN,
1096
+ "logits/rejected": NaN,
1097
+ "logps/chosen": -229.27243041992188,
1098
+ "logps/rejected": -306.8113708496094,
1099
+ "loss": 0.0868,
1100
+ "rewards/accuracies": 0.875,
1101
+ "rewards/chosen": -0.37009963393211365,
1102
+ "rewards/margins": 10.902031898498535,
1103
+ "rewards/rejected": -11.272132873535156,
1104
+ "step": 292
1105
+ },
1106
+ {
1107
+ "epoch": 3.382857142857143,
1108
+ "grad_norm": 0.0879807099699974,
1109
+ "learning_rate": 3.322683706070287e-05,
1110
+ "logits/chosen": NaN,
1111
+ "logits/rejected": NaN,
1112
+ "logps/chosen": -348.1703796386719,
1113
+ "logps/rejected": -276.8051452636719,
1114
+ "loss": 0.0438,
1115
+ "rewards/accuracies": 0.9375,
1116
+ "rewards/chosen": 0.8444142937660217,
1117
+ "rewards/margins": 11.02114486694336,
1118
+ "rewards/rejected": -10.176729202270508,
1119
+ "step": 296
1120
+ },
1121
+ {
1122
+ "epoch": 3.4285714285714284,
1123
+ "grad_norm": 0.10615295171737671,
1124
+ "learning_rate": 3.067092651757188e-05,
1125
+ "logits/chosen": NaN,
1126
+ "logits/rejected": NaN,
1127
+ "logps/chosen": -236.68743896484375,
1128
+ "logps/rejected": -297.0989990234375,
1129
+ "loss": 0.0435,
1130
+ "rewards/accuracies": 0.9375,
1131
+ "rewards/chosen": 0.44540417194366455,
1132
+ "rewards/margins": 10.856500625610352,
1133
+ "rewards/rejected": -10.411096572875977,
1134
+ "step": 300
1135
+ },
1136
+ {
1137
+ "epoch": 3.474285714285714,
1138
+ "grad_norm": 0.1389647126197815,
1139
+ "learning_rate": 2.8115015974440894e-05,
1140
+ "logits/chosen": NaN,
1141
+ "logits/rejected": NaN,
1142
+ "logps/chosen": -233.98634338378906,
1143
+ "logps/rejected": -225.74227905273438,
1144
+ "loss": 0.1087,
1145
+ "rewards/accuracies": 0.84375,
1146
+ "rewards/chosen": 0.649261474609375,
1147
+ "rewards/margins": 8.719908714294434,
1148
+ "rewards/rejected": -8.070647239685059,
1149
+ "step": 304
1150
+ },
1151
+ {
1152
+ "epoch": 3.52,
1153
+ "grad_norm": 0.08364980667829514,
1154
+ "learning_rate": 2.5559105431309903e-05,
1155
+ "logits/chosen": NaN,
1156
+ "logits/rejected": NaN,
1157
+ "logps/chosen": -247.9769287109375,
1158
+ "logps/rejected": -222.0983123779297,
1159
+ "loss": 0.0434,
1160
+ "rewards/accuracies": 0.9375,
1161
+ "rewards/chosen": 1.2255136966705322,
1162
+ "rewards/margins": 10.814766883850098,
1163
+ "rewards/rejected": -9.589252471923828,
1164
+ "step": 308
1165
+ },
1166
+ {
1167
+ "epoch": 3.565714285714286,
1168
+ "grad_norm": 0.024187587201595306,
1169
+ "learning_rate": 2.3003194888178915e-05,
1170
+ "logits/chosen": NaN,
1171
+ "logits/rejected": NaN,
1172
+ "logps/chosen": -230.9536590576172,
1173
+ "logps/rejected": -308.1141662597656,
1174
+ "loss": 0.0651,
1175
+ "rewards/accuracies": 0.90625,
1176
+ "rewards/chosen": 0.6026107668876648,
1177
+ "rewards/margins": 10.963134765625,
1178
+ "rewards/rejected": -10.36052417755127,
1179
+ "step": 312
1180
+ },
1181
+ {
1182
+ "epoch": 3.611428571428571,
1183
+ "grad_norm": 0.041134633123874664,
1184
+ "learning_rate": 2.0447284345047924e-05,
1185
+ "logits/chosen": NaN,
1186
+ "logits/rejected": NaN,
1187
+ "logps/chosen": -278.3012390136719,
1188
+ "logps/rejected": -295.2455139160156,
1189
+ "loss": 0.065,
1190
+ "rewards/accuracies": 0.90625,
1191
+ "rewards/chosen": 1.5797958374023438,
1192
+ "rewards/margins": 11.178966522216797,
1193
+ "rewards/rejected": -9.599170684814453,
1194
+ "step": 316
1195
+ },
1196
+ {
1197
+ "epoch": 3.657142857142857,
1198
+ "grad_norm": 0.018303895369172096,
1199
+ "learning_rate": 1.7891373801916932e-05,
1200
+ "logits/chosen": NaN,
1201
+ "logits/rejected": NaN,
1202
+ "logps/chosen": -296.68463134765625,
1203
+ "logps/rejected": -361.7939453125,
1204
+ "loss": 0.0217,
1205
+ "rewards/accuracies": 0.96875,
1206
+ "rewards/chosen": 1.0021604299545288,
1207
+ "rewards/margins": 12.465021133422852,
1208
+ "rewards/rejected": -11.462860107421875,
1209
+ "step": 320
1210
+ },
1211
+ {
1212
+ "epoch": 3.702857142857143,
1213
+ "grad_norm": 1.3282262086868286,
1214
+ "learning_rate": 1.533546325878594e-05,
1215
+ "logits/chosen": NaN,
1216
+ "logits/rejected": NaN,
1217
+ "logps/chosen": -227.36346435546875,
1218
+ "logps/rejected": -220.03289794921875,
1219
+ "loss": 0.1087,
1220
+ "rewards/accuracies": 0.84375,
1221
+ "rewards/chosen": 0.9805165529251099,
1222
+ "rewards/margins": 9.542567253112793,
1223
+ "rewards/rejected": -8.562050819396973,
1224
+ "step": 324
1225
+ },
1226
+ {
1227
+ "epoch": 3.7485714285714287,
1228
+ "grad_norm": 0.14205706119537354,
1229
+ "learning_rate": 1.2779552715654951e-05,
1230
+ "logits/chosen": -1.0746899843215942,
1231
+ "logits/rejected": -1.233121395111084,
1232
+ "logps/chosen": -327.04486083984375,
1233
+ "logps/rejected": -355.2626953125,
1234
+ "loss": 0.0004,
1235
+ "rewards/accuracies": 1.0,
1236
+ "rewards/chosen": 0.632662832736969,
1237
+ "rewards/margins": 11.084798812866211,
1238
+ "rewards/rejected": -10.452136039733887,
1239
+ "step": 328
1240
+ },
1241
+ {
1242
+ "epoch": 3.7942857142857145,
1243
+ "grad_norm": 0.30354443192481995,
1244
+ "learning_rate": 1.0223642172523962e-05,
1245
+ "logits/chosen": -1.0154728889465332,
1246
+ "logits/rejected": -1.2137951850891113,
1247
+ "logps/chosen": -208.1333465576172,
1248
+ "logps/rejected": -226.25259399414062,
1249
+ "loss": 0.0002,
1250
+ "rewards/accuracies": 1.0,
1251
+ "rewards/chosen": 1.5299694538116455,
1252
+ "rewards/margins": 10.347978591918945,
1253
+ "rewards/rejected": -8.818008422851562,
1254
+ "step": 332
1255
+ },
1256
+ {
1257
+ "epoch": 3.84,
1258
+ "grad_norm": 0.016442114487290382,
1259
+ "learning_rate": 7.66773162939297e-06,
1260
+ "logits/chosen": NaN,
1261
+ "logits/rejected": NaN,
1262
+ "logps/chosen": -184.98435974121094,
1263
+ "logps/rejected": -204.31524658203125,
1264
+ "loss": 0.1092,
1265
+ "rewards/accuracies": 0.84375,
1266
+ "rewards/chosen": 1.1629523038864136,
1267
+ "rewards/margins": 8.743239402770996,
1268
+ "rewards/rejected": -7.580286979675293,
1269
+ "step": 336
1270
+ },
1271
+ {
1272
+ "epoch": 3.8857142857142857,
1273
+ "grad_norm": 0.1124640479683876,
1274
+ "learning_rate": 5.111821086261981e-06,
1275
+ "logits/chosen": NaN,
1276
+ "logits/rejected": NaN,
1277
+ "logps/chosen": -260.33941650390625,
1278
+ "logps/rejected": -250.80712890625,
1279
+ "loss": 0.022,
1280
+ "rewards/accuracies": 0.96875,
1281
+ "rewards/chosen": 2.213810682296753,
1282
+ "rewards/margins": 11.022459983825684,
1283
+ "rewards/rejected": -8.808650016784668,
1284
+ "step": 340
1285
+ },
1286
+ {
1287
+ "epoch": 3.9314285714285715,
1288
+ "grad_norm": 0.2672106623649597,
1289
+ "learning_rate": 2.5559105431309904e-06,
1290
+ "logits/chosen": NaN,
1291
+ "logits/rejected": NaN,
1292
+ "logps/chosen": -317.84588623046875,
1293
+ "logps/rejected": -330.1520080566406,
1294
+ "loss": 0.0218,
1295
+ "rewards/accuracies": 0.96875,
1296
+ "rewards/chosen": 0.6001543998718262,
1297
+ "rewards/margins": 11.707775115966797,
1298
+ "rewards/rejected": -11.107621192932129,
1299
+ "step": 344
1300
+ },
1301
+ {
1302
+ "epoch": 3.977142857142857,
1303
+ "grad_norm": 0.14436927437782288,
1304
+ "learning_rate": 0.0,
1305
+ "logits/chosen": NaN,
1306
+ "logits/rejected": NaN,
1307
+ "logps/chosen": -237.04251098632812,
1308
+ "logps/rejected": -338.6295471191406,
1309
+ "loss": 0.0219,
1310
+ "rewards/accuracies": 0.96875,
1311
+ "rewards/chosen": 0.9118407964706421,
1312
+ "rewards/margins": 11.192133903503418,
1313
+ "rewards/rejected": -10.280294418334961,
1314
+ "step": 348
1315
+ }
1316
+ ],
1317
+ "logging_steps": 4,
1318
+ "max_steps": 348,
1319
+ "num_input_tokens_seen": 0,
1320
+ "num_train_epochs": 4,
1321
+ "save_steps": 500,
1322
+ "stateful_callbacks": {
1323
+ "TrainerControl": {
1324
+ "args": {
1325
+ "should_epoch_stop": false,
1326
+ "should_evaluate": false,
1327
+ "should_log": false,
1328
+ "should_save": true,
1329
+ "should_training_stop": true
1330
+ },
1331
+ "attributes": {}
1332
+ }
1333
+ },
1334
+ "total_flos": 0.0,
1335
+ "train_batch_size": 1,
1336
+ "trial_name": null,
1337
+ "trial_params": null
1338
+ }
drive/MyDrive/checkpoint-348/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:401c8f0a5b208ac7229a8cefe34fcd909bad1958dc09ab0e56652e62fa248e8b
3
+ size 6008
drive/MyDrive/dpo_model/config.json ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "meta-llama/Llama-2-7b-hf",
3
+ "architectures": [
4
+ "LlamaForCausalLM"
5
+ ],
6
+ "attention_bias": false,
7
+ "attention_dropout": 0.0,
8
+ "bos_token_id": 1,
9
+ "eos_token_id": 2,
10
+ "head_dim": 128,
11
+ "hidden_act": "silu",
12
+ "hidden_size": 4096,
13
+ "initializer_range": 0.02,
14
+ "intermediate_size": 11008,
15
+ "max_position_embeddings": 4096,
16
+ "mlp_bias": false,
17
+ "model_type": "llama",
18
+ "num_attention_heads": 32,
19
+ "num_hidden_layers": 32,
20
+ "num_key_value_heads": 32,
21
+ "pretraining_tp": 1,
22
+ "quantization_config": {
23
+ "_load_in_4bit": true,
24
+ "_load_in_8bit": false,
25
+ "bnb_4bit_compute_dtype": "bfloat16",
26
+ "bnb_4bit_quant_storage": "uint8",
27
+ "bnb_4bit_quant_type": "nf4",
28
+ "bnb_4bit_use_double_quant": true,
29
+ "llm_int8_enable_fp32_cpu_offload": false,
30
+ "llm_int8_has_fp16_weight": false,
31
+ "llm_int8_skip_modules": null,
32
+ "llm_int8_threshold": 6.0,
33
+ "load_in_4bit": true,
34
+ "load_in_8bit": false,
35
+ "quant_method": "bitsandbytes"
36
+ },
37
+ "rms_norm_eps": 1e-05,
38
+ "rope_scaling": null,
39
+ "rope_theta": 10000.0,
40
+ "tie_word_embeddings": false,
41
+ "torch_dtype": "float32",
42
+ "transformers_version": "4.46.2",
43
+ "use_cache": true,
44
+ "vocab_size": 32000
45
+ }
drive/MyDrive/dpo_model/generation_config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 1,
3
+ "do_sample": true,
4
+ "eos_token_id": 2,
5
+ "max_length": 4096,
6
+ "pad_token_id": 0,
7
+ "temperature": 0.6,
8
+ "top_p": 0.9,
9
+ "transformers_version": "4.46.2"
10
+ }
drive/MyDrive/dpo_model/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38dc639c2a14333f1e4c11f29287c431eda286bb9adfff73b278d66e6069c4db
3
+ size 4407665626
sample_data/README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ This directory includes a few sample datasets to get you started.
2
+
3
+ * `california_housing_data*.csv` is California housing data from the 1990 US
4
+ Census; more information is available at:
5
+ https://docs.google.com/document/d/e/2PACX-1vRhYtsvc5eOR2FWNCwaBiKL6suIOrxJig8LcSBbmCbyYsayia_DvPOOBlXZ4CAlQ5nlDD8kTaIDRwrN/pub
6
+
7
+ * `mnist_*.csv` is a small sample of the
8
+ [MNIST database](https://en.wikipedia.org/wiki/MNIST_database), which is
9
+ described at: http://yann.lecun.com/exdb/mnist/
10
+
11
+ * `anscombe.json` contains a copy of
12
+ [Anscombe's quartet](https://en.wikipedia.org/wiki/Anscombe%27s_quartet); it
13
+ was originally described in
14
+
15
+ Anscombe, F. J. (1973). 'Graphs in Statistical Analysis'. American
16
+ Statistician. 27 (1): 17-21. JSTOR 2682899.
17
+
18
+ and our copy was prepared by the
19
+ [vega_datasets library](https://github.com/altair-viz/vega_datasets/blob/4f67bdaad10f45e3549984e17e1b3088c731503d/vega_datasets/_data/anscombe.json).
sample_data/anscombe.json ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {"Series":"I", "X":10.0, "Y":8.04},
3
+ {"Series":"I", "X":8.0, "Y":6.95},
4
+ {"Series":"I", "X":13.0, "Y":7.58},
5
+ {"Series":"I", "X":9.0, "Y":8.81},
6
+ {"Series":"I", "X":11.0, "Y":8.33},
7
+ {"Series":"I", "X":14.0, "Y":9.96},
8
+ {"Series":"I", "X":6.0, "Y":7.24},
9
+ {"Series":"I", "X":4.0, "Y":4.26},
10
+ {"Series":"I", "X":12.0, "Y":10.84},
11
+ {"Series":"I", "X":7.0, "Y":4.81},
12
+ {"Series":"I", "X":5.0, "Y":5.68},
13
+
14
+ {"Series":"II", "X":10.0, "Y":9.14},
15
+ {"Series":"II", "X":8.0, "Y":8.14},
16
+ {"Series":"II", "X":13.0, "Y":8.74},
17
+ {"Series":"II", "X":9.0, "Y":8.77},
18
+ {"Series":"II", "X":11.0, "Y":9.26},
19
+ {"Series":"II", "X":14.0, "Y":8.10},
20
+ {"Series":"II", "X":6.0, "Y":6.13},
21
+ {"Series":"II", "X":4.0, "Y":3.10},
22
+ {"Series":"II", "X":12.0, "Y":9.13},
23
+ {"Series":"II", "X":7.0, "Y":7.26},
24
+ {"Series":"II", "X":5.0, "Y":4.74},
25
+
26
+ {"Series":"III", "X":10.0, "Y":7.46},
27
+ {"Series":"III", "X":8.0, "Y":6.77},
28
+ {"Series":"III", "X":13.0, "Y":12.74},
29
+ {"Series":"III", "X":9.0, "Y":7.11},
30
+ {"Series":"III", "X":11.0, "Y":7.81},
31
+ {"Series":"III", "X":14.0, "Y":8.84},
32
+ {"Series":"III", "X":6.0, "Y":6.08},
33
+ {"Series":"III", "X":4.0, "Y":5.39},
34
+ {"Series":"III", "X":12.0, "Y":8.15},
35
+ {"Series":"III", "X":7.0, "Y":6.42},
36
+ {"Series":"III", "X":5.0, "Y":5.73},
37
+
38
+ {"Series":"IV", "X":8.0, "Y":6.58},
39
+ {"Series":"IV", "X":8.0, "Y":5.76},
40
+ {"Series":"IV", "X":8.0, "Y":7.71},
41
+ {"Series":"IV", "X":8.0, "Y":8.84},
42
+ {"Series":"IV", "X":8.0, "Y":8.47},
43
+ {"Series":"IV", "X":8.0, "Y":7.04},
44
+ {"Series":"IV", "X":8.0, "Y":5.25},
45
+ {"Series":"IV", "X":19.0, "Y":12.50},
46
+ {"Series":"IV", "X":8.0, "Y":5.56},
47
+ {"Series":"IV", "X":8.0, "Y":7.91},
48
+ {"Series":"IV", "X":8.0, "Y":6.89}
49
+ ]
sample_data/california_housing_test.csv ADDED
The diff for this file is too large to render. See raw diff
 
sample_data/california_housing_train.csv ADDED
The diff for this file is too large to render. See raw diff
 
sample_data/mnist_test.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51c292478d94ec3a01461bdfa82eb0885d262eb09e615679b2d69dedb6ad09e7
3
+ size 18289443
sample_data/mnist_train_small.csv ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ef64781aa03180f4f5ce504314f058f5d0227277df86060473d973cf43b033e
3
+ size 36523880
special_tokens_map.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "</s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": "</s>",
17
+ "unk_token": {
18
+ "content": "<unk>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ }
24
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
3
+ size 499723
tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "eos_token": {
10
+ "content": "</s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": "</s>",
17
+ "unk_token": {
18
+ "content": "<unk>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ }
24
+ }
tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff