Hugging Face's logo

farid1088
/
qa_bert

Question Answering
Transformers
TensorBoard
Safetensors
bert
Generated from Trainer
Model card Files
xet
 Metrics Community
farid1088 commited on
Commit
7801c23
路
verified 路
1 Parent(s): 9743c02

Model save

Browse files
Files changed (6) hide show
  1. README.md +23 -5
  2. emissions.csv +1 -1
  3. model.safetensors +1 -1
  4. runs/Mar02_13-44-21_hcdsgpu1/events.out.tfevents.1709387071.hcdsgpu1.240208.0 +3 -0
  5. tokenizer.json +2 -16
  6. training_args.bin +1 -1
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model was trained from scratch on the None dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 3.0288
17
 
18
  ## Model description
19
 
@@ -33,19 +33,37 @@ More information needed
33
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 2e-05
36
- - train_batch_size: 40
37
  - eval_batch_size: 5
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
- - num_epochs: 2
42
 
43
  ### Training results
44
 
45
  | Training Loss | Epoch | Step | Validation Loss |
46
  |:-------------:|:-----:|:----:|:---------------:|
47
- | No log | 1.0 | 9 | 3.1963 |
48
- | No log | 2.0 | 18 | 3.0288 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
 
50
 
51
  ### Framework versions
 
13
 
14
  This model was trained from scratch on the None dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 4.5051
17
 
18
  ## Model description
19
 
 
33
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 2e-05
36
+ - train_batch_size: 160
37
  - eval_batch_size: 5
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
+ - num_epochs: 20
42
 
43
  ### Training results
44
 
45
  | Training Loss | Epoch | Step | Validation Loss |
46
  |:-------------:|:-----:|:----:|:---------------:|
47
+ | No log | 1.0 | 1 | 6.0874 |
48
+ | No log | 2.0 | 2 | 5.9063 |
49
+ | No log | 3.0 | 3 | 5.7224 |
50
+ | No log | 4.0 | 4 | 5.5453 |
51
+ | No log | 5.0 | 5 | 5.3798 |
52
+ | No log | 6.0 | 6 | 5.2311 |
53
+ | No log | 7.0 | 7 | 5.1051 |
54
+ | No log | 8.0 | 8 | 4.9980 |
55
+ | No log | 9.0 | 9 | 4.9069 |
56
+ | No log | 10.0 | 10 | 4.8298 |
57
+ | No log | 11.0 | 11 | 4.7628 |
58
+ | No log | 12.0 | 12 | 4.7047 |
59
+ | No log | 13.0 | 13 | 4.6565 |
60
+ | No log | 14.0 | 14 | 4.6156 |
61
+ | No log | 15.0 | 15 | 4.5825 |
62
+ | No log | 16.0 | 16 | 4.5555 |
63
+ | No log | 17.0 | 17 | 4.5345 |
64
+ | No log | 18.0 | 18 | 4.5195 |
65
+ | No log | 19.0 | 19 | 4.5101 |
66
+ | No log | 20.0 | 20 | 4.5051 |
67
 
68
 
69
  ### Framework versions
emissions.csv CHANGED
@@ -1,2 +1,2 @@
1
  timestamp,project_name,run_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
- 2024-03-01T18:37:37,codecarbon,54aa31de-a3ec-4495-b927-7285bbd313a9,19.324065923690796,0.0018809606630507847,9.733772749888917e-05,112.5,413.41700000000003,377.8920922279358,0.0006038699597120285,0.0026826128441476823,0.0020222115660146803,0.005308694369874392,Germany,DEU,free and hanseatic city of hamburg,,,Linux-5.15.0-97-generic-x86_64-with-glibc2.35,3.11.4,2.2.3,128,AMD EPYC 7543 32-Core Processor,5,4 x NVIDIA A401 x NVIDIA A100 80GB PCIe,9.9683,53.5649,1007.7122459411621,machine,N,1.0
 
1
  timestamp,project_name,run_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
2
+ 2024-03-02T13:45:22,codecarbon,796a8fb7-210e-4b44-b74e-2d62a00c4530,51.12793207168579,0.006170864604024167,0.00012069458618768466,112.5,488.164,377.8920922279358,0.0015977130606770517,0.01046330335225231,0.005355208617267231,0.017416225030196596,Germany,DEU,free and hanseatic city of hamburg,,,Linux-5.15.0-97-generic-x86_64-with-glibc2.35,3.11.4,2.2.3,128,AMD EPYC 7543 32-Core Processor,5,4 x NVIDIA A401 x NVIDIA A100 80GB PCIe,9.9683,53.5649,1007.7122459411621,machine,N,1.0
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ff5c167ec15895d4425fd3bd0d1c07c7e3cbe4f7e1fea2ecc6b63b62aca0b485
3
  size 433992496
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83f0918aa06150cbf92a18730b8418101436da38c4da767a70255f03569fc11b
3
  size 433992496
runs/Mar02_13-44-21_hcdsgpu1/events.out.tfevents.1709387071.hcdsgpu1.240208.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ed76ce660c2f4015ae0e30337bf15887f376e3bcc45c8a237fbe61191ad45b3
3
+ size 10204
tokenizer.json CHANGED
@@ -1,21 +1,7 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 256,
6
- "strategy": "OnlySecond",
7
- "stride": 0
8
- },
9
- "padding": {
10
- "strategy": {
11
- "Fixed": 256
12
- },
13
- "direction": "Right",
14
- "pad_to_multiple_of": null,
15
- "pad_id": 0,
16
- "pad_type_id": 0,
17
- "pad_token": "[PAD]"
18
- },
19
  "added_tokens": [
20
  {
21
  "id": 0,
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
4
+ "padding": null,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  "added_tokens": [
6
  {
7
  "id": 0,
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:672cc623e3617e01d534dc9f37595bfcd6c90fb8a7581608e9d2d2d21a278187
3
  size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7ce6b7bb296b0598f55f56b54061e850bca3614e8b9d09ce65a351ce09e9d37
3
  size 4856