Hugging Face's logo

Ermira
/
qa_model

Question Answering
Transformers
TensorBoard
Safetensors
xlm-roberta
Generated from Trainer
Model card Files
xet
 Metrics Community
Ermira commited on
Commit
23a5f72
路
verified 路
1 Parent(s): 6893c28

End of training

Browse files
Files changed (5) hide show
  1. README.md +61 -0
  2. model.safetensors +1 -1
  3. runs/Mar16_11-46-02_46510ad1b83d/events.out.tfevents.1710589563.46510ad1b83d.140.0 +3 -0
  4. runs/Mar16_11-48-45_46510ad1b83d/events.out.tfevents.1710589726.46510ad1b83d.140.1 +3 -0
  5. training_args.bin +1 -1
README.md ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: distilbert/distilbert-base-uncased
4
+ tags:
5
+ - generated_from_trainer
6
+ datasets:
7
+ - squad
8
+ model-index:
9
+ - name: qa_model
10
+ results: []
11
+ ---
12
+
13
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
+ should probably proofread and complete it, then remove this comment. -->
15
+
16
+ # qa_model
17
+
18
+ This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on the squad dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 3.6498
21
+
22
+ ## Model description
23
+
24
+ More information needed
25
+
26
+ ## Intended uses & limitations
27
+
28
+ More information needed
29
+
30
+ ## Training and evaluation data
31
+
32
+ More information needed
33
+
34
+ ## Training procedure
35
+
36
+ ### Training hyperparameters
37
+
38
+ The following hyperparameters were used during training:
39
+ - learning_rate: 2e-05
40
+ - train_batch_size: 16
41
+ - eval_batch_size: 16
42
+ - seed: 42
43
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
+ - lr_scheduler_type: linear
45
+ - num_epochs: 3
46
+
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss |
50
+ |:-------------:|:-----:|:----:|:---------------:|
51
+ | No log | 1.0 | 50 | 4.1982 |
52
+ | No log | 2.0 | 100 | 3.7093 |
53
+ | No log | 3.0 | 150 | 3.6498 |
54
+
55
+
56
+ ### Framework versions
57
+
58
+ - Transformers 4.38.1
59
+ - Pytorch 2.1.2
60
+ - Datasets 2.1.0
61
+ - Tokenizers 0.15.2
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8981b3d33ea89e7fc5847ecfe66a8a556821d8043302b3e5abfc0e25c5e749c3
3
  size 265470032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:742bb9f9f58e25e6d1ee082371c6b460d283491eadf34b00bcd43a6e4c023c15
3
  size 265470032
runs/Mar16_11-46-02_46510ad1b83d/events.out.tfevents.1710589563.46510ad1b83d.140.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2aa3a28b096a9aea7a186e2c3de4eb99b53f783e5c9625a0fe7b8f1a353afc20
3
+ size 5589
runs/Mar16_11-48-45_46510ad1b83d/events.out.tfevents.1710589726.46510ad1b83d.140.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a631fe0557fe2ab7aec11c04ee2692eb82b77ed81f58c1bac05e72442773fc81
3
+ size 5600
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cd79e89696afcb3e93f2b5bd184e35e417006dc3e758187ee8409b832e7b3de5
3
  size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4643b72603ee283b0ae3ea7a12dd5047bf9964be5aa72255b2d33324a5b4dbdb
3
  size 4856