hf-tuner commited on
Commit
c8bb4a5
verified
1 Parent(s): 30dfe66

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -23
README.md CHANGED
@@ -1,36 +1,35 @@
1
- ---
2
- library_name: transformers
3
- license: mit
4
- base_model: microsoft/MiniLM-L12-H384-uncased
5
- tags:
6
- - generated_from_trainer
7
- model-index:
8
- - name: bert-mini-squadv2
9
- results: []
10
- ---
 
 
 
 
 
 
 
 
11
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
  should probably proofread and complete it, then remove this comment. -->
14
 
15
  # bert-mini-squadv2
16
 
17
- This model is a fine-tuned version of [microsoft/MiniLM-L12-H384-uncased](https://huggingface.co/microsoft/MiniLM-L12-H384-uncased) on an unknown dataset.
 
18
  It achieves the following results on the evaluation set:
19
  - Loss: 1.4653
20
 
21
  ## Model description
22
 
23
- More information needed
24
-
25
- ## Intended uses & limitations
26
-
27
- More information needed
28
-
29
- ## Training and evaluation data
30
-
31
- More information needed
32
-
33
- ## Training procedure
34
 
35
  ### Training hyperparameters
36
 
@@ -57,4 +56,4 @@ The following hyperparameters were used during training:
57
  - Transformers 4.57.1
58
  - Pytorch 2.8.0+cu126
59
  - Datasets 4.0.0
60
- - Tokenizers 0.22.1
 
1
+ ---
2
+ library_name: transformers
3
+ license: mit
4
+ base_model: microsoft/MiniLM-L12-H384-uncased
5
+ tags:
6
+ - generated_from_trainer
7
+ - extractive_QA
8
+ model-index:
9
+ - name: bert-mini-squadv2
10
+ results: []
11
+ datasets:
12
+ - hf-tuner/squad_v2.0.1
13
+ language:
14
+ - en
15
+ metrics:
16
+ - exact_match
17
+ pipeline_tag: question-answering
18
+ ---
19
 
20
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
21
  should probably proofread and complete it, then remove this comment. -->
22
 
23
  # bert-mini-squadv2
24
 
25
+ This model is a fine-tuned version of [microsoft/MiniLM-L12-H384-uncased](https://huggingface.co/microsoft/MiniLM-L12-H384-uncased) on
26
+ [hf-tuner/squad_v2.0.1](https://huggingface.co/datasets/hf-tuner/squad_v2.0.1) dataset.
27
  It achieves the following results on the evaluation set:
28
  - Loss: 1.4653
29
 
30
  ## Model description
31
 
32
+ MiniLMv1-L12-H384-uncased: 12-layer, 384-hidden, 12-heads, 33M parameters, 2.7x faster than BERT-Base
 
 
 
 
 
 
 
 
 
 
33
 
34
  ### Training hyperparameters
35
 
 
56
  - Transformers 4.57.1
57
  - Pytorch 2.8.0+cu126
58
  - Datasets 4.0.0
59
+ - Tokenizers 0.22.1