PavanNeerudu commited on
Commit
07a4a71
·
1 Parent(s): 192524c

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +49 -0
README.md ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ datasets:
6
+ - glue
7
+ metrics:
8
+ - accuracy
9
+ model-index:
10
+ - name: gpt2-finetuned-mnli
11
+ results:
12
+ - task:
13
+ name: Text Classification
14
+ type: text-classification
15
+ dataset:
16
+ name: GLUE MNLI
17
+ type: glue
18
+ args: mnli
19
+ metrics:
20
+ - name: Accuracy
21
+ type: accuracy
22
+ value: 0.81
23
+ ---
24
+
25
+
26
+ # gpt2-finetuned-mnli
27
+
28
+ <!-- Provide a quick summary of what the model is/does. -->
29
+
30
+ This model is GPT-2 fine-tuned on GLUE MNLI dataset.
31
+
32
+ ## Model Details
33
+ GPT-2 is a transformers model pretrained on a very large corpus of English data in a self-supervised fashion.
34
+ This means it was pretrained on the raw texts only, with no humans labelling them in any way (which is why it can use lots of publicly available data) with an automatic process to generate inputs and labels from those texts. More precisely, it was trained to guess the next word in sentences.
35
+ However, it acheives very good results on Text Classification tasks.
36
+ ## Training procedure
37
+
38
+
39
+ ### Training hyperparameters
40
+
41
+ The following hyperparameters were used during training:
42
+ - learning_rate: 2e-5
43
+ - train_batch_size: 16
44
+ - eval_batch_size: 16
45
+ - seed: 123
46
+ - optimizer: epsilon=1e-08
47
+ - num_epochs: 3
48
+
49
+ ### Training results