mgubri commited on
Commit
f1a42bd
·
verified ·
1 Parent(s): e60a6f1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -3
README.md CHANGED
@@ -3,9 +3,13 @@ license: mit
3
  base_model: microsoft/deberta-v3-base
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: apricot_clustering_trivia_qa_deberta-v3-base_for_vicuna-7b-v1.5
8
  results: []
 
 
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -13,11 +17,12 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # apricot_clustering_trivia_qa_deberta-v3-base_for_vicuna-7b-v1.5
15
 
16
- This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on the trivia_qa dataset.
17
 
18
  ## Model description
19
 
20
- More information needed
 
21
 
22
  ## Intended uses & limitations
23
 
@@ -31,6 +36,8 @@ More information needed
31
 
32
  ### Training hyperparameters
33
 
 
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 5e-05
36
  - train_batch_size: 8
@@ -45,4 +52,4 @@ The following hyperparameters were used during training:
45
  - Transformers 4.32.0
46
  - Pytorch 2.0.0+cu117
47
  - Datasets 2.14.6
48
- - Tokenizers 0.13.3
 
3
  base_model: microsoft/deberta-v3-base
4
  tags:
5
  - generated_from_trainer
6
+ - calibration
7
+ - uncertainty
8
  model-index:
9
  - name: apricot_clustering_trivia_qa_deberta-v3-base_for_vicuna-7b-v1.5
10
  results: []
11
+ datasets:
12
+ - mandarjoshi/trivia_qa
13
  ---
14
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
17
 
18
  # apricot_clustering_trivia_qa_deberta-v3-base_for_vicuna-7b-v1.5
19
 
20
+ This model is part of the 🍑 Apricot paper ["Calibrating Large Language Models Using Their Generations Only"](https://aclanthology.org/2024.acl-long.824/) (ACL 2024).
21
 
22
  ## Model description
23
 
24
+ This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) to predict the calibration score for the [lmsys/vicuna-7b-v1.5](https://huggingface.co/lmsys/vicuna-7b-v1.5) model on the questions from the trivia_qa dataset. It uses the clustering type of calibration target score.
25
+
26
 
27
  ## Intended uses & limitations
28
 
 
36
 
37
  ### Training hyperparameters
38
 
39
+ **TODO**: update the values below
40
+
41
  The following hyperparameters were used during training:
42
  - learning_rate: 5e-05
43
  - train_batch_size: 8
 
52
  - Transformers 4.32.0
53
  - Pytorch 2.0.0+cu117
54
  - Datasets 2.14.6
55
+ - Tokenizers 0.13.3