Hugging Face's logo

ccore
/
opt-125-smart-test

Text Generation
Transformers
PyTorch
opt
text-generation-inference
Model card Files
xet
 Community
3
ccore commited on
Commit
598a55c
·
1 Parent(s): 73bb7e9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -1,6 +1,13 @@
1
  ---
2
  license: gpl-3.0
3
  ---
 
 
 
 
 
 
 
4
  prompt format:
5
 
6
  [INSTRUCTION] what's the capital of Brasil? ?
 
1
  ---
2
  license: gpl-3.0
3
  ---
4
+ hf-causal (pretrained=ccore/opt-125-smart-test), limit: None, provide_description: False, num_fewshot: 0, batch_size: None
5
+ | Task |Version| Metric |Value | |Stderr|
6
+ |----------|------:|--------|-----:|---|-----:|
7
+ |openbookqa| 0|acc |0.1560|± |0.0162|
8
+ | | |acc_norm|0.3420|± |0.0212|
9
+ |piqa | 0|acc |0.6197|± |0.0113|
10
+ | | |acc_norm|0.6023|± |0.0114|
11
  prompt format:
12
 
13
  [INSTRUCTION] what's the capital of Brasil? ?