Hugging Face's logo

M4-ai
/
NeuralReyna-Mini-1.8B-v0.2

Text Generation
Transformers
Safetensors
English
qwen2
conversational
Eval Results
text-generation-inference
Model card Files
xet
Community
3
Locutusque commited on
Commit
2856795
·
verified ·
1 Parent(s): 103d947

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -27,6 +27,23 @@ This model was trained on OpenAI's ChatML prompt format.
27
  AGIEval:
28
  ![eval](https://media.discordapp.net/attachments/1190343662400458884/1209814747864764426/Screenshot_from_2024-02-21_16-21-09.png?ex=65e84ac9&is=65d5d5c9&hm=b3aca22a8add5510bce55fa648c5d204e495ceb54cbe2bc9f63b752a6bcb6c9e&)
29
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  # Disclaimer
31
 
32
  This model may have overfitted to the DPO training data, and may not perform well.
 
27
  AGIEval:
28
  ![eval](https://media.discordapp.net/attachments/1190343662400458884/1209814747864764426/Screenshot_from_2024-02-21_16-21-09.png?ex=65e84ac9&is=65d5d5c9&hm=b3aca22a8add5510bce55fa648c5d204e495ceb54cbe2bc9f63b752a6bcb6c9e&)
29
 
30
+ GPT4ALL:
31
+ | Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
32
+ |-------------|------:|------|-----:|--------|-----:|---|-----:|
33
+ |arc_challenge| 1|none | 0|acc |0.3208|± |0.0136|
34
+ | | |none | 0|acc_norm|0.3336|± |0.0138|
35
+ |arc_easy | 1|none | 0|acc |0.6035|± |0.0100|
36
+ | | |none | 0|acc_norm|0.5833|± |0.0101|
37
+ |boolq | 2|none | 0|acc |0.6526|± |0.0083|
38
+ |hellaswag | 1|none | 0|acc |0.4556|± |0.0050|
39
+ | | |none | 0|acc_norm|0.6076|± |0.0049|
40
+ |openbookqa | 1|none | 0|acc |0.2600|± |0.0196|
41
+ | | |none | 0|acc_norm|0.3460|± |0.0213|
42
+ |piqa | 1|none | 0|acc |0.7236|± |0.0104|
43
+ | | |none | 0|acc_norm|0.7307|± |0.0104|
44
+ |winogrande | 1|none | 0|acc |0.6062|± |0.0137|
45
+
46
+
47
  # Disclaimer
48
 
49
  This model may have overfitted to the DPO training data, and may not perform well.