metadata
license: mit
library_name: transformers
MyAwesomeModel
MyAwesomeModel is a BERT-style model fine-tuned across many training steps. The best checkpoint (step 1000) achieves a weighted overall score of 0.71 across all 15 evaluation benchmarks.
Evaluation Results
Detailed benchmark scores for the best checkpoint (step_1000):
| # | Benchmark | Score |
|---|---|---|
| 1 | Math Reasoning | 0.550 |
| 2 | Logical Reasoning | 0.819 |
| 3 | Code Generation | 0.650 |
| 4 | Question Answering | 0.607 |
| 5 | Reading Comprehension | 0.700 |
| 6 | Common Sense | 0.736 |
| 7 | Text Classification | 0.828 |
| 8 | Sentiment Analysis | 0.792 |
| 9 | Dialogue Generation | 0.644 |
| 10 | Summarization | 0.767 |
| 11 | Translation | 0.804 |
| 12 | Knowledge Retrieval | 0.676 |
| 13 | Creative Writing | 0.610 |
| 14 | Instruction Following | 0.758 |
| 15 | Safety Evaluation | 0.739 |
Weighted Overall Score: 0.710
Model Details
- Model type: BERT (
BertModel) - Hidden size: 768
- Layers: 12
- Attention heads: 12
- Vocab size: 30522
- Total parameters: 109,482,240
License
MIT