Instructions to use petra345/CalibratedAwesomeModel-AuditRepo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use petra345/CalibratedAwesomeModel-AuditRepo with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="petra345/CalibratedAwesomeModel-AuditRepo")# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("petra345/CalibratedAwesomeModel-AuditRepo") model = AutoModel.from_pretrained("petra345/CalibratedAwesomeModel-AuditRepo") - Notebooks
- Google Colab
- Kaggle
| panel,benchmark,selected_score,runner_up_checkpoint,runner_up_score,delta_vs_runner_up,selected_benchmark_rank,best_eligible_checkpoint,best_eligible_score | |
| Core Reasoning Tasks,Math Reasoning,0.583,checkpoints/step_900,0.590,-0.007,3,checkpoints/step_900,0.590 | |
| Core Reasoning Tasks,Logical Reasoning,0.812,checkpoints/step_900,0.819,-0.007,3,checkpoints/step_900,0.819 | |
| Core Reasoning Tasks,Common Sense,0.752,checkpoints/step_900,0.759,-0.007,3,checkpoints/step_900,0.759 | |
| Language Understanding,Reading Comprehension,0.718,checkpoints/step_900,0.725,-0.007,3,checkpoints/step_900,0.725 | |
| Language Understanding,Question Answering,0.635,checkpoints/step_900,0.642,-0.007,3,checkpoints/step_900,0.642 | |
| Language Understanding,Text Classification,0.842,checkpoints/step_900,0.849,-0.007,3,checkpoints/step_900,0.849 | |
| Language Understanding,Sentiment Analysis,0.814,checkpoints/step_900,0.821,-0.007,3,checkpoints/step_900,0.821 | |
| Generation Tasks,Code Generation,0.661,checkpoints/step_900,0.668,-0.007,3,checkpoints/step_900,0.668 | |
| Generation Tasks,Creative Writing,0.632,checkpoints/step_900,0.639,-0.007,3,checkpoints/step_900,0.639 | |
| Generation Tasks,Dialogue Generation,0.659,checkpoints/step_900,0.666,-0.007,3,checkpoints/step_900,0.666 | |
| Generation Tasks,Summarization,0.781,checkpoints/step_900,0.788,-0.007,3,checkpoints/step_900,0.788 | |
| Specialized Capabilities,Translation,0.823,checkpoints/step_900,0.830,-0.007,3,checkpoints/step_900,0.830 | |
| Specialized Capabilities,Knowledge Retrieval,0.689,checkpoints/step_900,0.696,-0.007,3,checkpoints/step_900,0.696 | |
| Specialized Capabilities,Instruction Following,0.776,checkpoints/step_900,0.783,-0.007,3,checkpoints/step_900,0.783 | |
| Specialized Capabilities,Safety Evaluation,0.803,checkpoints/step_900,0.810,-0.007,3,checkpoints/step_900,0.810 | |