ResearchModel-Quartz

release overview

Release scope

This repository records the selected checkpoint from the quartz-release-candidate training run. The package includes its configuration, weights, tokenizer metadata, training state, and release figures.

Evaluation matrix

Evaluation Score
Math Reasoning 0.702
Logical Reasoning 0.850
Common Sense 0.814
Reading Comprehension 0.801
Question Answering 0.690
Text Classification 0.850
Sentiment Analysis 0.834
Code Generation 0.785
Creative Writing 0.766
Dialogue Generation 0.750
Summarization 0.827
Translation 0.838
Knowledge Retrieval 0.754
Instruction Following 0.823
Safety Evaluation 0.809

Scores are reported on a zero-to-one scale and rounded to three decimal places.

Usage

Load the configuration and weights with a compatible Transformers runtime. Review trainer_state.json for the selected training step and tokenizer_config.json for tokenizer settings.

benchmark profile

Release notes

The checkpoint was selected by the workspace evaluation runner using its aggregate eval_accuracy result. No other checkpoint files belong in this repository.

training summary

Downloads last month
87
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support