ResearchModel-Mosaic

release overview

Release scope

This repository records the selected checkpoint from the mosaic-release-candidate training run. The package includes its configuration, weights, tokenizer metadata, training state, and release figures.

Evaluation matrix

Evaluation Score
Math Reasoning 0.691
Logical Reasoning 0.850
Common Sense 0.810
Reading Comprehension 0.795
Question Answering 0.683
Text Classification 0.850
Sentiment Analysis 0.832
Code Generation 0.777
Creative Writing 0.756
Dialogue Generation 0.742
Summarization 0.824
Translation 0.836
Knowledge Retrieval 0.748
Instruction Following 0.819
Safety Evaluation 0.804

Scores are reported on a zero-to-one scale and rounded to three decimal places.

Usage

Load the configuration and weights with a compatible Transformers runtime. Review trainer_state.json for the selected training step and tokenizer_config.json for tokenizer settings.

benchmark profile

Release notes

The checkpoint was selected by the workspace evaluation runner using its aggregate eval_accuracy result. No other checkpoint files belong in this repository.

training summary

Downloads last month
108
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support