Instructions to use DesaiJayM/Bharat-24B-Math-Code with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use DesaiJayM/Bharat-24B-Math-Code with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-Small-3.2-24B-Instruct-2506") model = PeftModel.from_pretrained(base_model, "DesaiJayM/Bharat-24B-Math-Code") - Notebooks
- Google Colab
- Kaggle
Polish release card typography
Browse files
README.md
CHANGED
|
@@ -31,9 +31,9 @@ These math/code results cover **192 cases from a completed 222-case evaluation r
|
|
| 31 |
<details>
|
| 32 |
<summary>Test method and exact scope</summary>
|
| 33 |
|
| 34 |
-
Evaluation used the saved
|
| 35 |
|
| 36 |
-
The math number above is a format-tolerant secondary analysis. Its checker was chosen after an earlier answer-format artifact and declared before the
|
| 37 |
|
| 38 |
</details>
|
| 39 |
|
|
@@ -51,7 +51,7 @@ The math number above is a format-tolerant secondary analysis. Its checker was c
|
|
| 51 |
| Examples per optimizer update | 8 |
|
| 52 |
| Target modules | Text attention and MLP |
|
| 53 |
|
| 54 |
-
Training used assistant-only labels, complete response reasoning/content, and the original native fine-tuning format.
|
| 55 |
|
| 56 |
## Run Bharat
|
| 57 |
|
|
@@ -66,8 +66,8 @@ Use `--revision RELEASE_COMMIT_SHA` to pin a public release commit. The helper v
|
|
| 66 |
|
| 67 |
## Base and data attribution
|
| 68 |
|
| 69 |
-
Base model: [Mistral Small 3.2 24B Instruct](https://huggingface.co/mistralai/Mistral-Small-3.2-24B-Instruct-2506), by **Mistral AI**, revision `95a6d26c4bfb886c58daf9d3f7332c857cb27b43`. Released under
|
| 70 |
|
| 71 |
-
Question sources: [NuminaMath-TIR](https://huggingface.co/datasets/AI-MO/NuminaMath-TIR), by Project Numina (
|
| 72 |
|
| 73 |
Bharat 24B denotes Leo Labs' fine-tuned derivative and serving identity. The optional identity system policy supplies that name during ordinary serving. This release provides a model artifact and inference code; it does not send user prompts to a hosted inference API.
|
|
|
|
| 31 |
<details>
|
| 32 |
<summary>Test method and exact scope</summary>
|
| 33 |
|
| 34 |
+
Evaluation used the saved step 625 adapter with an NF4 backbone, original native prompt IDs and greedy decoding. Math used published GSM8K numeric answers and MathVerify 0.9.0; code used the original HumanEval tests in an isolated process. The exact normalized training-question overlap check found zero matches for these frozen evaluation prompts.
|
| 35 |
|
| 36 |
+
The math number above is a format-tolerant secondary analysis. Its checker was chosen after an earlier answer-format artifact and declared before the remaining 100 responses were generated. The registered `####` answer-format metric is **111/128 (86.72%)**, retained in evaluation-results.json. Six math responses reached the generation-token limit; none of these math/code cases was cut by the evaluation wall-time limit. Results are from fixed subsets, not full benchmark or leaderboard evaluations.
|
| 37 |
|
| 38 |
</details>
|
| 39 |
|
|
|
|
| 51 |
| Examples per optimizer update | 8 |
|
| 52 |
| Target modules | Text attention and MLP |
|
| 53 |
|
| 54 |
+
Training used assistant-only labels, complete response reasoning/content, and the original native fine-tuning format. All 5,000 examples were consumed exactly once. Vision parameters were frozen. The adapter and native tokenizer are byte-for-byte preserved from the evaluated checkpoint.
|
| 55 |
|
| 56 |
## Run Bharat
|
| 57 |
|
|
|
|
| 66 |
|
| 67 |
## Base and data attribution
|
| 68 |
|
| 69 |
+
Base model: [Mistral Small 3.2 24B Instruct](https://huggingface.co/mistralai/Mistral-Small-3.2-24B-Instruct-2506), by **Mistral AI**, revision `95a6d26c4bfb886c58daf9d3f7332c857cb27b43`. Released under Apache 2.0; see LICENSE and NOTICE.
|
| 70 |
|
| 71 |
+
Question sources: [NuminaMath-TIR](https://huggingface.co/datasets/AI-MO/NuminaMath-TIR), by Project Numina (Apache 2.0), and [OpenCodeInstruct](https://huggingface.co/datasets/nvidia/OpenCodeInstruct), by NVIDIA (CC BY 4.0). Only the selected questions were used; the original dataset answers were replaced with newly generated synthetic response targets. See DATA_ATTRIBUTION.md for source credits and license links.
|
| 72 |
|
| 73 |
Bharat 24B denotes Leo Labs' fine-tuned derivative and serving identity. The optional identity system policy supplies that name during ordinary serving. This release provides a model artifact and inference code; it does not send user prompts to a hosted inference API.
|