42e commited on
Commit
3e5852e
·
verified ·
1 Parent(s): cd549e6

Upload folder using huggingface_hub

Browse files
Files changed (5) hide show
  1. .gitattributes +1 -0
  2. README.md +16 -56
  3. stats.json +9 -0
  4. train.jsonl +3 -0
  5. val.jsonl +0 -0
.gitattributes CHANGED
@@ -35,3 +35,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  checkpoint-1524/tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
 
 
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  checkpoint-1524/tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
38
+ train.jsonl filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,62 +1,22 @@
1
  ---
2
- base_model: Qwen/Qwen2.5-Math-7B-Instruct
3
- library_name: peft
4
- model_name: verifier_v_7b
5
- tags:
6
- - base_model:adapter:Qwen/Qwen2.5-Math-7B-Instruct
7
- - lora
8
- - sft
9
- - transformers
10
- - trl
11
- licence: license
12
- pipeline_tag: text-generation
13
  ---
14
 
15
- # Model Card for verifier_v_7b
16
 
17
- This model is a fine-tuned version of [Qwen/Qwen2.5-Math-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Math-7B-Instruct).
18
- It has been trained using [TRL](https://github.com/huggingface/trl).
 
 
19
 
20
- ## Quick start
 
 
 
 
 
 
21
 
22
- ```python
23
- from transformers import pipeline
24
-
25
- question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
26
- generator = pipeline("text-generation", model="None", device="cuda")
27
- output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
28
- print(output["generated_text"])
29
- ```
30
-
31
- ## Training procedure
32
-
33
-
34
-
35
-
36
-
37
- This model was trained with SFT.
38
-
39
- ### Framework versions
40
-
41
- - PEFT 0.19.1
42
- - TRL: 1.8.0
43
- - Transformers: 5.13.1
44
- - Pytorch: 2.11.0+cu128
45
- - Datasets: 5.0.0
46
- - Tokenizers: 0.22.2
47
-
48
- ## Citations
49
-
50
-
51
-
52
- Cite TRL as:
53
-
54
- ```bibtex
55
- @software{vonwerra2020trl,
56
- title = {{TRL: Transformers Reinforcement Learning}},
57
- author = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin},
58
- license = {Apache-2.0},
59
- url = {https://github.com/huggingface/trl},
60
- year = {2020}
61
- }
62
- ```
 
1
  ---
2
+ license: mit
3
+ task_categories: [text-generation]
4
+ tags: [math, process-verification, ProcessBench, PRM800K, mathcompose]
 
 
 
 
 
 
 
 
5
  ---
6
 
7
+ # mathcompose — Model V (process verifier) SFT data
8
 
9
+ First-error-localization critiques for training a small generative math verifier.
10
+ Each row: a problem + a step-indexed candidate solution (`prompt`) and a
11
+ paragraph-by-paragraph critique ending in `\boxed{{k}}` (`completion`), where `k`
12
+ is the 0-based index of the first erroneous step (`-1` = all correct).
13
 
14
+ - **Labels** are ground truth from **PRM800K** (OpenAI, MIT).
15
+ - **Genuine-detection recipe:** **claude-opus-4-8** critiques each solution *blind*
16
+ (never shown the answer); a critique is kept only if its predicted index matches
17
+ the PRM800K gold (rejection sampling, ~77% keep-rate). So the critiques contain
18
+ real error-finding reasoning, not rationalization.
19
+ - **Deduped** against ProcessBench + MATH-500 (no eval contamination).
20
+ - Naturally ~50/50 erroneous/all-correct (no rebalancing needed).
21
 
22
+ Built by the mathcompose harness. Eval target: ProcessBench first-error F1.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
stats.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "n_total": 8554,
3
+ "n_train": 8127,
4
+ "n_val": 427,
5
+ "n_erroneous": 4316,
6
+ "n_all_correct": 4238,
7
+ "teacher": "promptlens",
8
+ "deduped": true
9
+ }
train.jsonl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5daa5a76a515a874eab6db9f445083bd2d9b704b4858aef2f7a14c646065a797
3
+ size 20155092
val.jsonl ADDED
The diff for this file is too large to render. See raw diff