K12-Reasoner-4B

K12-Reasoner-4B ๆ˜ฏๅŸบไบŽ Qwen3.5-4B ่ฟ›่กŒ DAPO ๅŽ่ฎญ็ปƒ็š„ๅคšๆจกๆ€ๆจกๅž‹๏ผŒไฝฟ็”จๆœฌ้กน็›ฎๆ•ด็†็š„ๆ•ฐๅญฆไธŽ็‰ฉ็†่ฎญ็ปƒ้›†๏ผŒ้ขๅ‘ๅ›พๆ–‡้ข˜็›ฎ็†่งฃใ€ๅญฆ็ง‘ๆŽจ็†ไธŽ็ญ”ๆกˆ็”Ÿๆˆใ€‚

้กน็›ฎไธป้กต ยท ่ฎญ็ปƒๆ•ฐๆฎ ยท ่ฎญ็ปƒไปฃ็ 

ๆจกๅž‹ๆฆ‚ๅ†ต

้กน็›ฎ ้…็ฝฎ
ๅŸบ็ก€ๆจกๅž‹ Qwen3.5-4B
ๅ‚ๆ•ฐ่ง„ๆจก 4B ็บง
่พ“ๅ…ฅ / ่พ“ๅ‡บ ๆ–‡ๆœฌไธŽๅ›พ็‰‡ / ๆ–‡ๆœฌ
ๅŽ่ฎญ็ปƒ DAPO๏ผŒๅŸบไบŽ TRL
่ฎญ็ปƒๆ•ฐๆฎ ๆ•ฐๅญฆไธŽ็‰ฉ็†่ฎญ็ปƒ้›†๏ผŒ1,160 ้ข˜
ๆƒ้‡ๆ ผๅผ BF16๏ผŒSafetensors

ๅฟซ้€Ÿไฝฟ็”จ

ๅฎ‰่ฃ…ๆ”ฏๆŒๆœฌๆจกๅž‹็š„ Transformers ไธŽ PyTorch ็Žฏๅขƒ๏ผŒไธ‹่ฝฝๆจกๅž‹ๅŽไฝฟ็”จ้š้™„็š„infer.py๏ผš

pip install "torch==2.10.0" "transformers==5.15.0" "accelerate==1.13.0" "Pillow==12.2.0"
hf download zhenliuu/K12-Reasoner-4B --local-dir K12-Reasoner-4B
python K12-Reasoner-4B/infer.py --model ./K12-Reasoner-4B \
  --subject ๆ•ฐๅญฆ --question "ๆฑ‚ๆ–น็จ‹ 2x + 3 = 11 ็š„่งฃใ€‚"

ๅ›พ็‰‡้ข˜้€š่ฟ‡--imageไผ ๅ…ฅๆœฌๅœฐๅ›พ็‰‡๏ผŒ้ข˜ๅนฒไธŽ้€‰้กน้€š่ฟ‡--questionไผ ๅ…ฅ๏ผ›้‡ๅค--imageๅฏๆไพ›ๅคšๅผ ๅ›พ็‰‡๏ผš

python K12-Reasoner-4B/infer.py --model ./K12-Reasoner-4B \
  --subject ็‰ฉ็† --image question.png --question "ๆ นๆฎๅ›พ็คบ๏ผŒๅˆคๆ–ญ็‰ฉไฝ“ๆ‰€ๅ—ๅˆๅŠ›็š„ๆ–นๅ‘ใ€‚"

้ป˜่ฎคไฝฟ็”จๅ•ๅผ CUDA GPUใ€BF16ไธŽ่ดชๅฟƒ่งฃ็ ๏ผŒๅ…ณ้—ญthinking๏ผŒๆœ€ๅคง่พ“ๅ‡บ8,192 tokensใ€‚่„šๆœฌๆ”ฏๆŒ--device cpuไปฅๅŠๆœฌๅœฐๆจกๅž‹่ทฏๅพ„ใ€‚PyTorch็š„CUDAๆž„ๅปบ้œ€ไธŽ่ฟ่กŒ็ŽฏๅขƒๅŒน้…ใ€‚ๆจกๅž‹ไฝฟ็”จๅŸบ็ก€ๆžถๆž„็š„processorไธŽchat template๏ผŒ่พ“ๅ‡บๅŒ…ๅซ็ฎ€ๆด่งฃ้ข˜่ฟ‡็จ‹ๅ’Œๆœซ่กŒโ€œๆœ€็ปˆ็ญ”ๆกˆ๏ผšโ€ใ€‚

่ฏ„ๆต‹็ป“ๆžœ

ๆˆ‘ไปฌๅœจไปฅไธ‹ๅคšๆจกๆ€ๆ•ฐๅญฆไธŽ็‰ฉ็†ๅŸบๅ‡†ไธŠ๏ผŒๅฐ† K12-Reasoner-4B ไธŽๅŸบ็ก€ๆจกๅž‹ Qwen3.5-4B ่ฟ›่กŒๅฏนๆฏ”ใ€‚ๆŒ‡ๆ ‡ไธบๅ‡†็กฎ็އ๏ผŒๆๅ‡ไปฅ็™พๅˆ†็‚น๏ผˆpp๏ผ‰่กจ็คบใ€‚

ๅŸบๅ‡† ๅฏ่ฎกๅˆ†้ข˜ๆ•ฐ / ๆต‹่ฏ•้ข˜ๆ•ฐ Qwen3.5-4B K12-Reasoner-4B ๆๅ‡๏ผˆpp๏ผ‰
OlympiadBench 4,055 / 4,869 31.89% 40.12% +8.24
MMSciBench 710 / 1,167 63.24% 69.58% +6.34
LiveK12Bench 1,168 / 1,168 48.72% 54.71% +5.99
MM-MATH 5,881 / 5,901 67.40% 71.96% +4.56
PhyX 6,000 / 6,000 43.30% 47.78% +4.48
PhysUniBench 1,247 / 3,304 38.89% 41.94% +3.05

่ฏ„ๆต‹่ฎพ็ฝฎ๏ผš ไธคๆจกๅž‹ไฝฟ็”จ็›ธๅŒ่พ“ๅ…ฅๆจกๆฟใ€่งฃ็ ่ฎพ็ฝฎๅ’Œ่‡ชๅŠจๅˆคๅˆ†็จ‹ๅบ๏ผ›ๅ…ณ้—ญ thinking๏ผŒ้‡‡็”จ่ดชๅฟƒ่งฃ็ ๏ผŒๆœ€ๅคง่พ“ๅ‡บ้•ฟๅบฆไธบ 8,192 tokensใ€‚ๅ‡†็กฎ็އๆŒ‰ๅฏ่ฎกๅˆ†้ข˜็›ฎ่ฎก็ฎ—๏ผšMMSciBenchใ€PhysUniBench ไฝฟ็”จ้€‰ๆ‹ฉ้ข˜๏ผŒOlympiadBench ไฝฟ็”จ้ž่ฏๆ˜Ž้ข˜ใ€‚็ป“ๆžœๅŸบไบŽ้กน็›ฎ็ปŸไธ€่ฏ„ๆต‹ๅ่ฎฎใ€‚

ๅฎŒๆ•ดๆ็คบ่ฏๅ’Œ่ฎกๅˆ†ๅฃๅพ„่ง ่ฏ„ๆต‹่ฏดๆ˜Ž๏ผŒ่ฎญ็ปƒ้…็ฝฎ่ง้กน็›ฎ่ฎญ็ปƒๆ–‡ๆกฃใ€‚

ไฝฟ็”จ่Œƒๅ›ด

ๆจกๅž‹้ขๅ‘ๆ•™่‚ฒๅ›พๆ–‡ๆŽจ็†็ ”็ฉถไธŽๅบ”็”จๅผ€ๅ‘ใ€‚ๆถ‰ๅŠ้‡่ฆๆ•™ๅญฆ็ป“่ฎบๆ—ถ๏ผŒๅบ”็ป“ๅˆๅ‚่€ƒ็ญ”ๆกˆไธŽไธ“ไธš็Ÿฅ่ฏ†ๅคๆ ธๆจกๅž‹่พ“ๅ‡บใ€‚

Downloads last month
10
Safetensors
Model size
5B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for zhenliuu/K12-Reasoner-4B

Finetuned
Qwen/Qwen3.5-4B
Finetuned
(1214)
this model

Dataset used to train zhenliuu/K12-Reasoner-4B