Upload DocVQA model and trajectories

README.md

@@ -17,9 +17,12 @@ and the latest evaluation outputs.
 ## Contents
 
 - `models/qwen35-4b-math-grpo-dapo400-e15-seed1-step20/`: Hugging Face model export with 4 safetensors shards, tokenizer files, and generation/config metadata.
+- `models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/`: DocVQA Hugging Face model export with 4 safetensors shards, tokenizer files, and generation/config metadata.
 - `trajectories/qwen35-4b-math-grpo-dapo400-e15-seed1/raw/`: raw train and validation trajectory JSONL files.
 - `trajectories/qwen35-4b-math-grpo-dapo400-e15-seed1/exports/attempt2_step001_020/`: exported train/validation trajectory JSONL files for steps 1-20.
+- `trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/`: DocVQA trace2skill trajectory collection outputs, including RL rollouts and sample-only trajectories.
 - `eval/qwen35-4b-math-grpo-dapo400-e15-seed1/step20_eval_50x4096_rerun_20260805/`: evaluation summary and per-sample outputs.
+- `eval/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/`: DocVQA post-eval outputs, trace2skill sample-only eval outputs, and RL curve CSV.
 
 ## Evaluation
 
@@ -30,6 +33,10 @@ top-k 40, presence penalty 2.0, and `paper_react_cli` mode.
 | --- | ---: | ---: | ---: |
 | DAPO100 | 400 | 0.6875 | 0.8300 |
 | AIME2026 | 120 | 0.5833 | 0.7667 |
+| DocVQA post-eval | 400 | 0.4522 | 0.5147 |
+
+DocVQA trace2skill sample-only evaluation used 8 samples per item on 50 evolve
+items and reached mean score 0.4338 with max@8 0.7585.
 
 The full optimizer state, Megatron/FSDP training checkpoint files, tool
 workspaces, server logs, and cache directories are not included in this repo.

eval/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/docvqa_rl_curve.csv

@@ -0,0 +1,161 @@
+step,trajectories_seen,progress,reward_mean,reward_ma10,reward_cumulative_mean,reward_min,reward_max,score_mean,entropy,kl_loss,pg_loss,grad_norm,learning_rate,response_length_mean,response_length_max,aborted_ratio,turns_mean,step_time_s,generation_time_s,actor_update_time_s,total_tokens,throughput
+1,48,0.008333333333333333,0.24494950473308563,0.24494950473308563,0.24494950473308563,0.0,1.0,0.24494950473308563,0.49017247557640076,0.0,-0.013617564458400011,2.3789048194885254,1e-06,6649.64599609375,27188.0,0.0,43.666666666666664,754.2376516980003,286.92356900899904,396.6889400359996,330679.0,73.07135429077492
+2,96,0.016666666666666666,0.4166666567325592,0.3308080807328224,0.3308080807328224,0.0,1.0,0.4166666567325592,0.53962242603302,0.00020394015382407815,-0.06412524590268731,2.708346366882324,1e-06,6612.70849609375,26477.0,0.0,38.270833333333336,887.8937803489989,312.02144067100016,500.0137724039996,329138.0,61.78254037523643
+3,144,0.025,0.4430999457836151,0.36823870241642,0.36823870241642,0.0,1.0,0.4430999457836151,0.5301787853240967,0.0006898151577843237,0.014317558147013187,2.247436046600342,1e-06,6343.79150390625,23715.0,0.0,36.520833333333336,748.3013172760002,221.3246845880003,455.606362429,316062.0,70.39543935557559
+4,192,0.03333333333333333,0.3958333432674408,0.3751373626291752,0.3751373626291752,0.0,1.0,0.3958333432674408,0.5222951769828796,0.0008839508755045244,-0.008917778730392456,2.588818311691284,1e-06,8104.1875,22894.0,0.0,43.4375,1037.2784840050008,371.49146225000004,577.1173119900013,400601.0,64.36731732402487
+5,240,0.041666666666666664,0.46691176295280457,0.39349224269390104,0.39349224269390104,0.0,1.0,0.46691176295280457,0.5514000654220581,0.0007286454274435528,0.01617727056145668,1.9867116212844849,1e-06,7465.375,23414.0,0.0,40.625,892.4047758449997,288.79589617500096,525.6114797430018,369874.0,69.07814518170373
+6,288,0.05,0.42068561911582947,0.3980244720975558,0.3980244720975558,0.0,1.0,0.42068561911582947,0.5347718000411987,0.001670440920861438,-0.004540343186818063,1.9661049842834473,1e-06,6067.125,31062.0,0.0,39.291666666666664,896.5522984680028,275.4947808789984,545.3359940130031,302670.0,56.26554087943185
+7,336,0.058333333333333334,0.31734007596969604,0.38649812979357584,0.38649812979357584,0.0,1.0,0.31734007596969604,0.5204557776451111,0.0029620649802382104,-0.042189293541014194,1.3815906047821045,1e-06,6106.22900390625,28912.0,0.0,40.791666666666664,806.3407864979999,272.70499370299876,463.67803958999866,304587.0,62.956631798912376
+8,384,0.06666666666666667,0.561180591583252,0.40833343751728535,0.40833343751728535,0.0,1.0,0.561180591583252,0.49783235788345337,0.0025904066205839626,0.004208974540233612,2.0666494369506836,1e-06,4873.0625,16831.0,0.0,36.083333333333336,512.8775933540019,206.62977614400006,255.81708992899803,245539.0,79.7912936672599
+9,432,0.075,0.435762882232666,0.4113811535967721,0.4113811535967721,0.0,1.0,0.435762882232666,0.5371173620223999,0.002369466528762132,-0.052080308087170124,1.6648420095443726,1e-06,6042.39599609375,28384.0,0.0,39.020833333333336,908.113617873998,276.1268410119992,552.1156952240017,301651.0,55.36219882305786
+10,480,0.08333333333333333,0.4375,0.4139930382370949,0.4139930382370949,0.0,1.0,0.4375,0.46501633524894714,0.00487504388729576,0.013658582232892513,1.3846955299377441,1e-06,7222.10400390625,31922.0,0.0,41.458333333333336,901.825292116002,248.15214976500283,573.617227769002,358173.0,66.19408495400832
+11,528,0.09166666666666666,0.49442338943481445,0.43894042670726774,0.42130488834597846,0.0,1.0,0.49442338943481445,0.5128280520439148,0.003847302607027814,0.05070710787549615,2.24259090423584,1e-06,4506.08349609375,16304.0,0.0,26.5625,502.32563800799835,155.02645660199778,291.81620837599985,227788.0,75.57780012427351
+12,576,0.1,0.5233585834503174,0.4496096193790436,0.4298093629380067,0.0,1.0,0.5233585834503174,0.4644262194633484,0.004824153089430183,-0.0142042962834239,1.229419231414795,1e-06,7128.16650390625,32768.0,0.0,42.3125,838.6439645819992,259.834945472001,504.7239689570015,353680.0,70.28807116741982
+13,624,0.10833333333333334,0.7615740895271301,0.4814570337533951,0.45532972652178544,0.0,1.0,0.7615740895271301,0.44616079330444336,0.005131423647981137,0.0191820808686316,1.8194243907928467,1e-06,5323.89599609375,23262.0,0.0,35.229166666666664,618.2217993199993,271.60175837800125,296.9356947519991,267179.0,72.02889542606397
+14,672,0.11666666666666667,0.6746070981025696,0.509334409236908,0.47099239592041287,0.0,1.0,0.6746070981025696,0.3503928780555725,0.008356725855264813,-0.04835740756243467,2.384852647781372,1e-06,5438.66650390625,32768.0,0.0,32.229166666666664,1018.6339635250006,299.4694664790004,635.6902455580021,272480.0,44.58258310588791
+15,720,0.125,0.8238635659217834,0.5450295895338059,0.49451714058717094,0.0,1.0,0.8238635659217834,0.287509948015213,0.008130816131597385,0.04885930381715298,2.0127763748168945,1e-06,2043.125,19594.0,0.0,16.479166666666668,363.25036360800004,153.82550152600015,174.6456919839984,109622.0,50.2968067309347
+16,768,0.13333333333333333,0.5331258177757263,0.5562736093997955,0.49693018291145563,0.0,1.0,0.5331258177757263,0.36057335138320923,0.009627742081647739,-0.03802471607923508,2.3077034950256348,1e-06,5581.27099609375,32768.0,0.0,29.395833333333332,684.7886437790003,335.88930539899957,302.4899268049994,279501.0,68.02609888932935
+17,816,0.14166666666666666,0.45406290888786316,0.5699458926916122,0.49440857855712667,0.0,1.0,0.45406290888786316,0.41700857877731323,0.007322938879951835,0.021356412209570408,1.7274655103683472,1e-06,8593.0625,29683.0,0.0,38.666666666666664,1021.5168082870005,383.5809795489986,560.9577021770019,424067.0,69.18910463338752
+18,864,0.15,0.5160000920295715,0.5654278427362442,0.4956081070833736,0.0,1.0,0.5160000920295715,0.2694139778614044,0.011500056891236454,0.08560188952833414,2.6421256065368652,1e-06,6457.8125,28348.0,0.0,32.916666666666664,868.5866515519992,359.35431537600016,442.3238597700001,321551.0,61.70004252031149
+19,912,0.15833333333333333,0.5347222089767456,0.5753237754106522,0.49766674402513,0.0,1.0,0.5347222089767456,0.31363171339035034,0.00865150720346719,-0.005524219945073128,1.8557919263839722,1e-06,6871.83349609375,25757.0,0.0,36.854166666666664,990.0760148180016,366.8975844310007,550.3543154060026,341432.0,57.47572154224322
+20,960,0.16666666666666666,0.9268519282341003,0.6242589682340622,0.5191260032355786,0.0,1.0,0.9268519282341003,0.3626325726509094,0.013959126663394272,0.0,2.358567714691162,1e-06,990.625,7524.0,0.0,9.708333333333334,108.78174319999744,34.56938732300114,56.97326196799986,58942.0,90.30620743598176
+21,1008,0.175,0.6875,0.6435666292905807,0.5271438126053128,0.0,1.0,0.6875,0.20174433290958405,0.011239468469284475,0.011048511601984501,1.5039501190185547,1e-06,5518.79150390625,26740.0,0.0,30.041666666666668,758.6137021979994,256.47165760900316,439.756876757001,276598.0,60.768302145213006
+22,1056,0.18333333333333332,0.8134469985961914,0.6725754708051681,0.5401575937867165,0.0,1.0,0.8134469985961914,0.24181495606899261,0.011842883075587451,-0.006672027462627739,1.3440638780593872,1e-06,4623.97900390625,29078.0,0.0,23.5625,867.5419126499983,255.8359847879983,543.8345763559992,233431.0,44.84528770238516
+23,1104,0.19166666666666668,0.7059054374694824,0.6670086055994033,0.5473640217729236,0.0,1.0,0.7059054374694824,0.16737425327301025,0.010541642783209682,-0.009885277599096298,0.9199361801147461,1e-06,7022.5625,29042.0,0.0,35.770833333333336,910.070670027002,314.6648456920011,526.5394361880026,348643.0,63.84907082539272
+24,1152,0.2,0.7304293513298035,0.6725908309221268,0.5549917438377937,0.0,1.0,0.7304293513298035,0.17737673223018646,0.015051751805003732,0.012302946764975786,2.0713131427764893,1e-06,4860.29150390625,29819.0,0.0,26.583333333333332,858.8186041709996,321.78931348800324,472.5924150840001,244886.0,47.52381135563614
+25,1200,0.20833333333333334,0.9477671980857849,0.6849811941385269,0.5707027620077133,0.0,1.0,0.9477671980857849,0.1601172238588333,0.016747765825130045,0.02756814146414399,5.166260719299316,1e-06,2382.25,26767.0,0.0,15.645833333333334,447.3700342129996,225.28363837699726,188.5740655840018,125828.0,46.87692900626546
+26,1248,0.21666666666666667,0.6539140939712524,0.6970600217580796,0.5739031978524648,0.0,1.0,0.6539140939712524,0.13214966654777527,0.018498602730687708,0.03660793183371425,3.625883102416992,1e-06,2657.083251953125,24031.0,0.0,18.416666666666668,571.5306388019962,240.64537857499818,284.10141252299945,139020.0,40.54025878396892
+27,1296,0.225,0.5208333134651184,0.703737062215805,0.5719376465788594,0.0,1.0,0.5208333134651184,0.1491883099079132,0.015337509335950017,0.011048511601984501,1.7381882667541504,1e-06,11509.6044921875,30715.0,0.0,49.291666666666664,1572.8656356760039,541.0547580950006,924.0907865330009,564197.0,59.7844031940585
+28,1344,0.23333333333333334,0.6324405074119568,0.7153811037540436,0.5740984630371843,0.0,1.0,0.6324405074119568,0.15035177767276764,0.014541023643687367,-0.01687687076628208,3.3190524578094482,1e-06,8019.5,28922.0,0.0,38.479166666666664,1438.3394236890017,505.750507069999,829.9091744890029,396504.0,45.94464902485264
+29,1392,0.24166666666666667,0.6392480731010437,0.7258336901664734,0.5763450013152485,0.0,1.0,0.6392480731010437,0.22072502970695496,0.019139314186759293,0.029538803268224,5.653146266937256,1e-06,8833.4794921875,32768.0,0.0,37.895833333333336,1258.2509080439995,416.0416993340041,754.2399408450001,435583.0,57.6968919335189
+30,1440,0.25,0.7708333134651184,0.7102318286895752,0.5828279450535774,0.0,1.0,0.7708333134651184,0.2844598591327667,0.022744216490536928,0.011352635454386473,2.9081854820251465,1e-06,4633.0,26051.0,0.0,24.625,541.8960377459953,207.23088617500616,286.4274673129985,233816.0,71.91293277475404
+31,1488,0.25833333333333336,0.5803571343421936,0.6995175421237946,0.5827482414822425,0.0,1.0,0.5803571343421936,0.16954657435417175,0.014563609147444367,-0.01657270872965455,3.3121237754821777,1e-06,10101.75,30725.0,0.0,46.541666666666664,1170.606094638002,356.0549435089997,724.4859286290011,496396.0,70.67506913352514
+32,1536,0.26666666666666666,0.7184343338012695,0.6900162756443023,0.5869884318672121,0.0,1.0,0.7184343338012695,0.1965799629688263,0.017522162990644574,0.03483247384428978,4.052924633026123,1e-06,4587.85400390625,27658.0,0.0,27.583333333333332,618.8674420990064,219.6852076159994,343.9968065810026,231881.0,62.447675712678084
+33,1584,0.275,0.6651485562324524,0.6859405875205994,0.5893569204843405,0.0,1.0,0.6651485562324524,0.24844537675380707,0.022034705383703113,-0.006316041108220816,5.228036403656006,1e-06,7983.70849609375,32757.0,0.0,35.9375,1155.644906075002,387.1668446440017,683.6642624950036,394586.0,56.907042109235235
+34,1632,0.2833333333333333,0.7083333134651184,0.6837309837341309,0.5928562261602458,0.0,1.0,0.7083333134651184,0.16498596966266632,0.01885832322295755,0.0,1.764824628829956,1e-06,6848.10400390625,32768.0,0.0,36.604166666666664,863.579537192003,358.54499229700014,447.0092885979975,340485.0,65.71195536258185
+35,1680,0.2916666666666667,0.7613635659217834,0.6650906205177307,0.597670721582004,0.0,1.0,0.7613635659217834,0.2774999439716339,0.020798348588868976,0.02438779314979911,6.139462471008301,1e-06,3513.625,19993.0,0.0,22.458333333333332,520.3511246529961,186.0182340579995,284.4043857190045,180374.0,57.77316874904585
+36,1728,0.3,0.6666666865348816,0.6663658797740937,0.5995872761640284,0.0,1.0,0.6666666865348816,0.15924227237701416,0.028027600375935435,0.0,0.018196094781160355,1e-06,4799.0,20226.0,0.0,30.9375,636.0632836500008,228.39326953399723,351.88928101200145,241872.0,63.37734158883162
+37,1776,0.30833333333333335,0.8263888359069824,0.69692143201828,0.6057170480489731,0.0,1.0,0.8263888359069824,0.23834224045276642,0.024715313338674605,0.005524241365492344,5.17094612121582,1e-06,1916.2708740234375,25070.0,0.0,14.895833333333334,420.47952308000094,168.88511829000345,216.1537580419972,103421.0,40.993276455114874
+38,1824,0.31666666666666665,0.8145833015441895,0.7151357114315033,0.6112135284041104,0.0,1.0,0.8145833015441895,0.3245449960231781,0.026075506350025535,0.007766519673168659,3.8837058544158936,1e-06,2244.645751953125,16325.0,0.0,16.354166666666668,380.08643366899923,150.69495683599962,189.81039795799734,119215.0,52.27539029706559
+39,1872,0.325,0.8007155060768127,0.7312824547290802,0.6160725534726412,0.0,1.0,0.8007155060768127,0.2353791892528534,0.025163010461255908,0.04506958043202758,7.756253719329834,1e-06,4555.83349609375,22220.0,0.0,29.104166666666668,492.2421491839996,215.51471189499716,232.8714967499982,230176.0,77.93454244066926
+40,1920,0.3333333333333333,0.4166666567325592,0.6958657890558243,0.6110874060541391,0.0,1.0,0.4166666567325592,0.22035150229930878,0.023033442441374063,-0.016876891255378723,5.131223678588867,1e-06,9363.8330078125,26984.0,0.0,51.6875,959.5828502519944,357.2277443290004,524.3754207840029,461160.0,80.09730476093432
+41,1952,0.3388888888888889,0.4791666865348816,0.6857467442750931,0.6078698275292792,0.0,1.0,0.4791666865348816,0.6079760193824768,0.0124259986623656,-0.02497995225712657,4.108351707458496,1e-06,4798.34375,19569.0,0.0,45.53125,500.68072739499985,228.25757469100063,220.21326073299952,161267.0,80.52387039094693
+42,1984,0.34444444444444444,0.75,0.6889033108949661,0.6112538792547726,0.0,1.0,0.75,0.48654595017433167,0.012258987757377326,0.04955898504704237,1.915374755859375,1e-06,6601.9375,20605.0,0.0,39.0625,522.182998581,157.2593536759996,309.8565300279997,219062.0,104.87798367396461
+43,2016,0.35,0.7395833730697632,0.6963467925786972,0.6142382860876793,0.0,1.0,0.7395833730697632,0.4516216516494751,0.019661200960399583,-0.011048455722630024,3.2884035110473633,1e-06,4679.46875,20941.0,0.0,24.90625,493.93453786100054,222.69543856099972,227.61176401800003,157447.0,79.69021597569858
+44,2048,0.35555555555555557,0.532589316368103,0.6787723928689957,0.6123826276849617,0.0,1.0,0.532589316368103,0.4871399402618408,0.03214627830311656,0.01897608069702983,5.900459289550781,1e-06,2871.4375,11679.0,0.0,18.875,211.70204012199974,60.29089925700009,122.44026523100001,99598.0,117.6157772766427
+45,2080,0.3611111111111111,0.8671875,0.6893547862768173,0.6180449581808514,0.0,1.0,0.8671875,0.4030989408493042,0.023097925877664238,0.03806754341349006,3.134502649307251,1e-06,2024.9375,11896.0,0.0,20.875,175.92188500700013,67.08121777799988,85.76313947700055,72470.0,102.98604974178787
+46,2112,0.36666666666666664,0.75,0.6976881176233292,0.6209135460464851,0.0,1.0,0.75,0.3473146855831146,0.02082379092462361,0.0,0.010874814353883266,1e-06,4161.9375,17424.0,0.0,35.5,303.17379910599993,116.58492905999992,154.02871473899995,140958.0,116.23530827503687
+47,2144,0.37222222222222223,0.9796481132507324,0.7130140453577042,0.6285461964125328,0.6428571343421936,1.0,0.9796481132507324,0.15918844938278198,0.02920371713116765,-0.027621103450655937,2.750657558441162,1e-06,1004.59375,6042.0,0.0,11.1875,76.77780446499946,20.457018443999914,42.33392787400044,39755.0,129.44821839143313
+48,2176,0.37777777777777777,0.4625000059604645,0.6778057157993317,0.6250869007781148,0.0,1.0,0.4625000059604645,0.38593292236328125,0.027985093358438462,0.01310234609991312,3.5436692237854004,1e-06,1528.8125,9907.0,0.0,9.5625,123.51402980900002,40.336788061000334,64.58103783200022,56682.0,114.72785740950253
+49,2208,0.38333333333333336,0.3494318127632141,0.6326773464679718,0.6194612867369944,0.0,1.0,0.3494318127632141,0.30612078309059143,0.02750417636707425,0.01708238199353218,2.0377209186553955,1e-06,1438.71875,6687.0,0.0,13.625,122.77529949000018,48.840375486000084,56.437729235000006,53655.0,109.25446776118453
+50,2240,0.3888888888888889,0.4545454680919647,0.6364652276039123,0.6161629703640937,0.0,1.0,0.4545454680919647,0.3265306055545807,0.017727599304635078,0.00350213423371315,0.09375497698783875,1e-06,2408.6875,11636.0,0.0,22.25,207.6616913150001,73.19925057,108.21952279699963,84686.0,101.9518808015733
+51,2272,0.39444444444444443,0.2914930582046509,0.6176978647708893,0.609796893655085,0.0,1.0,0.2914930582046509,0.2638721764087677,0.023991232155822217,-0.021373667288571596,2.597158432006836,1e-06,2988.53125,15141.0,0.0,26.03125,306.3210862979995,97.78708561499934,171.8076884380007,103425.0,84.40897854105337
+52,2304,0.4,0.656622052192688,0.6083600699901581,0.6106973774731159,0.0,1.0,0.656622052192688,0.21308191120624542,0.02046681335195899,0.02163589559495449,1.9961403608322144,1e-06,2090.0625,7046.0,0.0,21.75,138.29624441800024,46.865929184999914,68.79434113599928,74602.0,134.85904898204527
+53,2336,0.40555555555555556,0.7206101417541504,0.6064627468585968,0.6127712032142675,0.0,1.0,0.7206101417541504,0.21439297497272491,0.023879878455772996,-0.044685485772788525,3.0917961597442627,1e-06,1651.59375,3844.0,0.0,21.6875,111.59566769699995,45.77698364600019,49.14778054999988,60635.0,135.83636634675125
+54,2368,0.4111111111111111,0.20738635957241058,0.5739424511790275,0.605264076480159,0.0,1.0,0.20738635957241058,0.2421918362379074,0.026983676245436072,0.02228569984436035,1.3805313110351562,1e-06,1973.25,5773.0,0.0,25.21875,137.22363069399944,52.24738980899929,64.75593772599859,70768.0,128.92823131499932
+55,2400,0.4166666666666667,0.375,0.5247237011790276,0.6010774569077926,0.0,1.0,0.375,0.24250176548957825,0.02605975791811943,0.02116511994972825,2.7289483547210693,1e-06,1916.46875,6960.0,0.0,20.21875,170.38327433000086,66.92997815600029,80.76315201800026,69047.0,101.31129400980512
+56,2432,0.4222222222222222,0.609375,0.5106612011790276,0.6012256273201534,0.0,1.0,0.609375,0.22362691164016724,0.028200863860547543,-0.017737168818712234,1.4961767196655273,1e-06,1873.125,7130.0,0.0,17.9375,108.99705069599986,35.31489361700005,56.165401021000434,67524.0,154.87575023550178
+57,2464,0.42777777777777776,0.5625,0.4689463898539543,0.6005462303496244,0.0,1.0,0.5625,0.2294110655784607,0.026296275667846203,0.010744423605501652,3.2239174842834473,1e-06,2479.40625,5812.0,0.0,20.4375,136.08726857500005,47.91921126000125,67.58387834100176,87141.0,160.08293963218
+58,2496,0.43333333333333335,0.6366639137268066,0.4863627806305885,0.6011689490285413,0.0,1.0,0.6366639137268066,0.23472222685813904,0.023509906488470733,0.011971540283411741,2.942763090133667,1e-06,2104.75,13530.0,0.0,25.28125,207.45568471499973,88.10090956099884,95.0055812999999,74992.0,90.37110757295366
+59,2528,0.4388888888888889,0.6784722208976746,0.5192668214440346,0.6024791739754758,0.0,1.0,0.6784722208976746,0.24205519258975983,0.022162572015076876,-0.0001222332939505577,2.1298019886016846,1e-06,1763.71875,5350.0,0.0,20.0,127.03733248000026,53.87091683399922,55.41743297799985,64199.0,126.33884612247147
+60,2560,0.4444444444444444,0.75,0.5488122746348381,0.6049378544092179,0.0,1.0,0.75,0.22937455773353577,0.026333363144658506,0.005524256266653538,2.2662479877471924,1e-06,2279.96875,15707.0,0.0,21.84375,240.49697560099958,87.78710833900004,124.51586224600032,80623.0,83.80874624153164
+61,2592,0.45,0.5198863744735718,0.5716516062617302,0.6035435678528958,0.0,1.0,0.5198863744735718,0.2570663392543793,0.02572810323908925,0.03739848406985402,3.2670767307281494,1e-06,2411.125,9188.0,0.0,23.1875,184.98220499200033,89.94978689799973,74.15495681600078,84788.0,114.58940064487109
+62,2624,0.45555555555555555,1.0,0.6059894010424614,0.6099380264359135,1.0,1.0,1.0,0.26407483220100403,0.02221373573411256,0.0,0.009148592129349709,1e-06,2605.40625,10819.0,0.0,23.6875,186.0377824320003,55.85497282800134,102.7156877540001,91149.0,122.48721578010151
+63,2656,0.46111111111111114,0.7506312727928162,0.608991514146328,0.6121712525685629,0.0,1.0,0.7506312727928162,0.30214086174964905,0.015507688105572015,0.017696078401058912,2.474806308746338,1e-06,3615.8125,9802.0,0.0,34.625,265.79200378800124,127.70573446299932,109.52654027899916,123282.0,115.95721301150499
+64,2688,0.4666666666666667,0.38699495792388916,0.6269523739814759,0.6086528729647398,0.0,1.0,0.38699495792388916,0.32826098799705505,0.01622269331710413,0.009011960122734308,2.0572190284729004,1e-06,6941.15625,29562.0,0.0,53.4375,774.4696851179997,364.1602624400002,353.7670102579996,229917.0,74.21755958239005
+65,2720,0.4722222222222222,0.20044191181659698,0.6094965651631356,0.6023727043316914,0.0,1.0,0.20044191181659698,0.3137173056602478,0.017542726593092084,-0.008799768052995205,0.6703165173530579,1e-06,6561.78125,31231.0,0.0,42.40625,898.2871406389986,341.2599233429992,488.38581044700004,217625.0,60.56665796339686
+66,2752,0.4777777777777778,0.671875,0.6157465651631355,0.6034257694175749,0.0,1.0,0.671875,0.30602946877479553,0.01881041727028787,0.03675107564777136,1.0079466104507446,1e-06,6167.46875,26193.0,0.0,49.96875,554.101800987999,189.84002553400023,312.1485252509992,205247.0,92.60347089381024
+67,2784,0.48333333333333334,0.5204861164093018,0.6115451768040657,0.6021878641487947,0.0,1.0,0.5204861164093018,0.30439451336860657,0.024776103789918125,0.03345791809260845,2.225799560546875,1e-06,3614.21875,11231.0,0.0,35.1875,284.1391380090008,136.66234284099846,117.73062693999964,123295.0,108.48118360598244
+68,2816,0.4888888888888889,0.78125,0.626003785431385,0.6048211308524889,0.0,1.0,0.78125,0.2975461184978485,0.021118261269293725,-0.054310654290020466,1.1692849397659302,1e-06,4807.90625,26330.0,0.0,41.40625,549.3427377499993,228.42190247500002,274.54546597599983,161597.0,73.54106502885148
+69,2848,0.49444444444444446,0.49340277910232544,0.6074968412518501,0.6032063721314721,0.0,1.0,0.49340277910232544,0.3342686593532562,0.020222524413838983,0.036289522890001535,2.282155752182007,1e-06,5508.0625,32768.0,0.0,41.53125,655.6292910640004,199.13287651300016,397.3042805619989,183890.0,70.11965546169033
+70,2880,0.5,0.9375,0.6262468412518502,0.6079819953867367,0.0,1.0,0.9375,0.33250823616981506,0.021104599814862013,0.03314553573727608,1.3447624444961548,1e-06,2660.25,9611.0,0.0,26.09375,196.19024354700014,80.78491095499885,90.74491242699878,92728.0,118.16081972723799
+71,2912,0.5055555555555555,0.4895833432674408,0.623216538131237,0.6063144087371691,0.0,1.0,0.4895833432674408,0.3388713300228119,0.015785087773110718,0.025597906205803156,1.6122236251831055,1e-06,5284.0,16936.0,0.0,43.6875,497.0040691799986,171.1035348000005,273.71358713100017,176960.0,89.01335571153587
+72,2944,0.5111111111111111,0.7982954978942871,0.6030460879206657,0.6089808127532402,0.0,1.0,0.7982954978942871,0.32488352060317993,0.024355289060622454,0.010189496097154915,1.214378833770752,1e-06,2750.96875,7425.0,0.0,24.6875,180.9891636299999,74.64295782500085,82.8735429419994,95791.0,132.31593273151375
+73,2976,0.5166666666666667,0.7795138955116272,0.6059343501925468,0.6113168823800675,0.0,1.0,0.7795138955116272,0.3458699882030487,0.021062713873106986,0.0377824492752552,1.4976528882980347,1e-06,4584.625,32493.0,0.0,32.78125,624.2233154660007,230.18790974200056,342.9278537250011,154252.0,61.77757069392964
+74,3008,0.5222222222222223,0.7299107313156128,0.6402259275317193,0.6129195019602776,0.0,1.0,0.7299107313156128,0.2866557836532593,0.024896137067116797,-0.04610845819115639,2.142530679702759,1e-06,2369.5,11963.0,0.0,22.625,239.92625965800107,120.3313141260005,94.88947129299959,83624.0,87.13510571873255
+75,3040,0.5277777777777778,0.5,0.6701817363500595,0.6114139086008072,0.0,1.0,0.5,0.3236987590789795,0.018475174554623663,0.0,0.009476874023675919,1e-06,4882.5,17593.0,0.0,43.0,450.789146015999,181.42500094000025,225.85956069500025,163848.0,90.86731648713258
+76,3072,0.5333333333333333,0.7964015007019043,0.68263438642025,0.6138479558652953,0.0,1.0,0.7964015007019043,0.30700045824050903,0.026496743666939437,-0.0020472584292292595,2.066908121109009,1e-06,2460.78125,11587.0,0.0,22.6875,188.59083789299984,71.33852350000052,92.56691021200095,86489.0,114.65164607979389
+77,3104,0.5388888888888889,0.90625,0.7212107747793197,0.6176453850099018,0.0,1.0,0.90625,0.22000552713871002,0.024057686678133905,0.005524252075701952,1.4433742761611938,1e-06,2696.59375,11027.0,0.0,27.8125,263.45123239500026,115.46325605400125,118.49511884899948,93955.0,89.15786723207512
+78,3136,0.5444444444444444,0.9232954978942871,0.7354153245687485,0.6215639762007273,0.5,1.0,0.9232954978942871,0.29227256774902344,0.02472158696036786,0.01775239035487175,0.9062841534614563,1e-06,2265.53125,9079.0,0.0,20.4375,170.3398576010004,65.4403932690002,82.21161365699845,80097.0,117.55469496108348
+79,3168,0.55,0.873106062412262,0.7733856528997421,0.6247480532413796,0.0,1.0,0.873106062412262,0.28547191619873047,0.02085073769558221,-0.008840478025376797,0.5867876410484314,1e-06,3021.21875,12153.0,0.0,27.46875,256.31724760900033,101.20673995200195,125.00558564400126,104375.0,101.80255228007428
+80,3200,0.5555555555555556,0.5,0.7296356528997421,0.6231887025758625,0.0,1.0,0.5,0.31137895584106445,0.015421238378621638,0.0,0.006322839297354221,1e-06,10333.9375,32768.0,0.0,58.375,1037.3102922090002,401.4348496390012,566.2384844500011,338606.0,81.6067290913799
+81,3232,0.5611111111111111,0.3809043765068054,0.7187677562236786,0.6201975380564914,0.0,1.0,0.3809043765068054,0.45008739829063416,0.014293167274445295,-0.015891558025032282,1.2760679721832275,1e-06,8321.03125,32754.0,0.0,42.96875,972.129837307999,321.93339216000095,577.3808493620018,273857.0,70.42706372390516
+82,3264,0.5666666666666667,0.78125,0.7170632064342499,0.6221615924704366,0.0,1.0,0.78125,0.2699650228023529,0.022365427459590137,0.011048511601984501,0.9240556359291077,1e-06,7460.4375,32768.0,0.0,34.5625,1225.999626072,253.23885782899742,876.8390886199995,246534.0,50.27203817138882
+83,3296,0.5722222222222222,0.5005388259887695,0.6891656994819642,0.6206962579345129,0.0,1.0,0.5005388259887695,0.4375145137310028,0.02242451987694949,2.3283064365386963e-09,1.4031392335891724,1e-06,6926.25,32763.0,0.0,37.75,929.8208863190011,310.8759290880007,549.2952295120012,229264.0,61.64197948585996
+84,3328,0.5777777777777777,0.71875,0.6880496263504028,0.6218635643876734,0.0,1.0,0.71875,0.4074714481830597,0.02375075384043157,-0.01657276740297675,1.3902783393859863,1e-06,4030.625,21775.0,0.0,28.09375,446.59705381899767,196.42328887400072,211.38054634499713,136700.0,76.52312013202591
+85,3360,0.5833333333333334,0.9007352590560913,0.728123152256012,0.6251444078543607,0.0,1.0,0.9007352590560913,0.29851478338241577,0.025654609431512654,0.03344965819269419,2.593235969543457,1e-06,3228.21875,29486.0,0.0,24.09375,352.76556859599805,92.28120953600228,223.75871768199795,110967.0,78.64075315063137
+86,3392,0.5888888888888889,0.296875,0.6781705021858215,0.6213273217165193,0.0,1.0,0.296875,0.32583197951316833,0.01607248542131856,-0.03053540736436844,1.4725221395492554,1e-06,10699.65625,32768.0,0.0,61.5625,1129.2232754039978,292.77778491700155,743.1870239210002,350117.0,77.51279300250431
+87,3424,0.5944444444444444,0.75,0.6625455021858215,0.6228063180186283,0.0,1.0,0.75,0.2921220064163208,0.02425966609735042,0.0,0.007218159269541502,1e-06,4021.28125,32768.0,0.0,28.15625,488.0769426190018,164.33227444700242,280.2324956250013,136353.0,69.84195937854344
+88,3456,0.6,0.7083333730697632,0.6410492897033692,0.6237782163714821,0.0,1.0,0.7083333730697632,0.30686843395233154,0.02088150568306446,0.00030421139672398567,2.170747756958008,1e-06,4754.46875,32719.0,0.0,31.3125,682.5932579459986,275.7415667940004,356.1328512339969,159919.0,58.57038512261848
+89,3488,0.6055555555555555,0.6473214626312256,0.6184708297252655,0.6240427472283331,0.0,1.0,0.6473214626312256,0.44828489422798157,0.02064222819171846,0.02004069951362908,0.9459578394889832,1e-06,9554.8125,32194.0,0.0,45.46875,935.5018611980013,408.12930426599996,466.2625123270009,313330.0,83.73313111284205
+90,3520,0.6111111111111112,0.5796874761581421,0.6264395773410797,0.6235499108831087,0.0,1.0,0.5796874761581421,0.30548492074012756,0.018542950390838087,-0.052936557214707136,0.885843813419342,1e-06,10442.0,32485.0,0.0,53.09375,1192.7598028979992,398.0113500960033,713.7873268270014,341928.0,71.66740511568878
+91,3552,0.6166666666666667,0.96875,0.6852241396903992,0.6273433184558219,0.0,1.0,0.96875,0.28221622109413147,0.028225781163200736,0.03314553527161479,0.8042802810668945,1e-06,2695.8125,12899.0,0.0,22.75,200.13691262499924,78.54388833399935,96.70006471399756,94050.0,117.48207610285199
+92,3584,0.6222222222222222,0.7821969389915466,0.6853188335895538,0.629026509983384,0.0,1.0,0.7821969389915466,0.30662092566490173,0.0239970067050308,0.05648127058520913,1.7847297191619873,1e-06,3626.6875,31110.0,0.0,30.875,422.4367146000004,108.44290117499986,270.5226296460023,123886.0,73.3163073416251
+93,3616,0.6277777777777778,0.8191287517547607,0.717177826166153,0.6310706201099581,0.0,1.0,0.8191287517547607,0.3448200821876526,0.026177973952144384,0.0009841229766607285,1.3086260557174683,1e-06,5668.03125,32768.0,0.0,33.8125,691.0729560670006,203.15709664400129,428.83552068599965,189057.0,68.3925620081965
+94,3648,0.6333333333333333,0.49609375,0.6949122011661529,0.6296346959598521,0.0,1.0,0.49609375,0.3207833766937256,0.0187069580424577,0.033144880551844835,0.9394970536231995,1e-06,9510.75,32372.0,0.0,54.21875,820.5090756379977,284.3040893790021,467.7487113640018,312072.0,95.0848714736471
+95,3680,0.6388888888888888,0.75,0.6798386752605439,0.6309016991602747,0.0,1.0,0.75,0.35021406412124634,0.024416861589998007,0.0,0.0076813302002847195,1e-06,3103.0,18600.0,0.0,29.1875,295.9084778920005,103.87792913099838,158.66108558699852,106920.0,90.33198437036944
+96,3712,0.6444444444444445,0.75,0.7251511752605438,0.6321423064606885,0.0,1.0,0.75,0.37670886516571045,0.03004657954443246,0.005828344728797674,0.9896931052207947,1e-06,4959.59375,25844.0,0.0,37.8125,536.8094340519965,187.1673825789985,300.87874103799913,166299.0,77.44787509821033
+97,3744,0.65,0.9375,0.7439011752605438,0.6352903239198566,0.0,1.0,0.9375,0.309249609708786,0.028545106411911547,0.016876891255378723,1.050965666770935,1e-06,4130.6875,24950.0,0.0,33.09375,442.5550542719975,199.8940001009978,204.63585897300072,139878.0,79.01728759492937
+98,3776,0.6555555555555556,0.8920454978942871,0.7622723877429962,0.6379102746746979,0.0,1.0,0.8920454978942871,0.2875044345855713,0.028064337209798396,0.017448298167437315,1.2604012489318848,1e-06,4473.375,24172.0,0.0,37.4375,451.286079401998,150.7201161899975,254.23685228199975,150716.0,83.4924933867419
+99,3808,0.6611111111111111,0.5,0.7475402414798736,0.6365172415971756,0.0,1.0,0.5,0.3015187084674835,0.019477788533549756,0.0,0.0058274720795452595,1e-06,8809.78125,23792.0,0.0,58.15625,956.3721172410005,321.900734062001,554.4765863649991,289825.0,75.76156675188955
+100,3840,0.6666666666666666,0.328125,0.7223839938640595,0.6334333191812038,0.0,1.0,0.328125,0.29283061623573303,0.019043981563299894,-0.022096992004662752,1.2845481634140015,1e-06,8538.21875,28239.0,0.0,64.1875,741.6848909920009,251.34558630899846,422.7693491360005,280935.0,94.69486415728736
+101,3872,0.6722222222222223,0.7652190923690796,0.7020309031009674,0.6347381288167273,0.0,1.0,0.7652190923690796,0.3839334547519684,0.026966859120875597,0.003778581856749952,1.7003792524337769,1e-06,4840.53125,13579.0,0.0,46.625,359.5485551269994,160.9928394210001,162.09012577400063,162497.0,112.98682589796735
+102,3904,0.6777777777777778,0.78125,0.7019362092018128,0.6361745197106811,0.0,1.0,0.78125,0.3216039538383484,0.024935174267739058,-0.007785324938595295,1.5267010927200317,1e-06,5793.46875,32170.0,0.0,44.125,714.996083525999,236.52495030999853,419.69981657600147,193127.0,67.52729296347867
+103,3936,0.6833333333333333,0.59375,0.6793983340263366,0.6357626311698006,0.0,1.0,0.59375,0.3164835274219513,0.021014191675931215,-0.01948695583269,1.317975640296936,1e-06,9819.15625,30573.0,0.0,63.34375,881.3670149659993,282.77334066800177,525.2287591910062,322061.0,91.35269261592012
+104,3968,0.6888888888888889,0.6805555820465088,0.6978445172309875,0.6361933326205382,0.0,1.0,0.6805555820465088,0.35206693410873413,0.027350096264854074,0.0497180731035769,2.0149216651916504,1e-06,5984.28125,21223.0,0.0,48.6875,599.2589690660025,212.9561948430055,329.4361041660013,199049.0,83.03964157192144
+105,4000,0.6944444444444444,0.9375,0.7165945172309875,0.6390629199289141,0.0,1.0,0.9375,0.341147243976593,0.028609560220502317,-0.027621279936283827,1.035979151725769,1e-06,4664.0,13604.0,0.0,44.3125,381.0610044330024,164.98205636100465,176.8470066709997,156960.0,102.97563787296194
+106,4032,0.7,0.796875,0.7212820172309875,0.6405517131371318,0.0,1.0,0.796875,0.3411329686641693,0.029363689362071455,2.9802322387695312e-08,1.2344120740890503,1e-06,6345.6875,31144.0,0.0,50.875,641.367488195996,213.16560610500164,370.6174222819973,210894.0,82.20482168233664
+107,4064,0.7055555555555556,0.25,0.6525320172309875,0.6369016971265045,0.0,1.0,0.25,0.3014489412307739,0.01669807080179453,-0.02264273352921009,1.2426620721817017,1e-06,13368.3125,30832.0,0.0,93.53125,1263.797566236004,441.9974189400018,726.8996172719999,435690.0,86.1866670026959
+108,4096,0.7111111111111111,0.42500001192092896,0.6058274686336518,0.634939644485712,0.0,1.0,0.42500001192092896,0.37781161069869995,0.022910808445885777,0.016572722233831882,1.589017391204834,1e-06,9331.75,30459.0,0.0,67.40625,904.4531052029997,288.60630288800166,540.8144981910009,306304.0,84.66552832809714
+109,4128,0.7166666666666667,0.5241013169288635,0.6082376003265381,0.6339227790952823,0.0,1.0,0.5241013169288635,0.3775639533996582,0.026483717607334256,-0.04531704634428024,1.1229933500289917,1e-06,8921.53125,19199.0,0.0,70.5,711.3578001339993,277.94026910499815,366.8258944839981,293113.0,103.01180360459462
+110,4160,0.7222222222222222,0.625,0.637925100326538,0.6338416629216888,0.0,1.0,0.625,0.376244455575943,0.025892165722325444,-0.009298043325543404,1.002420425415039,1e-06,9830.125,23147.0,0.0,76.75,760.5035221310027,278.48831165199954,412.76233719700394,322148.0,105.8995752897077
+111,4192,0.7277777777777777,0.4598214328289032,0.6073853343725204,0.6322739131010331,0.0,1.0,0.4598214328289032,0.40939223766326904,0.026065470650792122,-0.027621198445558548,1.1126024723052979,1e-06,10977.1875,30496.0,0.0,75.46875,949.5950052990011,375.73143520099984,498.17685406700184,359070.0,94.53240539290191
+112,4224,0.7333333333333333,0.8368055820465088,0.6129408925771713,0.6341000887166176,0.0,1.0,0.8368055820465088,0.45703941583633423,0.034048574045300484,-0.005797059275209904,1.3730090856552124,1e-06,7454.3125,25927.0,0.0,63.125,715.7743247350008,261.6233407309992,381.4469219559978,246130.0,85.96634144816665
+113,4256,0.7388888888888889,0.8501838445663452,0.6385842770338058,0.6360123343436064,0.0,1.0,0.8501838445663452,0.4878495931625366,0.03181080857757479,-0.011594128329306841,1.4764173030853271,1e-06,8073.34375,29617.0,0.0,64.25,776.2692010199971,302.40836961199966,410.657920206002,266139.0,85.7109233659858
+114,4288,0.7444444444444445,0.46875,0.617403718829155,0.6345451208844519,0.0,1.0,0.46875,0.475120484828949,0.0307149114087224,-0.011048512067645788,0.4888818562030792,1e-06,8554.6875,17023.0,0.0,71.46875,602.572592534998,251.4644644059954,292.3533759150014,281350.0,116.72867447238688
+115,4320,0.75,0.53125,0.576778718829155,0.6336469024419784,0.0,1.0,0.53125,0.4686606228351593,0.026285600382834673,0.04449816746637225,1.129177451133728,1e-06,9946.75,17526.0,0.0,82.25,730.8504216040019,272.9332619470006,385.1836095210019,325952.0,111.49750700171697
+116,4352,0.7555555555555555,0.53125,0.550216218829155,0.6327641705243752,0.0,1.0,0.53125,0.5114588141441345,0.03311238274909556,-0.02047073980793357,1.5685045719146729,1e-06,9275.90625,17309.0,0.0,79.625,712.3588541049976,306.07394738600124,346.4053157810049,304733.0,106.94504540933386
+117,4384,0.7611111111111111,0.375,0.562716218829155,0.6305610579557908,0.0,1.0,0.375,0.5243729948997498,0.03157026367262006,-9.313225746154785e-10,1.1829904317855835,1e-06,9275.59375,15901.0,0.0,86.5625,685.0167982619969,323.12372009200044,305.43999807599903,304371.0,111.08158251456042
+118,4416,0.7666666666666667,0.3125,0.551466217637062,0.6278656252612502,0.0,1.0,0.3125,0.5047681927680969,0.027923603309318423,-0.01173288282006979,1.4175602197647095,1e-06,11526.8125,20945.0,0.0,87.09375,875.163593651996,346.52199574300175,453.9238649639956,376650.0,107.59416945929677
+119,4448,0.7722222222222223,0.4575892686843872,0.5448150128126145,0.6264347315085035,0.0,1.0,0.4575892686843872,0.5027925968170166,0.033983897883445024,-0.010770143009722233,1.2801748514175415,1e-06,10191.5,23580.0,0.0,85.6875,781.1067987279966,299.8490380380026,410.7409704149977,333872.0,106.85862693286569
+120,4480,0.7777777777777778,0.5284091234207153,0.535155925154686,0.6256178514411052,0.0,1.0,0.5284091234207153,0.5569469928741455,0.03378004557453096,-0.01687689684331417,2.615743637084961,1e-06,9535.8125,18267.0,0.0,79.8125,737.2922842449989,305.8171431910014,352.30864538699825,312754.0,106.04817339173228
+121,4512,0.7833333333333333,0.588737964630127,0.5480475783348083,0.625313058988122,0.0,1.0,0.588737964630127,0.5512794256210327,0.03701434237882495,0.03513643518090248,1.7769917249679565,1e-06,8224.09375,15799.0,0.0,78.0625,628.2515895460019,291.57310188399424,283.08619549599825,270875.0,107.78922190859254
+122,4544,0.7888888888888889,0.78125,0.5424920201301575,0.6265912306357603,0.0,1.0,0.78125,0.5417989492416382,0.03328873496502638,-0.03701696963980794,1.4722737073898315,1e-06,9387.0,20078.0,0.0,79.40625,727.1160834459952,312.672299210004,353.3180050900046,308048.0,105.91431238189615
+123,4576,0.7944444444444444,0.59375,0.5168486356735229,0.6263242287606727,0.0,1.0,0.59375,0.5627554655075073,0.032315776916220784,0.042237100657075644,1.2200132608413696,1e-06,9604.84375,20965.0,0.0,83.125,759.0557322899986,363.6044317559936,335.9192556660055,314995.0,103.74567591028205
+124,4608,0.8,0.625,0.5324736356735229,0.6263135494964738,0.0,1.0,0.625,0.5565440058708191,0.03728303010575473,-0.0035009384155273438,1.7979390621185303,1e-06,8743.28125,16410.0,0.0,77.28125,684.3729462939955,289.3639488100016,336.23781639299705,287609.0,105.06296367991139
+125,4640,0.8055555555555556,0.7141098380088806,0.550759619474411,0.627015919804573,0.0,1.0,0.7141098380088806,0.5723283886909485,0.03934943373315036,-0.02965876937378198,1.7521216869354248,1e-06,9173.9375,14544.0,0.0,75.78125,623.204925185004,273.5443370399953,293.48215427000105,301254.0,120.84869190923438
+126,4672,0.8111111111111111,0.53125,0.550759619474411,0.6262558728219971,0.0,1.0,0.53125,0.5311294794082642,0.04010983696207404,-0.029710976406931877,1.2397727966308594,1e-06,9936.6875,18334.0,0.0,78.3125,700.9642002920009,291.4325309170017,347.7891824019971,325590.0,116.12219278258749
+127,4704,0.8166666666666667,0.46875,0.560134619474411,0.6250156690989892,0.0,1.0,0.46875,0.5179776549339294,0.03984615136869252,-0.01886894181370735,1.5026448965072632,1e-06,11630.4375,19960.0,0.0,88.59375,949.8214335849989,375.8492509860007,491.068162096999,379974.0,100.0119566068932
+128,4736,0.8222222222222222,0.4955357313156128,0.5784381926059723,0.6240041070850566,0.0,1.0,0.4955357313156128,0.542945921421051,0.038961376529186964,0.05316445464268327,1.313188076019287,1e-06,11929.875,20859.0,0.0,88.8125,995.034908751004,406.29969265800173,508.0643240019999,389340.0,97.82068864516286
+129,4768,0.8277777777777777,0.28125,0.5608042657375336,0.6213470985030018,0.0,1.0,0.28125,0.6017671227455139,0.04371624533087015,0.0028829211369156837,1.7867417335510254,1e-06,11279.46875,17697.0,0.0,86.15625,873.452001038997,355.5255192689947,440.99942797100084,368727.0,105.53728183156841
+130,4800,0.8333333333333334,0.46875,0.5548383533954621,0.6201732746683635,0.0,1.0,0.46875,0.5928316116333008,0.05331338895484805,0.03252609819173813,1.9997047185897827,1e-06,11718.34375,19466.0,0.0,85.09375,951.2359299210002,373.40190088000236,488.95113882199803,382747.0,100.59202663628018
+131,4832,0.8388888888888889,0.375,0.5334645569324493,0.6183017229533377,0.0,1.0,0.375,0.5774513483047485,0.05012143310159445,0.01132136583328247,1.9648877382278442,1e-06,13001.625,23958.0,0.0,91.5,1133.2563905019997,463.5300958980006,583.8676047320041,424020.0,93.54017404044187
+132,4864,0.8444444444444444,0.28125,0.48346455693244933,0.6157483008097518,0.0,1.0,0.28125,0.6425586342811584,0.06312552210874856,-0.011732903309166431,2.3910293579101562,1e-06,13407.8125,24026.0,0.0,92.6875,1082.7494760609989,508.76302987699455,496.5951919020008,436634.0,100.81602661874697
+133,4896,0.85,0.6196895837783813,0.4860585153102875,0.6157779345162829,0.0,1.0,0.6196895837783813,0.7623345851898193,0.07549610082060099,0.0025529609993100166,2.475010871887207,1e-06,11944.0625,18534.0,0.0,86.8125,906.3047480050009,401.4822521629976,434.1120181830047,389754.0,107.51184986560652
+134,4928,0.8555555555555555,0.21732953190803528,0.445291468501091,0.6128044389744303,0.0,1.0,0.21732953190803528,0.7878969311714172,0.07450028881430626,-0.0049224961549043655,2.5018677711486816,1e-06,13789.90625,18937.0,0.0,95.4375,1046.299599594,448.8230399879976,516.3334242660057,448925.0,107.26492683696864
+135,4960,0.8611111111111112,0.21875,0.39575548470020294,0.6098855172042493,0.0,1.0,0.21875,0.7965275645256042,0.08216525753960013,-0.007547578774392605,2.2317757606506348,1e-06,14427.9375,20392.0,0.0,93.125,1103.636843332999,483.5946667349999,539.6266413960038,469414.0,106.33343813132475
+136,4992,0.8666666666666667,0.265625,0.36919298470020295,0.6073541898718652,0.0,1.0,0.265625,0.8604928851127625,0.090252127032727,-0.01886896137148142,2.839259624481201,1e-06,13495.21875,21836.0,0.0,92.0,1060.3656114990008,435.2010758100005,544.6687408759972,439615.0,103.64703344597625
+137,5024,0.8722222222222222,0.3532196879386902,0.35763995349407196,0.6054991935073895,0.0,1.0,0.3532196879386902,0.8595027327537537,0.1166499825194478,-0.02266639843583107,3.4554829597473145,1e-06,12714.65625,22346.0,0.0,92.78125,985.8951307530006,410.91094168199925,498.9521524340016,414445.0,105.09358122183286
+138,5056,0.8777777777777778,0.375,0.34558638036251066,0.6038289094964663,0.0,1.0,0.375,0.7477181553840637,0.09893591050058603,0.06038062181323767,4.570157051086426,1e-06,12703.71875,18404.0,0.0,90.9375,962.9236716000014,396.9300077680018,484.12719249699876,414327.0,107.57005259605651
+139,5088,0.8833333333333333,0.34375,0.3518363803625107,0.6019578382051248,0.0,1.0,0.34375,0.8214343190193176,0.11875244230031967,-0.008020231034606695,4.192262172698975,1e-06,11536.03125,17497.0,0.0,92.5625,862.3632335530056,355.6671881710063,423.3274497309976,376969.0,109.28370590628543
+140,5120,0.8888888888888888,0.4375,0.3487113803625107,0.6007831393608025,0.0,1.0,0.4375,0.7382907867431641,0.11518465168774128,0.015649206936359406,4.3111491203308105,1e-06,10845.78125,21253.0,0.0,90.1875,894.3772942620053,378.7608357249992,445.09585443000105,354785.0,99.17095455021321
+141,5152,0.8944444444444445,0.46875,0.35808638036251067,0.5998467341171089,0.0,1.0,0.46875,0.7204105257987976,0.10797738283872604,0.006477963179349899,3.8894994258880615,1e-06,9127.9375,17106.0,0.0,88.71875,664.6222905940012,303.0469127690012,306.42757176199666,299726.0,112.74298358700929
+142,5184,0.9,0.47972744703292847,0.37793412506580354,0.5990008236446851,0.0,1.0,0.47972744703292847,0.6398255228996277,0.12292451551184058,-0.05603132146643475,3.662858486175537,1e-06,9096.0,17699.0,0.0,87.9375,712.4780162230018,327.9175086960022,325.0235900859989,298800.0,104.84534020572406
+143,5216,0.9055555555555556,0.5,0.3659651666879654,0.5983085101926243,0.0,1.0,0.5,0.684481143951416,0.11467130854725838,-0.03808304527774453,4.073719501495361,1e-06,7836.03125,14293.0,0.0,79.96875,524.3538214029977,218.81934455499868,254.65701454199734,258585.0,123.28745850850858
+144,5248,0.9111111111111111,0.125,0.3567322134971619,0.5950216455385089,0.0,1.0,0.125,0.6325398087501526,0.09488800400868058,0.0,2.0359292030334473,1e-06,9165.53125,17024.0,0.0,92.9375,664.6822722120123,306.14739986500354,297.87586116099556,300833.0,113.14917388982353
+145,5280,0.9166666666666666,0.40625,0.3754822134971619,0.5937197721210019,0.0,1.0,0.40625,0.7131418585777283,0.10848444048315287,0.005828381981700659,3.3547847270965576,1e-06,7807.65625,14645.0,0.0,84.1875,536.1132394120068,237.89537485501205,249.48760342699825,257453.0,120.05532650264657
+146,5312,0.9222222222222223,0.65625,0.4145447134971619,0.5941480613530499,0.0,1.0,0.65625,0.5278119444847107,0.08859263407066464,-0.02792540332302451,2.548308849334717,1e-06,9317.75,19228.0,0.0,76.1875,636.2111726889998,245.4347475090035,330.6733724509977,305808.0,120.1676476017691
+147,5344,0.9277777777777778,0.7152777910232544,0.4507505238056183,0.5949720731195138,0.0,1.0,0.7152777910232544,0.6326598525047302,0.09549310058355331,-0.027620915789157152,2.789980888366699,1e-06,7527.4375,12268.0,0.0,73.375,533.2891108869953,215.58959951100405,244.80390844699286,248470.0,116.47997067984907
+148,5376,0.9333333333333333,0.9598214626312256,0.5092326700687408,0.5974372716972957,0.0,1.0,0.9598214626312256,0.5717431902885437,0.08902004128322005,-0.022096899803727865,1.9798340797424316,1e-06,6950.65625,17076.0,0.0,68.28125,537.6978383080132,229.88232261499797,257.7511907059961,230269.0,107.06245385168046
+149,5408,0.9388888888888889,0.03281249850988388,0.47813891991972923,0.5936478436893264,0.0,0.550000011920929,0.03281249850988388,0.46466338634490967,0.07427925104275346,-0.0276211965829134,1.6558598279953003,1e-06,11544.09375,19125.0,0.0,83.5625,864.6241383659944,333.1147536570061,456.6448786050023,377163.0,109.05403378882632
+150,5440,0.9444444444444444,0.9375,0.5281389199197293,0.5959401913980643,0.0,1.0,0.9375,0.5715621709823608,0.08573185931891203,-0.02209702366963029,1.8805148601531982,1e-06,6858.59375,14114.0,0.0,63.4375,494.69706650999433,212.319024041004,219.94617871499213,227163.0,114.79904338355857
+151,5472,0.95,0.5539772510528564,0.5366616450250149,0.5956622911308775,0.0,1.0,0.5539772510528564,0.47979527711868286,0.07984621077775955,-0.005524249281734228,1.6674824953079224,1e-06,8277.21875,18375.0,0.0,68.1875,637.1720781070035,272.26585396500013,308.58691172600084,272695.0,106.99425216895843
+152,5504,0.9555555555555556,0.9375,0.5824389003217221,0.5979112234260691,0.0,1.0,0.9375,0.5036134123802185,0.07261202670633793,0.060766810551285744,1.4194819927215576,1e-06,7717.125,18988.0,0.0,63.65625,614.2784289260017,262.26351999300823,297.6949962340004,254724.0,103.66797367659358
+153,5536,0.9611111111111111,0.8626893162727356,0.6187078319489956,0.5996417991963088,0.0,1.0,0.8626893162727356,0.5183735489845276,0.07394099328666925,0.00552454125136137,1.8318774700164795,1e-06,5635.25,13924.0,0.0,59.34375,399.3879788060003,163.64967352699023,195.23659524900722,187928.0,117.63498776416891
+154,5568,0.9666666666666667,0.34687501192092896,0.6408953331410885,0.5980004564217933,0.0,1.0,0.34687501192092896,0.40284156799316406,0.058414601255208254,-0.036363580264151096,2.051762104034424,1e-06,6814.75,16413.0,0.0,71.1875,441.56947982699785,194.54062468699703,201.978745076005,225800.0,127.83945127302843
+155,5600,0.9722222222222222,0.53125,0.6533953331410884,0.5975698083158463,0.0,1.0,0.53125,0.38849499821662903,0.06255758926272392,-0.03897391725331545,1.8420926332473755,1e-06,7739.625,21069.0,0.0,75.1875,561.7847249940096,219.46015238999098,290.3942456670047,255212.0,113.57197367849463
+156,5632,0.9777777777777777,0.75,0.6627703331410885,0.5985469249292061,0.0,1.0,0.75,0.34043529629707336,0.05294682923704386,0.0,0.020167065784335136,1e-06,6625.09375,20393.0,0.0,71.5,502.55861011899833,196.17271796800196,256.7203937250015,219555.0,109.21860434746739
+157,5664,0.9833333333333333,1.0,0.691242554038763,0.6011039508850711,1.0,1.0,1.0,0.35695207118988037,0.049239000771194696,0.0,0.020511247217655182,1e-06,5154.9375,9177.0,0.0,60.625,278.4052192539966,111.44530419301009,131.75643257300544,172774.0,155.14615751723176
+158,5696,0.9888888888888889,0.6875,0.6640104077756405,0.6016507613225074,0.0,1.0,0.6875,0.34239521622657776,0.047051018103957176,-0.01657276740297675,2.5596866607666016,1e-06,5864.59375,11249.0,0.0,64.5625,355.34276504200534,141.89146169400192,171.62695666399668,195427.0,137.49189460554967
+159,5728,0.9944444444444445,0.65625,0.7263541579246521,0.6019941527607306,0.0,1.0,0.65625,0.29192981123924255,0.03798528644256294,-0.0052201650105416775,2.025282144546509,1e-06,9066.0,28814.0,0.0,73.40625,727.5502040899883,257.2529562379932,402.5874261560093,297752.0,102.3132143755031
+160,5760,1.0,0.918526828289032,0.7244568407535553,0.6039724819827825,0.0,1.0,0.918526828289032,0.33194801211357117,0.044051496777683496,-0.01694883799063973,1.073145866394043,1e-06,5376.40625,8507.0,0.0,61.5,322.8353051979939,132.88410105500952,150.7621233719983,179749.0,139.1955875843261

eval/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/post_eval/outputs/docvqa.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b10346d9dd0fb272f478b5091819b539aa53298d1f387492db1ab1947d30b54c
+size 13487369

eval/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/post_eval/summaries/docvqa.summary.json

@@ -0,0 +1,70 @@
+{
+  "output": "/data/external/wangzk_team/chenrs/project/es/Dynamic-Agent/runs/docvqa_grpo/four_gpu_from_step40/post_eval/outputs/docvqa.jsonl",
+  "records": 400,
+  "valid_records": 400,
+  "mean_score": 0.45222229853479845,
+  "max@4": 0.5147490842490843,
+  "score_methods": {
+    "docvqa_paper_react_cli_anls": 400
+  },
+  "mean_anls": 0.45222229853479845,
+  "max@4_anls": 0.5147490842490843,
+  "mean_vlns": 0.45222229853479845,
+  "max@4_vlns": 0.5147490842490843,
+  "mean_acc": 0.47,
+  "max@4_acc": 0.53,
+  "by_sample": {
+    "0": {
+      "count": 100,
+      "mean_score": 0.4416895604395604
+    },
+    "1": {
+      "count": 100,
+      "mean_score": 0.4409395604395605
+    },
+    "2": {
+      "count": 100,
+      "mean_score": 0.4657014652014652
+    },
+    "3": {
+      "count": 100,
+      "mean_score": 0.4605586080586081
+    }
+  },
+  "docvqa_diagnostics": {
+    "records": 400,
+    "valid_records": 400,
+    "request_errors": 0,
+    "mean_anls": 0.4522222985347985,
+    "mean_accuracy": 0.47,
+    "tool_success_rate": 1.0,
+    "mean_turns": 32.79,
+    "mean_latency_s": 78.86162417352199,
+    "react_errors": {
+      "max_react_turns_exceeded": 54
+    },
+    "usage": {
+      "mean_prompt_tokens": 108325.16,
+      "mean_completion_tokens": 3412.0375,
+      "mean_total_tokens": 111737.1975
+    }
+  },
+  "dataset": "docvqa",
+  "kind": "docvqa",
+  "data": "/data/external/wangzk_team/chenrs/project/es/Dynamic-Agent/data/trace2skill/docvqa/test.jsonl",
+  "items": 100,
+  "samples": 4,
+  "expected_records": 400,
+  "enable_thinking": false,
+  "mode": "paper_react_cli",
+  "math_max_turns": null,
+  "docvqa_max_turns": 50,
+  "sampling": {
+    "temperature": 1.0,
+    "top_p": 1.0,
+    "top_k": 40,
+    "min_p": 0.0,
+    "presence_penalty": 2.0,
+    "repetition_penalty": 1.0
+  }
+}

eval/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/post_eval/summary.json

@@ -0,0 +1,72 @@
+{
+  "docvqa": {
+    "output": "/data/external/wangzk_team/chenrs/project/es/Dynamic-Agent/runs/docvqa_grpo/four_gpu_from_step40/post_eval/outputs/docvqa.jsonl",
+    "records": 400,
+    "valid_records": 400,
+    "mean_score": 0.45222229853479845,
+    "max@4": 0.5147490842490843,
+    "score_methods": {
+      "docvqa_paper_react_cli_anls": 400
+    },
+    "mean_anls": 0.45222229853479845,
+    "max@4_anls": 0.5147490842490843,
+    "mean_vlns": 0.45222229853479845,
+    "max@4_vlns": 0.5147490842490843,
+    "mean_acc": 0.47,
+    "max@4_acc": 0.53,
+    "by_sample": {
+      "0": {
+        "count": 100,
+        "mean_score": 0.4416895604395604
+      },
+      "1": {
+        "count": 100,
+        "mean_score": 0.4409395604395605
+      },
+      "2": {
+        "count": 100,
+        "mean_score": 0.4657014652014652
+      },
+      "3": {
+        "count": 100,
+        "mean_score": 0.4605586080586081
+      }
+    },
+    "docvqa_diagnostics": {
+      "records": 400,
+      "valid_records": 400,
+      "request_errors": 0,
+      "mean_anls": 0.4522222985347985,
+      "mean_accuracy": 0.47,
+      "tool_success_rate": 1.0,
+      "mean_turns": 32.79,
+      "mean_latency_s": 78.86162417352199,
+      "react_errors": {
+        "max_react_turns_exceeded": 54
+      },
+      "usage": {
+        "mean_prompt_tokens": 108325.16,
+        "mean_completion_tokens": 3412.0375,
+        "mean_total_tokens": 111737.1975
+      }
+    },
+    "dataset": "docvqa",
+    "kind": "docvqa",
+    "data": "/data/external/wangzk_team/chenrs/project/es/Dynamic-Agent/data/trace2skill/docvqa/test.jsonl",
+    "items": 100,
+    "samples": 4,
+    "expected_records": 400,
+    "enable_thinking": false,
+    "mode": "paper_react_cli",
+    "math_max_turns": null,
+    "docvqa_max_turns": 50,
+    "sampling": {
+      "temperature": 1.0,
+      "top_p": 1.0,
+      "top_k": 40,
+      "min_p": 0.0,
+      "presence_penalty": 2.0,
+      "repetition_penalty": 1.0
+    }
+  }
+}

eval/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80_sample_only/outputs/docvqa.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:99bbabedb25ff57bd2b530011541b3ae0fc9cee9478fd36c33da3f5590d284e9
+size 22025486

eval/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80_sample_only/summaries/docvqa.summary.json

@@ -0,0 +1,86 @@
+{
+  "output": "/data/external/wangzk_team/chenrs/project/es/Dynamic-Agent/runs/docvqa_grpo/trace2skill_trajectory_collection_step80/sample_only/outputs/docvqa.jsonl",
+  "records": 400,
+  "valid_records": 400,
+  "mean_score": 0.4338380584557055,
+  "max@8": 0.7584848484848484,
+  "score_methods": {
+    "docvqa_paper_react_cli_anls": 400
+  },
+  "mean_anls": 0.4338380584557055,
+  "max@8_anls": 0.7584848484848484,
+  "mean_vlns": 0.4338380584557055,
+  "max@8_vlns": 0.7584848484848484,
+  "mean_acc": 0.4425,
+  "max@8_acc": 0.76,
+  "by_sample": {
+    "0": {
+      "count": 50,
+      "mean_score": 0.46993506493506493
+    },
+    "1": {
+      "count": 50,
+      "mean_score": 0.43179653679653685
+    },
+    "2": {
+      "count": 50,
+      "mean_score": 0.39623885918003565
+    },
+    "3": {
+      "count": 50,
+      "mean_score": 0.3763636363636364
+    },
+    "4": {
+      "count": 50,
+      "mean_score": 0.48236363636363633
+    },
+    "5": {
+      "count": 50,
+      "mean_score": 0.4267340067340068
+    },
+    "6": {
+      "count": 50,
+      "mean_score": 0.4963636363636364
+    },
+    "7": {
+      "count": 50,
+      "mean_score": 0.39090909090909093
+    }
+  },
+  "docvqa_diagnostics": {
+    "records": 400,
+    "valid_records": 400,
+    "request_errors": 0,
+    "mean_anls": 0.4338380584557055,
+    "mean_accuracy": 0.4425,
+    "tool_success_rate": 1.0,
+    "mean_turns": 43.0825,
+    "mean_latency_s": 127.1473990058899,
+    "react_errors": {
+      "max_react_turns_exceeded": 186
+    },
+    "usage": {
+      "mean_prompt_tokens": 226482.7425,
+      "mean_completion_tokens": 7051.74,
+      "mean_total_tokens": 233534.4825
+    }
+  },
+  "dataset": "docvqa",
+  "kind": "docvqa",
+  "data": "/data/external/wangzk_team/chenrs/project/es/Dynamic-Agent/data/trace2skill/docvqa/evolve.jsonl",
+  "items": 50,
+  "samples": 8,
+  "expected_records": 400,
+  "enable_thinking": false,
+  "mode": "paper_react_cli",
+  "math_max_turns": null,
+  "docvqa_max_turns": 50,
+  "sampling": {
+    "temperature": 1.0,
+    "top_p": 1.0,
+    "top_k": 40,
+    "min_p": 0.0,
+    "presence_penalty": 2.0,
+    "repetition_penalty": 1.0
+  }
+}

eval/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80_sample_only/summary.json

@@ -0,0 +1,88 @@
+{
+  "docvqa": {
+    "output": "/data/external/wangzk_team/chenrs/project/es/Dynamic-Agent/runs/docvqa_grpo/trace2skill_trajectory_collection_step80/sample_only/outputs/docvqa.jsonl",
+    "records": 400,
+    "valid_records": 400,
+    "mean_score": 0.4338380584557055,
+    "max@8": 0.7584848484848484,
+    "score_methods": {
+      "docvqa_paper_react_cli_anls": 400
+    },
+    "mean_anls": 0.4338380584557055,
+    "max@8_anls": 0.7584848484848484,
+    "mean_vlns": 0.4338380584557055,
+    "max@8_vlns": 0.7584848484848484,
+    "mean_acc": 0.4425,
+    "max@8_acc": 0.76,
+    "by_sample": {
+      "0": {
+        "count": 50,
+        "mean_score": 0.46993506493506493
+      },
+      "1": {
+        "count": 50,
+        "mean_score": 0.43179653679653685
+      },
+      "2": {
+        "count": 50,
+        "mean_score": 0.39623885918003565
+      },
+      "3": {
+        "count": 50,
+        "mean_score": 0.3763636363636364
+      },
+      "4": {
+        "count": 50,
+        "mean_score": 0.48236363636363633
+      },
+      "5": {
+        "count": 50,
+        "mean_score": 0.4267340067340068
+      },
+      "6": {
+        "count": 50,
+        "mean_score": 0.4963636363636364
+      },
+      "7": {
+        "count": 50,
+        "mean_score": 0.39090909090909093
+      }
+    },
+    "docvqa_diagnostics": {
+      "records": 400,
+      "valid_records": 400,
+      "request_errors": 0,
+      "mean_anls": 0.4338380584557055,
+      "mean_accuracy": 0.4425,
+      "tool_success_rate": 1.0,
+      "mean_turns": 43.0825,
+      "mean_latency_s": 127.1473990058899,
+      "react_errors": {
+        "max_react_turns_exceeded": 186
+      },
+      "usage": {
+        "mean_prompt_tokens": 226482.7425,
+        "mean_completion_tokens": 7051.74,
+        "mean_total_tokens": 233534.4825
+      }
+    },
+    "dataset": "docvqa",
+    "kind": "docvqa",
+    "data": "/data/external/wangzk_team/chenrs/project/es/Dynamic-Agent/data/trace2skill/docvqa/evolve.jsonl",
+    "items": 50,
+    "samples": 8,
+    "expected_records": 400,
+    "enable_thinking": false,
+    "mode": "paper_react_cli",
+    "math_max_turns": null,
+    "docvqa_max_turns": 50,
+    "sampling": {
+      "temperature": 1.0,
+      "top_p": 1.0,
+      "top_k": 40,
+      "min_p": 0.0,
+      "presence_penalty": 2.0,
+      "repetition_penalty": 1.0
+    }
+  }
+}

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/added_tokens.json

@@ -0,0 +1,35 @@
+{
+  "</think>": 248069,
+  "</tool_call>": 248059,
+  "</tool_response>": 248067,
+  "<think>": 248068,
+  "<tool_call>": 248058,
+  "<tool_response>": 248066,
+  "<tts_pad>": 248072,
+  "<tts_text_bos>": 248073,
+  "<tts_text_bos_single>": 248075,
+  "<tts_text_eod>": 248074,
+  "<|audio_end|>": 248071,
+  "<|audio_pad|>": 248076,
+  "<|audio_start|>": 248070,
+  "<|box_end|>": 248050,
+  "<|box_start|>": 248049,
+  "<|endoftext|>": 248044,
+  "<|file_sep|>": 248065,
+  "<|fim_middle|>": 248061,
+  "<|fim_pad|>": 248063,
+  "<|fim_prefix|>": 248060,
+  "<|fim_suffix|>": 248062,
+  "<|im_end|>": 248046,
+  "<|im_start|>": 248045,
+  "<|image_pad|>": 248056,
+  "<|object_ref_end|>": 248048,
+  "<|object_ref_start|>": 248047,
+  "<|quad_end|>": 248052,
+  "<|quad_start|>": 248051,
+  "<|repo_name|>": 248064,
+  "<|video_pad|>": 248057,
+  "<|vision_end|>": 248054,
+  "<|vision_pad|>": 248055,
+  "<|vision_start|>": 248053
+}

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/chat_template.jinja

@@ -0,0 +1,154 @@
+{%- set image_count = namespace(value=0) %}
+{%- set video_count = namespace(value=0) %}
+{%- macro render_content(content, do_vision_count, is_system_content=false) %}
+    {%- if content is string %}
+        {{- content }}
+    {%- elif content is iterable and content is not mapping %}
+        {%- for item in content %}
+            {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}
+                {%- if is_system_content %}
+                    {{- raise_exception('System message cannot contain images.') }}
+                {%- endif %}
+                {%- if do_vision_count %}
+                    {%- set image_count.value = image_count.value + 1 %}
+                {%- endif %}
+                {%- if add_vision_id %}
+                    {{- 'Picture ' ~ image_count.value ~ ': ' }}
+                {%- endif %}
+                {{- '<|vision_start|><|image_pad|><|vision_end|>' }}
+            {%- elif 'video' in item or item.type == 'video' %}
+                {%- if is_system_content %}
+                    {{- raise_exception('System message cannot contain videos.') }}
+                {%- endif %}
+                {%- if do_vision_count %}
+                    {%- set video_count.value = video_count.value + 1 %}
+                {%- endif %}
+                {%- if add_vision_id %}
+                    {{- 'Video ' ~ video_count.value ~ ': ' }}
+                {%- endif %}
+                {{- '<|vision_start|><|video_pad|><|vision_end|>' }}
+            {%- elif 'text' in item %}
+                {{- item.text }}
+            {%- else %}
+                {{- raise_exception('Unexpected item type in content.') }}
+            {%- endif %}
+        {%- endfor %}
+    {%- elif content is none or content is undefined %}
+        {{- '' }}
+    {%- else %}
+        {{- raise_exception('Unexpected content type.') }}
+    {%- endif %}
+{%- endmacro %}
+{%- if not messages %}
+    {{- raise_exception('No messages provided.') }}
+{%- endif %}
+{%- if tools and tools is iterable and tools is not mapping %}
+    {{- '<|im_start|>system\n' }}
+    {{- "# Tools\n\nYou have access to the following functions:\n\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>" }}
+    {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
+    {%- if messages[0].role == 'system' %}
+        {%- set content = render_content(messages[0].content, false, true)|trim %}
+        {%- if content %}
+            {{- '\n\n' + content }}
+        {%- endif %}
+    {%- endif %}
+    {{- '<|im_end|>\n' }}
+{%- else %}
+    {%- if messages[0].role == 'system' %}
+        {%- set content = render_content(messages[0].content, false, true)|trim %}
+        {{- '<|im_start|>system\n' + content + '<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for message in messages[::-1] %}
+    {%- set index = (messages|length - 1) - loop.index0 %}
+    {%- if ns.multi_step_tool and message.role == "user" %}
+        {%- set content = render_content(message.content, false)|trim %}
+        {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}
+            {%- set ns.multi_step_tool = false %}
+            {%- set ns.last_query_index = index %}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if ns.multi_step_tool %}
+    {{- raise_exception('No user query found in messages.') }}
+{%- endif %}
+{%- for message in messages %}
+    {%- set content = render_content(message.content, true)|trim %}
+    {%- if message.role == "system" %}
+        {%- if not loop.first %}
+            {{- raise_exception('System message must be at the beginning.') }}
+        {%- endif %}
+    {%- elif message.role == "user" %}
+        {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {%- set reasoning_content = '' %}
+        {%- if message.reasoning_content is string %}
+            {%- set reasoning_content = message.reasoning_content %}
+        {%- else %}
+            {%- if '</think>' in content %}
+                {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
+                {%- set content = content.split('</think>')[-1].lstrip('\n') %}
+            {%- endif %}
+        {%- endif %}
+        {%- set reasoning_content = reasoning_content|trim %}
+        {%- if loop.index0 > ns.last_query_index %}
+            {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content + '\n</think>\n\n' + content }}
+        {%- else %}
+            {{- '<|im_start|>' + message.role + '\n' + content }}
+        {%- endif %}
+        {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
+            {%- for tool_call in message.tool_calls %}
+                {%- if tool_call.function is defined %}
+                    {%- set tool_call = tool_call.function %}
+                {%- endif %}
+                {%- if loop.first %}
+                    {%- if content|trim %}
+                        {{- '\n\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                    {%- else %}
+                        {{- '<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                    {%- endif %}
+                {%- else %}
+                    {{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                {%- endif %}
+                {%- if tool_call.arguments is defined %}
+                    {%- for args_name, args_value in tool_call.arguments|items %}
+                        {{- '<parameter=' + args_name + '>\n' }}
+                        {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}
+                        {{- args_value }}
+                        {{- '\n</parameter>\n' }}
+                    {%- endfor %}
+                {%- endif %}
+                {{- '</function>\n</tool_call>' }}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if loop.previtem and loop.previtem.role != "tool" %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- content }}
+        {{- '\n</tool_response>' }}
+        {%- if not loop.last and loop.nextitem.role != "tool" %}
+            {{- '<|im_end|>\n' }}
+        {%- elif loop.last %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- else %}
+        {{- raise_exception('Unexpected message role.') }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+    {%- if enable_thinking is defined and enable_thinking is false %}
+        {{- '<think>\n\n</think>\n\n' }}
+    {%- else %}
+        {{- '<think>\n' }}
+    {%- endif %}
+{%- endif %}

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/config.json

@@ -0,0 +1,112 @@
+{
+  "architectures": [
+    "Qwen3NextForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "attn_output_gate": true,
+  "decoder_sparse_step": 1,
+  "dtype": "bfloat16",
+  "eos_token_id": 248046,
+  "full_attention_interval": 4,
+  "head_dim": 256,
+  "hidden_act": "silu",
+  "hidden_size": 2560,
+  "initializer_range": 0.02,
+  "intermediate_size": 9216,
+  "layer_types": [
+    "linear_attention",
+    "linear_attention",
+    "linear_attention",
+    "full_attention",
+    "linear_attention",
+    "linear_attention",
+    "linear_attention",
+    "full_attention",
+    "linear_attention",
+    "linear_attention",
+    "linear_attention",
+    "full_attention",
+    "linear_attention",
+    "linear_attention",
+    "linear_attention",
+    "full_attention",
+    "linear_attention",
+    "linear_attention",
+    "linear_attention",
+    "full_attention",
+    "linear_attention",
+    "linear_attention",
+    "linear_attention",
+    "full_attention",
+    "linear_attention",
+    "linear_attention",
+    "linear_attention",
+    "full_attention",
+    "linear_attention",
+    "linear_attention",
+    "linear_attention",
+    "full_attention"
+  ],
+  "linear_conv_kernel_dim": 4,
+  "linear_key_head_dim": 128,
+  "linear_num_key_heads": 16,
+  "linear_num_value_heads": 32,
+  "linear_value_head_dim": 128,
+  "mamba_ssm_dtype": "float32",
+  "max_position_embeddings": 262144,
+  "mlp_only_layers": [
+    0,
+    1,
+    2,
+    3,
+    4,
+    5,
+    6,
+    7,
+    8,
+    9,
+    10,
+    11,
+    12,
+    13,
+    14,
+    15,
+    16,
+    17,
+    18,
+    19,
+    20,
+    21,
+    22,
+    23,
+    24,
+    25,
+    26,
+    27,
+    28,
+    29,
+    30,
+    31
+  ],
+  "model_type": "qwen3_next",
+  "moe_intermediate_size": 512,
+  "norm_topk_prob": true,
+  "num_attention_heads": 16,
+  "num_experts": 0,
+  "num_experts_per_tok": 0,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 4,
+  "output_router_logits": false,
+  "pad_token_id": 248044,
+  "partial_rotary_factor": 0.25,
+  "rms_norm_eps": 1e-06,
+  "rope_scaling": null,
+  "rope_theta": 10000000,
+  "router_aux_loss_coef": 0.001,
+  "shared_expert_intermediate_size": 512,
+  "tie_word_embeddings": true,
+  "transformers_version": "4.57.1",
+  "use_cache": true,
+  "vocab_size": 248320
+}

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "eos_token_id": 248046,
+  "pad_token_id": 248044,
+  "transformers_version": "4.57.1"
+}

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/model-00001-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c2b67c52d1df276238cc8dead68889954892c9fdd372fa9a34e86d7d057763ad
+size 4948083944

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/model-00002-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a7baed42aa433d1faab1bbaf6f5d08fb3da52548f87286821abfab175200b511
+size 4997765600

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/model-00003-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f603b31cd392f67b9194cfbdce64e1822fcc0f27e69cb6fdc53b04d5fcb74e30
+size 4997765672

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/model-00004-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ee007b0d9eb42fb81aa64a64c87bd7569b67d57e507bfae62f7d9c56bacaef9
+size 4422230088

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/model.safetensors.index.json

@@ -0,0 +1,387 @@
+{
+  "metadata": {
+    "total_parameters": 4841450496,
+    "total_size": 19365801984
+  },
+  "weight_map": {
+    "lm_head.weight": "model-00004-of-00004.safetensors",
+    "model.embed_tokens.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.input_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.linear_attn.A_log": "model-00001-of-00004.safetensors",
+    "model.layers.0.linear_attn.conv1d.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.linear_attn.dt_bias": "model-00001-of-00004.safetensors",
+    "model.layers.0.linear_attn.in_proj_ba.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.linear_attn.in_proj_qkvz.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.linear_attn.norm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.linear_attn.out_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.input_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.linear_attn.A_log": "model-00001-of-00004.safetensors",
+    "model.layers.1.linear_attn.conv1d.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.linear_attn.dt_bias": "model-00001-of-00004.safetensors",
+    "model.layers.1.linear_attn.in_proj_ba.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.linear_attn.in_proj_qkvz.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.linear_attn.norm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.linear_attn.out_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.10.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.10.linear_attn.A_log": "model-00002-of-00004.safetensors",
+    "model.layers.10.linear_attn.conv1d.weight": "model-00002-of-00004.safetensors",
+    "model.layers.10.linear_attn.dt_bias": "model-00002-of-00004.safetensors",
+    "model.layers.10.linear_attn.in_proj_ba.weight": "model-00002-of-00004.safetensors",
+    "model.layers.10.linear_attn.in_proj_qkvz.weight": "model-00002-of-00004.safetensors",
+    "model.layers.10.linear_attn.norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.10.linear_attn.out_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.10.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.10.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.10.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.10.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.self_attn.k_norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.self_attn.q_norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.11.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.linear_attn.A_log": "model-00002-of-00004.safetensors",
+    "model.layers.12.linear_attn.conv1d.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.linear_attn.dt_bias": "model-00002-of-00004.safetensors",
+    "model.layers.12.linear_attn.in_proj_ba.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.linear_attn.in_proj_qkvz.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.linear_attn.norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.linear_attn.out_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.12.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.linear_attn.A_log": "model-00002-of-00004.safetensors",
+    "model.layers.13.linear_attn.conv1d.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.linear_attn.dt_bias": "model-00002-of-00004.safetensors",
+    "model.layers.13.linear_attn.in_proj_ba.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.linear_attn.in_proj_qkvz.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.linear_attn.norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.linear_attn.out_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.13.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.linear_attn.A_log": "model-00002-of-00004.safetensors",
+    "model.layers.14.linear_attn.conv1d.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.linear_attn.dt_bias": "model-00002-of-00004.safetensors",
+    "model.layers.14.linear_attn.in_proj_ba.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.linear_attn.in_proj_qkvz.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.linear_attn.norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.linear_attn.out_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.14.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.self_attn.k_norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.self_attn.q_norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.15.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.16.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.16.linear_attn.A_log": "model-00002-of-00004.safetensors",
+    "model.layers.16.linear_attn.conv1d.weight": "model-00002-of-00004.safetensors",
+    "model.layers.16.linear_attn.dt_bias": "model-00002-of-00004.safetensors",
+    "model.layers.16.linear_attn.in_proj_ba.weight": "model-00002-of-00004.safetensors",
+    "model.layers.16.linear_attn.in_proj_qkvz.weight": "model-00002-of-00004.safetensors",
+    "model.layers.16.linear_attn.norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.16.linear_attn.out_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.16.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.16.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.16.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.16.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.linear_attn.A_log": "model-00003-of-00004.safetensors",
+    "model.layers.17.linear_attn.conv1d.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.linear_attn.dt_bias": "model-00003-of-00004.safetensors",
+    "model.layers.17.linear_attn.in_proj_ba.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.linear_attn.in_proj_qkvz.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.linear_attn.norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.linear_attn.out_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.17.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.linear_attn.A_log": "model-00003-of-00004.safetensors",
+    "model.layers.18.linear_attn.conv1d.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.linear_attn.dt_bias": "model-00003-of-00004.safetensors",
+    "model.layers.18.linear_attn.in_proj_ba.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.linear_attn.in_proj_qkvz.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.linear_attn.norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.linear_attn.out_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.18.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.self_attn.k_norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.self_attn.q_norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.19.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.2.input_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.2.linear_attn.A_log": "model-00001-of-00004.safetensors",
+    "model.layers.2.linear_attn.conv1d.weight": "model-00001-of-00004.safetensors",
+    "model.layers.2.linear_attn.dt_bias": "model-00001-of-00004.safetensors",
+    "model.layers.2.linear_attn.in_proj_ba.weight": "model-00001-of-00004.safetensors",
+    "model.layers.2.linear_attn.in_proj_qkvz.weight": "model-00001-of-00004.safetensors",
+    "model.layers.2.linear_attn.norm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.2.linear_attn.out_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.2.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.2.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.2.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.20.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.20.linear_attn.A_log": "model-00003-of-00004.safetensors",
+    "model.layers.20.linear_attn.conv1d.weight": "model-00003-of-00004.safetensors",
+    "model.layers.20.linear_attn.dt_bias": "model-00003-of-00004.safetensors",
+    "model.layers.20.linear_attn.in_proj_ba.weight": "model-00003-of-00004.safetensors",
+    "model.layers.20.linear_attn.in_proj_qkvz.weight": "model-00003-of-00004.safetensors",
+    "model.layers.20.linear_attn.norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.20.linear_attn.out_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.20.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.20.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.20.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.20.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.linear_attn.A_log": "model-00003-of-00004.safetensors",
+    "model.layers.21.linear_attn.conv1d.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.linear_attn.dt_bias": "model-00003-of-00004.safetensors",
+    "model.layers.21.linear_attn.in_proj_ba.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.linear_attn.in_proj_qkvz.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.linear_attn.norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.linear_attn.out_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.21.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.linear_attn.A_log": "model-00003-of-00004.safetensors",
+    "model.layers.22.linear_attn.conv1d.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.linear_attn.dt_bias": "model-00003-of-00004.safetensors",
+    "model.layers.22.linear_attn.in_proj_ba.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.linear_attn.in_proj_qkvz.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.linear_attn.norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.linear_attn.out_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.22.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.self_attn.k_norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.self_attn.q_norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.23.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.linear_attn.A_log": "model-00003-of-00004.safetensors",
+    "model.layers.24.linear_attn.conv1d.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.linear_attn.dt_bias": "model-00003-of-00004.safetensors",
+    "model.layers.24.linear_attn.in_proj_ba.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.linear_attn.in_proj_qkvz.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.linear_attn.norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.linear_attn.out_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.24.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.linear_attn.A_log": "model-00003-of-00004.safetensors",
+    "model.layers.25.linear_attn.conv1d.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.linear_attn.dt_bias": "model-00003-of-00004.safetensors",
+    "model.layers.25.linear_attn.in_proj_ba.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.linear_attn.in_proj_qkvz.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.linear_attn.norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.linear_attn.out_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.25.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.input_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.linear_attn.A_log": "model-00003-of-00004.safetensors",
+    "model.layers.26.linear_attn.conv1d.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.linear_attn.dt_bias": "model-00003-of-00004.safetensors",
+    "model.layers.26.linear_attn.in_proj_ba.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.linear_attn.in_proj_qkvz.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.linear_attn.norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.linear_attn.out_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.mlp.down_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.26.post_attention_layernorm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.27.input_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.27.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.27.mlp.gate_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.27.mlp.up_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.27.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.27.self_attn.k_norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.27.self_attn.k_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.27.self_attn.o_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.27.self_attn.q_norm.weight": "model-00003-of-00004.safetensors",
+    "model.layers.27.self_attn.q_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.27.self_attn.v_proj.weight": "model-00003-of-00004.safetensors",
+    "model.layers.28.input_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.28.linear_attn.A_log": "model-00004-of-00004.safetensors",
+    "model.layers.28.linear_attn.conv1d.weight": "model-00004-of-00004.safetensors",
+    "model.layers.28.linear_attn.dt_bias": "model-00004-of-00004.safetensors",
+    "model.layers.28.linear_attn.in_proj_ba.weight": "model-00004-of-00004.safetensors",
+    "model.layers.28.linear_attn.in_proj_qkvz.weight": "model-00004-of-00004.safetensors",
+    "model.layers.28.linear_attn.norm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.28.linear_attn.out_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.28.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.28.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.28.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.28.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.input_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.linear_attn.A_log": "model-00004-of-00004.safetensors",
+    "model.layers.29.linear_attn.conv1d.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.linear_attn.dt_bias": "model-00004-of-00004.safetensors",
+    "model.layers.29.linear_attn.in_proj_ba.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.linear_attn.in_proj_qkvz.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.linear_attn.norm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.linear_attn.out_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.29.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.3.input_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.self_attn.k_norm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.self_attn.k_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.self_attn.o_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.self_attn.q_norm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.self_attn.q_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.3.self_attn.v_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.30.input_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.30.linear_attn.A_log": "model-00004-of-00004.safetensors",
+    "model.layers.30.linear_attn.conv1d.weight": "model-00004-of-00004.safetensors",
+    "model.layers.30.linear_attn.dt_bias": "model-00004-of-00004.safetensors",
+    "model.layers.30.linear_attn.in_proj_ba.weight": "model-00004-of-00004.safetensors",
+    "model.layers.30.linear_attn.in_proj_qkvz.weight": "model-00004-of-00004.safetensors",
+    "model.layers.30.linear_attn.norm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.30.linear_attn.out_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.30.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.30.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.30.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.30.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.input_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.mlp.down_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.mlp.gate_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.mlp.up_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.post_attention_layernorm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.self_attn.k_norm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.self_attn.k_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.self_attn.o_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.self_attn.q_norm.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.self_attn.q_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.31.self_attn.v_proj.weight": "model-00004-of-00004.safetensors",
+    "model.layers.4.input_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.4.linear_attn.A_log": "model-00001-of-00004.safetensors",
+    "model.layers.4.linear_attn.conv1d.weight": "model-00001-of-00004.safetensors",
+    "model.layers.4.linear_attn.dt_bias": "model-00001-of-00004.safetensors",
+    "model.layers.4.linear_attn.in_proj_ba.weight": "model-00001-of-00004.safetensors",
+    "model.layers.4.linear_attn.in_proj_qkvz.weight": "model-00001-of-00004.safetensors",
+    "model.layers.4.linear_attn.norm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.4.linear_attn.out_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.4.mlp.down_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.4.mlp.gate_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.4.mlp.up_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.5.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.5.linear_attn.A_log": "model-00001-of-00004.safetensors",
+    "model.layers.5.linear_attn.conv1d.weight": "model-00001-of-00004.safetensors",
+    "model.layers.5.linear_attn.dt_bias": "model-00001-of-00004.safetensors",
+    "model.layers.5.linear_attn.in_proj_ba.weight": "model-00001-of-00004.safetensors",
+    "model.layers.5.linear_attn.in_proj_qkvz.weight": "model-00001-of-00004.safetensors",
+    "model.layers.5.linear_attn.norm.weight": "model-00001-of-00004.safetensors",
+    "model.layers.5.linear_attn.out_proj.weight": "model-00001-of-00004.safetensors",
+    "model.layers.5.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.5.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.5.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.5.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.linear_attn.A_log": "model-00002-of-00004.safetensors",
+    "model.layers.6.linear_attn.conv1d.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.linear_attn.dt_bias": "model-00002-of-00004.safetensors",
+    "model.layers.6.linear_attn.in_proj_ba.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.linear_attn.in_proj_qkvz.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.linear_attn.norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.linear_attn.out_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.6.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.self_attn.k_norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.self_attn.k_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.self_attn.o_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.self_attn.q_norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.self_attn.q_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.7.self_attn.v_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.linear_attn.A_log": "model-00002-of-00004.safetensors",
+    "model.layers.8.linear_attn.conv1d.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.linear_attn.dt_bias": "model-00002-of-00004.safetensors",
+    "model.layers.8.linear_attn.in_proj_ba.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.linear_attn.in_proj_qkvz.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.linear_attn.norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.linear_attn.out_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.8.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.input_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.linear_attn.A_log": "model-00002-of-00004.safetensors",
+    "model.layers.9.linear_attn.conv1d.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.linear_attn.dt_bias": "model-00002-of-00004.safetensors",
+    "model.layers.9.linear_attn.in_proj_ba.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.linear_attn.in_proj_qkvz.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.linear_attn.norm.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.linear_attn.out_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.mlp.down_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.mlp.gate_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.mlp.up_proj.weight": "model-00002-of-00004.safetensors",
+    "model.layers.9.post_attention_layernorm.weight": "model-00002-of-00004.safetensors",
+    "model.norm.weight": "model-00004-of-00004.safetensors"
+  }
+}

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/special_tokens_map.json

@@ -0,0 +1,38 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "audio_bos_token": "<|audio_start|>",
+  "audio_eos_token": "<|audio_end|>",
+  "audio_token": "<|audio_pad|>",
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "image_token": "<|image_pad|>",
+  "pad_token": {
+    "content": "<|endoftext|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "video_token": "<|video_pad|>",
+  "vision_bos_token": "<|vision_start|>",
+  "vision_eos_token": "<|vision_end|>"
+}

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:87a7830d63fcf43bf241c3c5242e96e62dd3fdc29224ca26fed8ea333db72de4
+size 19989343

models/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42-step120/tokenizer_config.json

@@ -0,0 +1,312 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "248044": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248045": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248046": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248047": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248048": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248049": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248050": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248051": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248052": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248053": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248054": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248055": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248056": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248057": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248058": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248059": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248060": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248061": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248062": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248063": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248064": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248065": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248066": {
+      "content": "<tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248067": {
+      "content": "</tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248068": {
+      "content": "<think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248069": {
+      "content": "</think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "248070": {
+      "content": "<|audio_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248071": {
+      "content": "<|audio_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248072": {
+      "content": "<tts_pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248073": {
+      "content": "<tts_text_bos>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248074": {
+      "content": "<tts_text_eod>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248075": {
+      "content": "<tts_text_bos_single>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "248076": {
+      "content": "<|audio_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "audio_bos_token": "<|audio_start|>",
+  "audio_eos_token": "<|audio_end|>",
+  "audio_token": "<|audio_pad|>",
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {
+    "audio_bos_token": "<|audio_start|>",
+    "audio_eos_token": "<|audio_end|>",
+    "audio_token": "<|audio_pad|>",
+    "image_token": "<|image_pad|>",
+    "video_token": "<|video_pad|>",
+    "vision_bos_token": "<|vision_start|>",
+    "vision_eos_token": "<|vision_end|>"
+  },
+  "fix_mistral_regex": true,
+  "image_token": "<|image_pad|>",
+  "model_max_length": 262144,
+  "pad_token": "<|endoftext|>",
+  "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null,
+  "video_token": "<|video_pad|>",
+  "vision_bos_token": "<|vision_start|>",
+  "vision_eos_token": "<|vision_end|>"
+}

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/100.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:febbba07c5853d5702f4703dd0d733de4805892fac5b16477a54995b17414aad
+size 1489005

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/101.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6514a1bf24605897682224ab9e9feef78969c7c60a85ac9946956ceaf434e700
+size 1515259

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/102.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bf41ec60ce3ca0eb121b3aaea4d1b6d272683900c81354590db8d47e4c381f77
+size 1692589

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/103.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f291baa7f085307266d8af61bbfb168e3c59b0dd16703733e215090a6714d8cf
+size 1139913

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/104.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:61ea0000e9b8d45754e8d5211aced9bce8847556d739267558dd109892da70fa
+size 1399136

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/105.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1656f9d60cb14d546daa68ad747025f913ca23f1a523b7f8d8081712f68f9287
+size 1853646

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/81.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a1d83d1d8b621b0a4bde9c1962a4f105ec85e1eea7f6ed2a0ef4803aaeeb99b
+size 1478538

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/82.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6f22c3a5f356244a97c5e0c0226b48d78069726e38fed6bc35c99fc9929cac9c
+size 1225698

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/83.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95aee9590613e7197f25d461741189881af63bb7fe9d15c160c75f378a9adecf
+size 996009

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/84.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:716fde72ae95bb3570a54e7556382c585b2e7f7010c425cfdf1967eab666fa95
+size 1029293

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/85.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:45ad424494e05b33003373ed59be3f366372c9480fcd5425097035062c91d971
+size 1133485

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/86.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f42158e18c6ea2cfc15d2874067d254b70bf29cb8e01f5465c6314774ef73806
+size 1115345

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/87.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:44c6ab4d8dfc8f7ea2daf47ce5bbc1e1807edbc5023ef86e287547792a9e5c13
+size 1294804

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/88.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:579d27314e890c7089acefc6c3979b648d28ad7c86e0494d3420b7cd6568acfd
+size 1239431

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/89.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bdf6c70aa21a7c69ca82df20584355e831e1399caeac12e9267d8523eec5b16e
+size 1252823

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/90.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1c2a341eee261b098a22d7d65bac78c497954948975bccd17636bb46c6e4848b
+size 1416659

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/91.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b2a9c9c3b4e4f7b963aeda8ffd9e3da833569e9cfe31c0e4d700585512fd0acb
+size 1239521

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/92.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72e444627b579c92b8046c29b08108e216b8a366c6c572335fda1c8c0600353f
+size 1130327

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/93.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5342cc9f29b179e92bcccb2b34d73677e8d4a6d32c4a4de84c85c835e186c754
+size 1423131

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/94.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ec90cc80a14f42d684d5dd2b44c0b43979e371cfdbea67d73d820fef7829987
+size 1057710

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/95.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:914ed20c52527942d06b8cee6de237850959159f18367f7f9c0eac8f27336dc6
+size 1091343

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/96.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:247777084dcf95bd50161abca2f6b1f19d3a0ade2eadf4e9e9542ff6e01ab9e8
+size 1692079

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/97.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bb60fe1913f2b5319904f6a9cf42dd27f5f569b8dcb73e8f1437736a55021361
+size 1451435

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/98.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:60e59dde3cbbc4ddfcade786e314aea4f00d02995ddc160920b857aaf9eb572d
+size 1317110

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/raw_rollouts/99.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:37c2897c557f5ea049c57057b13b642d58078cc11a9b55d9f9a885cd7a25f051
+size 1513710

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/rl/trace2skill_trajectories.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:109568a0814ab406cc21f4e1b81f9585ba7e9b169793d95b7099e20a487e3a5d
+size 56299874

trajectories/qwen35-4b-docvqa-grpo-four-gpu-from-step40-seed42/trace2skill_collection_step80/sample_only/trace2skill_trajectories.jsonl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2231eb98cf968c1ab9a2454e3c714c6755d4a815e373f02c2cad45697cd6be20
+size 38235748