Lowca commited on
Commit
43dc7cc
Β·
verified Β·
1 Parent(s): e7e75d9

Add results/ (test outputs, logs) and Polish-target Uni-Sign checkpoints

Browse files
This view is limited to 50 files because it contains too many changes. Β  See raw diff
Files changed (50) hide show
  1. checkpoints/unisign/pjm_pl_ms_how2sign/best_checkpoint.pth +3 -0
  2. checkpoints/unisign/pjm_pl_si_how2sign/best_checkpoint.pth +3 -0
  3. results/README.md +45 -0
  4. results/polish/en2pl_ms_how2sign/bleurt_BLEURT-20.json +1 -0
  5. results/polish/en2pl_ms_how2sign/test_tmp_pres.txt +0 -0
  6. results/polish/en2pl_ms_how2sign/test_tmp_refs.txt +0 -0
  7. results/polish/en2pl_si_how2sign/bleurt_BLEURT-20.json +0 -0
  8. results/polish/en2pl_si_how2sign/test_tmp_pres.txt +0 -0
  9. results/polish/en2pl_si_how2sign/test_tmp_refs.txt +0 -0
  10. results/polish/pjm_pl_ms_how2sign/bleurt_BLEURT-20.json +1 -0
  11. results/polish/pjm_pl_ms_how2sign/log.txt +331 -0
  12. results/polish/pjm_pl_ms_how2sign/test_tmp_pres.txt +0 -0
  13. results/polish/pjm_pl_ms_how2sign/test_tmp_refs.txt +0 -0
  14. results/polish/pjm_pl_ms_how2sign/train.log.gz +3 -0
  15. results/polish/pjm_pl_si_how2sign/bleurt_BLEURT-20.json +0 -0
  16. results/polish/pjm_pl_si_how2sign/log.txt +504 -0
  17. results/polish/pjm_pl_si_how2sign/test_tmp_pres.txt +0 -0
  18. results/polish/pjm_pl_si_how2sign/test_tmp_refs.txt +0 -0
  19. results/polish/pjm_pl_si_how2sign/train.log.gz +3 -0
  20. results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/bleurt_Elron_bleurt-large-512.json +2942 -0
  21. results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/bleurt_lucadiliello_BLEURT-20.json +2942 -0
  22. results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/config.yaml +187 -0
  23. results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/output.log +47 -0
  24. results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/test_outputs.txt +0 -0
  25. results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/wandb-summary.json +1 -0
  26. results/spamo/2026-05-05T21-58-47_test_v30_dual_ms_scratch/config.yaml +183 -0
  27. results/spamo/2026-05-05T21-58-47_test_v30_dual_ms_scratch/output.log +46 -0
  28. results/spamo/2026-05-05T21-58-47_test_v30_dual_ms_scratch/test_outputs.txt +0 -0
  29. results/spamo/2026-05-05T21-58-47_test_v30_dual_ms_scratch/wandb-summary.json +1 -0
  30. results/spamo/2026-05-05T22-10-23_test_v31_quad_ms_scratch/config.yaml +187 -0
  31. results/spamo/2026-05-05T22-10-23_test_v31_quad_ms_scratch/output.log +48 -0
  32. results/spamo/2026-05-05T22-10-23_test_v31_quad_ms_scratch/test_outputs.txt +0 -0
  33. results/spamo/2026-05-05T22-10-23_test_v31_quad_ms_scratch/wandb-summary.json +1 -0
  34. results/spamo/2026-05-05T23-00-55_test_upstream_pjm_ms_dual/config.yaml +183 -0
  35. results/spamo/2026-05-05T23-00-55_test_upstream_pjm_ms_dual/output.log +47 -0
  36. results/spamo/2026-05-05T23-00-55_test_upstream_pjm_ms_dual/test_outputs.txt +0 -0
  37. results/spamo/2026-05-05T23-00-55_test_upstream_pjm_ms_dual/wandb-summary.json +1 -0
  38. results/spamo/2026-05-06T15-27-35_test_v32_dual_si_scratch/config.yaml +183 -0
  39. results/spamo/2026-05-06T15-27-35_test_v32_dual_si_scratch/output.log +44 -0
  40. results/spamo/2026-05-06T15-27-35_test_v32_dual_si_scratch/test_outputs.txt +0 -0
  41. results/spamo/2026-05-06T15-27-35_test_v32_dual_si_scratch/wandb-summary.json +1 -0
  42. results/spamo/2026-05-07T04-18-55_test_v33_quad_si_scratch/config.yaml +187 -0
  43. results/spamo/2026-05-07T04-18-55_test_v33_quad_si_scratch/output.log +46 -0
  44. results/spamo/2026-05-07T04-18-55_test_v33_quad_si_scratch/test_outputs.txt +0 -0
  45. results/spamo/2026-05-07T04-18-55_test_v33_quad_si_scratch/wandb-summary.json +1 -0
  46. results/spamo/2026-10-31T07-09-05_test_upstream_pjm_si_dual/bleurt_BLEURT-20.json +0 -0
  47. results/spamo/2026-10-31T07-09-05_test_upstream_pjm_si_dual/test_outputs.txt +0 -0
  48. results/spamo/2026-10-31T15-20-57_test_v27_quad_si_filtered/bleurt_BLEURT-20.json +0 -0
  49. results/spamo/2026-10-31T15-20-57_test_v27_quad_si_filtered/test_outputs.txt +0 -0
  50. results/spamo/finetune_pjm_ms.log.gz +3 -0
checkpoints/unisign/pjm_pl_ms_how2sign/best_checkpoint.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec9cb462e21579c74b3dd886eaddb18c2085f92f1d78a991504f175657b0bf1c
3
+ size 1175634096
checkpoints/unisign/pjm_pl_si_how2sign/best_checkpoint.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cbf756089fa81e66822b9522afc4bb34b8b6f5e35b10088923c5a48f6424d32
3
+ size 1175634096
results/README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Test outputs and logs
2
+
3
+ Model outputs, references, metric logs and training logs behind the CrocoSign paper. No weights; those are in
4
+ `checkpoints/` and as ONNX in `unisign/` and `spamo/`.
5
+
6
+ ## Uni-Sign (`unisign/eval_<run>/`)
7
+
8
+ `test_tmp_pres.txt` and `test_tmp_refs.txt` hold one line per test clip (`sample: <key>, prediction: ...` and
9
+ `sample: <key>, ground-truth: ...`), `log.txt` the evaluation log with BLEU, ROUGE-L and chrF, `bleurt_BLEURT-20.json`
10
+ the per-clip BLEURT-20 scores, `train.log.gz` the training log. Table 3 rows:
11
+
12
+ | Row | Directory |
13
+ |---|---|
14
+ | CSL-News MS / SI | `eval_pjm_phase3_full_ms`, `eval_pjm_phase3_full_si` |
15
+ | How2Sign MS / SI | `eval_pjm_phase3_full_ms_how2sign`, `eval_pjm_phase3_full_si_how2sign` |
16
+ | OpenASL MS / SI | `eval_pjm_phase3_full_ms_openasl`, `eval_pjm_phase3_full_si_openasl` |
17
+ | scratch MS / SI | `eval_pjm_phase3_full_ms_scratch`, `eval_pjm_phase3_full_si_scratch` |
18
+
19
+ The other directories are the second seeds (`_s43`), the chained and distilled experiments, and the SI
20
+ regularisation experiments (`_aug`, `_drop03*`). `greedy_ens.log` is the greedy ensemble selection.
21
+
22
+ ## SpaMo and Mod-SpaMo (`spamo/<run>/`)
23
+
24
+ `test_outputs.txt` holds reference and generated text per clip (lowercased, in test-set order without keys), plus
25
+ the wandb summary, config and console log of the test run where they exist. Table 3 rows:
26
+
27
+ | Row | Directory |
28
+ |---|---|
29
+ | SpaMo PHOENIX-2014T MS | `2026-05-05T23-00-55_test_upstream_pjm_ms_dual` |
30
+ | SpaMo PHOENIX-2014T SI | `2026-10-31T07-09-05_test_upstream_pjm_si_dual` |
31
+ | SpaMo scratch MS / SI | `2026-05-05T21-58-47_test_v30_dual_ms_scratch`, `2026-05-06T15-27-35_test_v32_dual_si_scratch` |
32
+ | Mod-SpaMo PHOENIX-2014T MS | `2026-05-04T09-09-26_test_v27_quad_xattn` |
33
+ | Mod-SpaMo PHOENIX-2014T SI | `2026-10-31T15-20-57_test_v27_quad_si_filtered` |
34
+ | Mod-SpaMo scratch MS / SI | `2026-05-05T22-10-23_test_v31_quad_ms_scratch`, `2026-05-07T04-18-55_test_v33_quad_si_scratch` |
35
+
36
+ `run_phoenix_si.log.gz` is the log of the SpaMo and Mod-SpaMo PHOENIX-2014T SI runs, `finetune_pjm_ms.log.gz`
37
+ the training log of the SpaMo PHOENIX-2014T MS run. BLEURT for the older SpaMo rows was computed separately and
38
+ is not stored here.
39
+
40
+ ## Polish targets (`polish/`)
41
+
42
+ `pjm_pl_{ms,si}_how2sign`: Uni-Sign How2Sign trained on Polish targets (`pl_fixed` of
43
+ `CrocoSign/pjm-data/texts/texts_fixed.csv`), weights in `checkpoints/unisign/pjm_pl_{ms,si}_how2sign/`.
44
+ `en2pl_{ms,si}_how2sign`: the English How2Sign outputs translated to Polish by a language model (Claude Sonnet).
45
+ Both are scored against `pl_fixed`; see the "Polish targets" paragraph of the paper.
results/polish/en2pl_ms_how2sign/bleurt_BLEURT-20.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"n": 2987, "mean": 0.40189960968107297, "per_sample": [0.36532172560691833, 0.144367977976799, 0.15004569292068481, 0.475974440574646, 0.4931231141090393, 0.4919888377189636, 0.687077522277832, 0.6020289063453674, 0.24977102875709534, 0.4200572371482849, 0.8044959902763367, 0.3483523726463318, 0.8628449440002441, 0.985565721988678, 0.6137216687202454, 0.7601506114006042, 0.31085336208343506, 0.8494436144828796, 0.3959192633628845, 0.14082562923431396, 0.35534363985061646, 0.22181272506713867, 0.4503054618835449, 0.5698639154434204, 0.9923543334007263, 0.2165459245443344, 0.6394700407981873, 0.3830946683883667, 0.14039155840873718, 0.23935151100158691, 0.11049884557723999, 0.17660024762153625, 0.16091544926166534, 0.9997283816337585, 0.13680250942707062, 0.2584958076477051, 0.5268515944480896, 0.27414509654045105, 0.07676464319229126, 0.12026955187320709, 0.1957036405801773, 0.4981980323791504, 0.2569637894630432, 0.2213805764913559, 0.17033571004867554, 0.7538908123970032, 0.560756504535675, 0.16996920108795166, 0.8098956942558289, 0.16465002298355103, 0.4456337094306946, 0.18884555995464325, 0.39800387620925903, 0.15583306550979614, 0.4316704273223877, 0.35693949460983276, 0.147499680519104, 0.7857553958892822, 0.40014928579330444, 0.052241772413253784, 0.2467067539691925, 0.43362778425216675, 0.07263097912073135, 0.5904923677444458, 0.3329419493675232, 0.4562145471572876, 0.5777466297149658, 0.2671351730823517, 0.46599411964416504, 0.26454252004623413, 0.2588653862476349, 0.500481128692627, 0.20003297924995422, 0.13574804365634918, 0.8932129740715027, 0.5731058120727539, 0.16530025005340576, 0.46458202600479126, 0.27312979102134705, 0.6981485486030579, 0.25567349791526794, 0.29191529750823975, 0.3575401306152344, 0.47441333532333374, 0.7122606039047241, 0.6807714700698853, 0.2996113896369934, 0.3477290868759155, 0.5524515509605408, 0.27911221981048584, 0.20913010835647583, 0.09848634898662567, 0.05382658541202545, 0.362466424703598, 0.20342078804969788, 0.3801368474960327, 0.3670439124107361, 0.0861361101269722, 0.4131585955619812, 0.38286054134368896, 0.14676699042320251, 0.44116276502609253, 0.7073009610176086, 0.045062288641929626, 0.39609354734420776, 0.5408853888511658, 0.3867347240447998, 0.13361167907714844, 0.4304032325744629, 0.4329620599746704, 0.7121391892433167, 0.8439050912857056, 0.5717125535011292, 0.6387772560119629, 0.5910243988037109, 0.2871212363243103, 0.12149415165185928, 0.5762686133384705, 0.358711302280426, 0.21784476935863495, 0.5857540369033813, 0.3142094612121582, 0.5992842316627502, 0.6564547419548035, 0.7324139475822449, 0.4079422950744629, 0.2846220135688782, 0.20020484924316406, 0.2909228205680847, 0.4883188009262085, 0.21992680430412292, 0.33357083797454834, 0.1414756178855896, 0.11413655430078506, 0.24626114964485168, 0.5280417799949646, 0.8290166258811951, 0.11510662734508514, 0.9109793305397034, 0.6185178756713867, 0.6973782777786255, 0.6964879631996155, 0.5787566900253296, 0.7597450613975525, 0.37954750657081604, 0.289931058883667, 0.2357909381389618, 0.8982458710670471, 0.1511077880859375, 0.7716262936592102, 0.6787106394767761, 0.2715030610561371, 0.3366925120353699, 0.21059779822826385, 0.9152569770812988, 0.4931994080543518, 0.61588454246521, 0.10144058614969254, 0.3333374857902527, 0.3723173141479492, 0.483009934425354, 0.14317524433135986, 0.7179175615310669, 0.8586656451225281, 0.23709753155708313, 0.4434243440628052, 0.11450397223234177, 0.20262880623340607, 0.2578350305557251, 0.5211665630340576, 0.8051069974899292, 0.5063328146934509, 0.40612995624542236, 0.323975533246994, 0.10383623093366623, 0.14776454865932465, 0.7180842161178589, 0.3280758261680603, 0.46074438095092773, 0.4164676070213318, 0.22671756148338318, 0.3058265447616577, 0.1494349241256714, 0.14792829751968384, 0.23936861753463745, 0.15407155454158783, 0.20963172614574432, 0.18406301736831665, 0.2300117313861847, 0.5467548370361328, 0.24674855172634125, 0.6618727445602417, 0.2068769633769989, 0.18283380568027496, 0.10275846719741821, 0.20050717890262604, 0.21064865589141846, 0.4584074020385742, 0.37208712100982666, 0.3524121642112732, 0.22702951729297638, 0.03616657853126526, 0.36139607429504395, 0.2800159454345703, 0.3575873374938965, 0.11356386542320251, 0.6652759909629822, 0.19428996741771698, 0.470736026763916, 0.48347169160842896, 0.2905511260032654, 0.418109655380249, 0.533134937286377, 0.3443654775619507, 0.7688494324684143, 0.16567537188529968, 0.4306049346923828, 0.4148734211921692, 0.2757953107357025, 0.582683265209198, 0.865821897983551, 0.7356013655662537, 0.2823025584220886, 0.4793214201927185, 0.1378704309463501, 0.21945850551128387, 0.23811396956443787, 0.8223487734794617, 0.863493025302887, 0.9176554083824158, 0.24581745266914368, 0.3228445053100586, 0.20147202908992767, 0.15190675854682922, 0.6800078749656677, 0.7471181750297546, 0.6616067886352539, 0.1516030877828598, 0.5413906574249268, 0.2353449910879135, 0.4430088400840759, 0.8098239302635193, 0.47869449853897095, 0.17048364877700806, 0.6232289671897888, 0.16162240505218506, 0.4225073456764221, 0.5979942083358765, 0.25218260288238525, 0.8990039229393005, 0.19264653325080872, 0.4287329912185669, 0.6328868269920349, 0.16828802227973938, 0.633200466632843, 0.14880451560020447, 0.6167209148406982, 0.7328436970710754, 0.3400558829307556, 0.6002620458602905, 0.8230385780334473, 0.20355333387851715, 0.3002683222293854, 0.11498970538377762, 0.8276697993278503, 0.25820159912109375, 0.7614163756370544, 0.35918986797332764, 0.9967108368873596, 0.518921971321106, 0.1057736724615097, 0.2503354847431183, 0.4228459596633911, 0.31243956089019775, 0.0943337082862854, 0.27639859914779663, 0.6923219561576843, 0.639546811580658, 0.24573571979999542, 0.39833682775497437, 0.10941532254219055, 0.5223857164382935, 0.7693855166435242, 0.9558145403862, 0.26156315207481384, 0.39665335416793823, 0.14999167621135712, 0.269044429063797, 0.37265974283218384, 0.8402988314628601, 0.44119083881378174, 0.5580105781555176, 0.5283351540565491, 0.206132173538208, 0.390666663646698, 0.2306818962097168, 0.5474939346313477, 0.5580204129219055, 0.16614098846912384, 0.28061962127685547, 0.7225618958473206, 0.2149490863084793, 0.24533876776695251, 0.2029537409543991, 0.3354722857475281, 0.10214623808860779, 0.7903355956077576, 0.3767155408859253, 0.16546601057052612, 0.23003584146499634, 0.4644608497619629, 0.27891165018081665, 0.8242451548576355, 0.28377556800842285, 0.37391313910484314, 0.5057311058044434, 0.56368488073349, 0.365134060382843, 0.22246196866035461, 0.49215805530548096, 0.16211268305778503, 0.5426808595657349, 0.8874804377555847, 0.23702958226203918, 0.3029816150665283, 0.35578519105911255, 0.7705284953117371, 0.18314310908317566, 0.48990702629089355, 0.4334872364997864, 0.7599521279335022, 0.8031892776489258, 0.8181119561195374, 0.2501877248287201, 0.39259374141693115, 0.21991723775863647, 0.3714831471443176, 0.37771356105804443, 0.5941811800003052, 0.3558390736579895, 0.07342006266117096, 0.6110856533050537, 0.26832807064056396, 0.10053963959217072, 0.47100138664245605, 0.6543611884117126, 0.024716809391975403, 0.3554016947746277, 0.22755232453346252, 0.5582588911056519, 0.31252509355545044, 0.2281276136636734, 0.33056509494781494, 0.7353017330169678, 0.2670828104019165, 0.2900579571723938, 0.2525264322757721, 0.07289442420005798, 0.22981995344161987, 0.33332860469818115, 0.6472599506378174, 0.6518998146057129, 0.11529670655727386, 0.12732529640197754, 0.04448237270116806, 0.6980217099189758, 0.16887402534484863, 0.6671318411827087, 0.3891258239746094, 1.012061357498169, 0.9841341376304626, 0.7768006920814514, 0.5306215882301331, 0.4844864010810852, 0.3101080358028412, 0.16223657131195068, 0.6284713745117188, 0.28301769495010376, 0.15801984071731567, 0.908689558506012, 0.713399350643158, 0.8721938729286194, 0.28230467438697815, 0.8463242053985596, 0.1380927413702011, 0.6939815282821655, 0.16462549567222595, 0.4333425760269165, 0.45189088582992554, 0.8591751456260681, 0.5986775159835815, 0.6187465786933899, 0.19015556573867798, 0.5799697637557983, 0.5835732221603394, 0.19560784101486206, 0.11591501533985138, 0.36307191848754883, 0.6262604594230652, 0.2862568497657776, 0.5596525073051453, 0.32330822944641113, 0.19652360677719116, 0.5953846573829651, 0.18698154389858246, 0.22682872414588928, 0.24907788634300232, 0.35248494148254395, 0.26532384753227234, 0.17890387773513794, 0.182450532913208, 0.6065966486930847, 0.4113010764122009, 0.7114028334617615, 0.21887463331222534, 0.5020715594291687, 0.3801741898059845, 0.5541000962257385, 0.09645277261734009, 0.2539967894554138, 0.33407899737358093, 0.5359902381896973, 0.3289870619773865, 0.2047336995601654, 0.5303810238838196, 0.37386077642440796, 0.2443484365940094, 0.36723607778549194, 0.3325832486152649, 0.27408650517463684, 0.4425022006034851, 0.1320624053478241, 0.24257129430770874, 0.22153499722480774, 0.0898832380771637, 0.4701548218727112, 0.43173110485076904, 0.5964803695678711, 0.5835044384002686, 0.357435405254364, 0.7422035336494446, 0.2398325800895691, 0.3355870246887207, 0.17215920984745026, 0.10856100171804428, 0.18592402338981628, 0.683239221572876, 0.10951349139213562, 0.7093770503997803, 0.2241993546485901, 0.3622106611728668, 0.6949432492256165, 0.5148212909698486, 0.3092462122440338, 0.2548019587993622, 0.14338594675064087, 0.7244274020195007, 0.4698522090911865, 0.7668433785438538, 1.0091254711151123, 0.4858807921409607, 0.3521704077720642, 0.18227896094322205, 0.8415030241012573, 0.8611471056938171, 0.5673017501831055, 0.33242881298065186, 0.3432157039642334, 0.3046935796737671, 0.5017580389976501, 0.4351351857185364, 0.11844190210103989, 0.09693016856908798, 0.14057323336601257, 0.5625860095024109, 0.33055537939071655, 0.6001588106155396, 0.07674562931060791, 0.2884634733200073, 0.16286224126815796, 0.22765156626701355, 0.22382494807243347, 0.3298531770706177, 0.29273897409439087, 0.4752250909805298, 0.490764856338501, 0.9841343760490417, 0.11269105225801468, 0.6363967061042786, 0.6291131973266602, 0.28292542695999146, 0.18079861998558044, 0.363157719373703, 0.22547020018100739, 0.1739366352558136, 0.056060075759887695, 0.30951040983200073, 0.4153892397880554, 0.13844089210033417, 0.4520782232284546, 0.18545925617218018, 0.4813648462295532, 0.2761862874031067, 0.38638806343078613, 0.18828415870666504, 0.8082442879676819, 0.7691823840141296, 0.12120932340621948, 0.5608708262443542, 0.42894208431243896, 0.8226507902145386, 0.4472271800041199, 0.5724764466285706, 0.2716239094734192, 0.3744984567165375, 0.14450472593307495, 0.17463719844818115, 0.27940696477890015, 0.2324802279472351, 0.264184832572937, 0.8676313757896423, 0.45535290241241455, 0.17359241843223572, 0.546010434627533, 0.4155775308609009, 0.43176335096359253, 0.12562987208366394, 0.8736449480056763, 0.8102778792381287, 0.25776928663253784, 0.7701931595802307, 0.8481372594833374, 0.32519590854644775, 0.8399679064750671, 0.8664761185646057, 0.39142104983329773, 0.5039321184158325, 0.2581773102283478, 0.2484603226184845, 0.17959913611412048, 0.8670842051506042, 0.28791162371635437, 0.27743327617645264, 0.14104142785072327, 0.5303115844726562, 0.1834634691476822, 0.7015410661697388, 0.6812989711761475, 0.6762648224830627, 0.4198039770126343, 0.18815961480140686, 0.5264521837234497, 0.32951247692108154, 0.40466803312301636, 0.3504648208618164, 0.32442790269851685, 0.8575813174247742, 0.45233404636383057, 0.36646193265914917, 0.13969773054122925, 0.19575299322605133, 0.4183477759361267, 0.5089722871780396, 0.19184496998786926, 0.6248573064804077, 0.8638084530830383, 0.18900145590305328, 0.2348857820034027, 0.34154778718948364, 0.17833229899406433, 0.1586708128452301, 0.303447425365448, 0.3610791563987732, 0.6840982437133789, 0.8980220556259155, 0.2611432671546936, 0.8286609053611755, 0.3266688585281372, 0.2683179974555969, 0.44354456663131714, 0.24032388627529144, 0.21925579011440277, 0.20407885313034058, 0.48807239532470703, 0.14877834916114807, 0.3964313864707947, 0.43985408544540405, 0.6686986088752747, 0.5386882424354553, 0.6820129752159119, 0.5539599657058716, 0.4509602189064026, 0.7895467877388, 0.14724615216255188, 0.2583458423614502, 0.1464516520500183, 0.23588192462921143, 0.13329100608825684, 0.5716352462768555, 0.3097299337387085, 0.5303666591644287, 0.872882604598999, 0.5631442666053772, 0.225791335105896, 0.5427462458610535, 0.5641793012619019, 0.12333638966083527, 0.7683677077293396, 0.36940550804138184, 0.615861713886261, 0.20333164930343628, 0.39853641390800476, 0.2081187665462494, 0.3269469738006592, 0.39717817306518555, 0.24901920557022095, 0.19101350009441376, 0.8479992747306824, 0.22163155674934387, 0.09864450991153717, 0.6617907285690308, 0.39772331714630127, 0.28646528720855713, 0.8802788853645325, 0.2564156651496887, 0.26043230295181274, 0.7458227276802063, 0.17385518550872803, 0.38352781534194946, 0.046319760382175446, 0.3225390315055847, 0.5338488221168518, 0.33917146921157837, 0.17731952667236328, 0.45937496423721313, 0.5161694288253784, 0.14248012006282806, 0.2578452527523041, 0.25933223962783813, 0.6874346137046814, 0.35543495416641235, 0.05921958386898041, 0.40445369482040405, 0.14093706011772156, 0.5190274119377136, 0.6115356087684631, 1.0271631479263306, 0.8057458400726318, 1.0448579788208008, 0.6211066842079163, 0.804030179977417, 0.5450805425643921, 0.1778312474489212, 0.09874935448169708, 0.2343476116657257, 0.26582399010658264, 0.19162246584892273, 0.49253976345062256, 0.23715713620185852, 0.43211859464645386, 0.46613234281539917, 0.6826910972595215, 0.40137821435928345, 0.22147811949253082, 0.38736480474472046, 0.27370038628578186, 0.6021484136581421, 0.8727884888648987, 0.14214572310447693, 0.36816346645355225, 0.5059385299682617, 0.39957672357559204, 0.2681717276573181, 0.56356281042099, 0.4997131824493408, 0.1425274908542633, 0.7141168713569641, 0.6886655688285828, 0.17658740282058716, 0.8006165623664856, 0.632247805595398, 0.33759409189224243, 0.0717044323682785, 0.19504791498184204, 0.44582468271255493, 0.5303057432174683, 0.5634821653366089, 0.25002413988113403, 0.22595074772834778, 0.3389015793800354, 0.34162163734436035, 0.6829081177711487, 0.13251061737537384, 0.3305007219314575, 0.10731497406959534, 0.45540738105773926, 0.737487256526947, 0.3985843062400818, 0.14913053810596466, 0.8909787535667419, 0.41231870651245117, 0.18732881546020508, 0.21961723268032074, 0.3056216239929199, 0.34028947353363037, 0.11083106696605682, 0.0907052606344223, 0.5722764134407043, 0.4605797529220581, 0.2732066810131073, 0.25090911984443665, 0.22469979524612427, 0.1433960497379303, 0.3536003828048706, 0.17833776772022247, 0.14839491248130798, 0.49965202808380127, 0.2290097177028656, 0.29169756174087524, 0.3027651309967041, 0.2674466073513031, 0.17511147260665894, 0.36220288276672363, 0.1670454442501068, 0.16123703122138977, 0.1266859471797943, 0.22317874431610107, 0.242730051279068, 0.25660890340805054, 0.2668353319168091, 0.3368077874183655, 0.5474182367324829, 0.46694785356521606, 0.41599881649017334, 0.08349001407623291, 0.5219728946685791, 0.305716335773468, 0.25981152057647705, 0.5554549694061279, 0.16902011632919312, 0.6283224821090698, 0.881041944026947, 0.30825233459472656, 0.09551489353179932, 0.5257981419563293, 0.5118386149406433, 0.278439998626709, 0.656048595905304, 0.48331737518310547, 0.4865456819534302, 0.3620195686817169, 0.19649186730384827, 0.41770273447036743, 0.5646117329597473, 0.35648053884506226, 0.09205524623394012, 0.10602548718452454, 0.4220964312553406, 0.08918273448944092, 0.26816409826278687, 0.263372540473938, 0.1465536504983902, 0.2972218692302704, 0.5444667339324951, 0.2054753303527832, 0.09232817590236664, 0.38667863607406616, 0.8918346762657166, 0.4975202679634094, 0.5479855537414551, 0.4503629207611084, 0.37751150131225586, 0.46388620138168335, 0.6205874085426331, 0.14157429337501526, 0.4654805064201355, 0.5876836776733398, 0.22678261995315552, 0.5857905745506287, 0.5364897847175598, 0.281185507774353, 0.3481740355491638, 0.4453849792480469, 0.125412255525589, 0.4584749937057495, 0.4956957697868347, 0.985695481300354, 0.2876114249229431, 0.23094908893108368, 0.5763046741485596, 0.9861380457878113, 0.2920650243759155, 0.5279566645622253, 0.15070556104183197, 0.2571091651916504, 0.9453065395355225, 0.9790518283843994, 0.49453556537628174, 0.169053316116333, 0.14569959044456482, 1.0204886198043823, 0.7214704155921936, 0.17636534571647644, 0.13267219066619873, 0.2820965051651001, 0.6094847321510315, 0.4349020719528198, 0.6313438415527344, 0.6968151926994324, 0.37665772438049316, 0.236513152718544, 0.1418994963169098, 0.26262974739074707, 0.43158525228500366, 0.13442382216453552, 0.21036580204963684, 0.19611485302448273, 0.08447560667991638, 0.22361397743225098, 0.11784470081329346, 0.3167373538017273, 0.15178194642066956, 0.35091841220855713, 0.5215554237365723, 0.48994380235671997, 0.24156589806079865, 0.1820564866065979, 0.22412030398845673, 0.4060284495353699, 0.26090309023857117, 0.3371226191520691, 0.13959766924381256, 0.17385432124137878, 0.1322009414434433, 0.2923361659049988, 0.242604061961174, 0.13690254092216492, 0.16056422889232635, 0.9063063263893127, 0.34089547395706177, 0.2482629120349884, 0.28638893365859985, 0.20446506142616272, 0.2200220376253128, 0.3407934308052063, 0.2812270522117615, 0.19591540098190308, 0.61219322681427, 0.4576573371887207, 0.7102261185646057, 0.2108035683631897, 0.17739979922771454, 0.19312652945518494, 0.39358747005462646, 0.07094457745552063, 0.47829097509384155, 0.5929891467094421, 0.776409387588501, 0.32287371158599854, 0.35438865423202515, 0.23920908570289612, 0.7316699624061584, 0.33167344331741333, 0.12085412442684174, 0.8296111226081848, 0.37825828790664673, 0.195393905043602, 0.09856639802455902, 0.11356789618730545, 0.1364176869392395, 0.3551679253578186, 0.3283417224884033, 0.31907200813293457, 0.2217060923576355, 0.8905048370361328, 0.6799857020378113, 0.5224395990371704, 0.4194301962852478, 0.12390738725662231, 0.23241986334323883, 0.3257836103439331, 0.1285826861858368, 0.37206482887268066, 0.18437838554382324, 0.16180413961410522, 0.5797035694122314, 0.49090874195098877, 0.11858966946601868, 0.5108361840248108, 0.15349769592285156, 0.3387642800807953, 0.3542329668998718, 0.4335595965385437, 0.5209317207336426, 0.8463735580444336, 0.47607994079589844, 0.21164470911026, 0.14510656893253326, 0.6502748131752014, 0.6399554014205933, 0.20669645071029663, 0.6643907427787781, 0.9470193386077881, 0.4211903214454651, 0.16112643480300903, 0.1624213308095932, 0.7647979259490967, 0.5246427059173584, 0.9139840006828308, 0.41800129413604736, 0.20841257274150848, 0.45274484157562256, 0.08542237430810928, 0.5726384520530701, 0.17413493990898132, 0.15020613372325897, 0.2806612253189087, 0.3331937789916992, 0.4207596778869629, 0.32597142457962036, 0.3181420564651489, 0.23048678040504456, 0.2087167203426361, 0.4700576066970825, 0.6487346887588501, 0.4652984142303467, 0.4567725658416748, 0.20433257520198822, 0.21335482597351074, 0.11887851357460022, 0.8403727412223816, 0.1962638795375824, 0.13758432865142822, 0.5952353477478027, 0.39636653661727905, 0.12210185080766678, 0.21329081058502197, 0.8366506099700928, 0.36281105875968933, 0.15814995765686035, 0.6003745794296265, 0.07615616917610168, 0.47302550077438354, 0.19688597321510315, 0.23574528098106384, 0.34956449270248413, 0.3242207169532776, 0.2728845179080963, 0.29345864057540894, 0.47408419847488403, 0.43203920125961304, 0.29186272621154785, 0.5074540376663208, 0.2182452529668808, 0.46533268690109253, 0.29871076345443726, 0.4253643751144409, 0.5044440627098083, 0.5350489020347595, 0.5814443230628967, 0.6748914122581482, 0.3328396677970886, 0.6487385630607605, 0.18321733176708221, 0.3095707893371582, 0.29730552434921265, 0.25577419996261597, 0.772514283657074, 0.8966256380081177, 0.12907609343528748, 0.35416358709335327, 0.40418410301208496, 0.08311247825622559, 0.6692231297492981, 0.7774489521980286, 0.3080652952194214, 0.4554895758628845, 0.4496675729751587, 0.7771273255348206, 0.4837089776992798, 0.1425846666097641, 0.04527214169502258, 0.49665844440460205, 0.17754992842674255, 0.07568217813968658, 0.5716363787651062, 0.05553460121154785, 0.6054638624191284, 0.4370904564857483, 0.3978753685951233, 0.7999148368835449, 0.4056910276412964, 0.5496336817741394, 0.26756551861763, 0.617671549320221, 0.12835413217544556, 0.6292762756347656, 0.14197535812854767, 0.17355765402317047, 0.22152592241764069, 0.48450130224227905, 0.11706588417291641, 0.13986709713935852, 0.07135772705078125, 0.7580674886703491, 0.1831812560558319, 0.16552209854125977, 0.232710599899292, 0.12849511206150055, 0.1429138332605362, 0.8461149334907532, 0.5855382084846497, 0.24374708533287048, 0.16377027332782745, 0.20274850726127625, 0.4876512885093689, 0.29992687702178955, 0.2829532325267792, 0.3066384196281433, 0.3450789451599121, 0.7763192057609558, 0.6280879974365234, 0.36962389945983887, 0.3990072011947632, 0.25881487131118774, 0.8089374899864197, 0.4189335107803345, 0.3048846125602722, 0.6956810355186462, 0.18181052803993225, 0.12340034544467926, 0.6846974492073059, 0.17222292721271515, 0.5324926972389221, 0.3973774313926697, 0.5843006372451782, 0.19540071487426758, 0.4575592279434204, 0.3350484371185303, 0.3502654433250427, 0.08717208355665207, 0.42110198736190796, 0.12049348652362823, 0.47144460678100586, 0.6387768983840942, 0.21674013137817383, 0.31105589866638184, 0.13605764508247375, 0.5530998110771179, 0.6049900054931641, 0.14980502426624298, 0.9912177920341492, 0.11512145400047302, 0.2080334722995758, 0.2763804793357849, 0.553768515586853, 0.4304860234260559, 0.6840576529502869, 0.2663881480693817, 0.7460508346557617, 0.4646052122116089, 0.3214383125305176, 0.25624945759773254, 0.6806902289390564, 0.1805802881717682, 0.32942959666252136, 0.33341240882873535, 0.7343637943267822, 0.31131070852279663, 0.1956348866224289, 0.6579565405845642, 0.7346596717834473, 0.24501225352287292, 0.6466484665870667, 0.46170544624328613, 0.37665966153144836, 0.30550283193588257, 0.37013739347457886, 0.17723211646080017, 0.17767687141895294, 0.6124117374420166, 0.3175373077392578, 0.642362654209137, 0.18574641644954681, 0.12878209352493286, 0.3644367754459381, 0.36884671449661255, 0.35019350051879883, 0.8342368006706238, 0.16569040715694427, 0.6441736817359924, 0.5944035053253174, 0.12058863788843155, 0.7256729006767273, 0.3649091124534607, 0.3596057593822479, 0.7501971125602722, 0.6092963218688965, 0.8008010983467102, 0.17558138072490692, 0.4115263819694519, 0.25076842308044434, 0.310772180557251, 0.5752643346786499, 0.414798378944397, 0.40437984466552734, 0.40109747648239136, 0.2865139842033386, 0.6163139939308167, 0.836210310459137, 0.46689021587371826, 0.2478242814540863, 0.6144335865974426, 0.6770864725112915, 0.2022152841091156, 0.0667429268360138, 0.04651927947998047, 0.12288345396518707, 0.2655790448188782, 0.9853898882865906, 0.7404066920280457, 0.0914791151881218, 0.2418290078639984, 0.4358043670654297, 0.6541951298713684, 0.550072193145752, 0.7716193795204163, 0.3957488536834717, 0.9334003329277039, 0.35406017303466797, 0.7441535592079163, 0.6652625203132629, 0.46442312002182007, 0.8223879933357239, 0.2941214442253113, 0.3698311746120453, 0.5446319580078125, 0.35199201107025146, 0.6587375998497009, 0.15631631016731262, 0.49932795763015747, 0.2958260774612427, 0.362857460975647, 0.34097087383270264, 0.28155434131622314, 0.4985616207122803, 0.2673437297344208, 0.2683536112308502, 0.5389447808265686, 0.42499762773513794, 0.9622344970703125, 0.9841340780258179, 0.3639548420906067, 0.24188759922981262, 0.6429123282432556, 0.33276307582855225, 0.16439205408096313, 0.5008624196052551, 0.16400600969791412, 0.24405917525291443, 0.743827760219574, 0.20229265093803406, 0.706697404384613, 0.3886379599571228, 0.4970414638519287, 0.399877667427063, 0.6788575649261475, 0.32727307081222534, 0.2504720687866211, 0.7391847968101501, 0.38696032762527466, 0.3417901396751404, 0.2834552824497223, 0.7702506184577942, 0.12146074324846268, 0.6721907258033752, 0.3287228047847748, 0.5770794153213501, 0.9363771080970764, 0.24721668660640717, 0.26665598154067993, 0.7445626854896545, 0.44729286432266235, 0.24022510647773743, 0.21476252377033234, 0.4857906103134155, 0.18106621503829956, 0.38026779890060425, 0.5265958309173584, 0.2958719730377197, 0.14741218090057373, 0.4830697178840637, 0.6445441842079163, 0.1807590126991272, 0.2321149706840515, 0.2906869351863861, 0.5114840269088745, 0.1412539929151535, 0.07631102204322815, 0.8330383896827698, 0.18029749393463135, 0.5834376215934753, 0.20878557860851288, 0.2423897683620453, 0.6419472098350525, 0.22046919167041779, 0.24148796498775482, 0.29356229305267334, 0.22244583070278168, 0.19316796958446503, 0.8385537266731262, 0.251070499420166, 0.5216558575630188, 0.4454149007797241, 0.30912667512893677, 0.5130100250244141, 0.13947778940200806, 0.5460660457611084, 0.22913262248039246, 0.10865316540002823, 0.652466893196106, 0.4169515371322632, 0.7060227394104004, 0.10068459808826447, 0.2865464687347412, 0.24926923215389252, 0.13492506742477417, 0.14468450844287872, 0.21503780782222748, 0.15676650404930115, 0.13736481964588165, 0.1018606573343277, 0.2737985849380493, 0.3013925552368164, 0.30544042587280273, 0.32531845569610596, 0.4836583137512207, 0.21235515177249908, 0.6869080662727356, 0.8331589102745056, 0.2805935740470886, 0.43378615379333496, 0.40583640336990356, 0.21438071131706238, 0.2876776456832886, 0.11236534267663956, 0.8924165368080139, 0.18332892656326294, 0.4429861307144165, 0.7219208478927612, 0.2654169201850891, 0.23603779077529907, 0.8079383969306946, 0.44973307847976685, 0.7018660306930542, 0.5934991836547852, 0.3435973823070526, 0.8490044474601746, 0.8648533225059509, 0.15922436118125916, 0.17807349562644958, 0.12224748730659485, 0.719402015209198, 0.514533281326294, 0.1523243933916092, 0.13363656401634216, 0.16367360949516296, 0.15478235483169556, 0.3402795195579529, 0.10779061913490295, 0.3646281361579895, 0.44005531072616577, 0.27836543321609497, 0.634800374507904, 0.4271608591079712, 0.17169921100139618, 0.22407415509223938, 0.10731258988380432, 0.366235613822937, 0.5963388085365295, 0.6920066475868225, 0.23014554381370544, 0.1964418590068817, 0.23554620146751404, 0.24906335771083832, 0.26313239336013794, 1.0197713375091553, 0.6547755599021912, 0.32031017541885376, 0.41237765550613403, 0.651565670967102, 0.4380335211753845, 0.4365691542625427, 0.557061493396759, 0.8493202328681946, 0.6053533554077148, 0.8094397187232971, 0.30760353803634644, 0.17113350331783295, 0.15819066762924194, 0.6207509636878967, 0.2674317955970764, 0.18580327928066254, 0.18316280841827393, 0.6833357214927673, 0.08111067861318588, 0.3273679316043854, 0.4427942633628845, 0.28490781784057617, 0.3351582884788513, 0.7961620092391968, 0.8572580814361572, 0.1673905849456787, 0.5734205842018127, 0.4601122736930847, 0.6147503852844238, 0.7790549993515015, 0.5078544616699219, 0.5000020265579224, 0.4501841068267822, 0.21085627377033234, 0.22551068663597107, 0.299235463142395, 0.26879969239234924, 0.3500661551952362, 0.32755523920059204, 0.4778149127960205, 0.24686211347579956, 0.6694344878196716, 0.44874006509780884, 0.14592713117599487, 0.11057204008102417, 0.6300880908966064, 0.46756649017333984, 0.1688081920146942, 0.270323246717453, 0.1872144341468811, 0.1810394674539566, 0.32288724184036255, 0.21434125304222107, 0.9673076272010803, 0.683643639087677, 0.7017204165458679, 0.33468031883239746, 0.6072729229927063, 0.6619632840156555, 0.3323666453361511, 0.19531241059303284, 0.15423348546028137, 0.16512379050254822, 0.4913906455039978, 0.47299516201019287, 0.14085844159126282, 0.6268612146377563, 0.5133826732635498, 0.44938230514526367, 0.3288728594779968, 0.32848578691482544, 0.3887389004230499, 0.2913983464241028, 0.2350715845823288, 0.7681670784950256, 0.30010223388671875, 0.49537551403045654, 0.8294707536697388, 0.7037040591239929, 0.19528062641620636, 0.4709409475326538, 0.6283119916915894, 0.7959991693496704, 0.4580492377281189, 0.5930723547935486, 0.22047725319862366, 0.48098015785217285, 0.7227135300636292, 0.1661493480205536, 0.23402920365333557, 0.2382379174232483, 0.5061658024787903, 0.26411697268486023, 0.19096647202968597, 0.6464909315109253, 0.1788381040096283, 0.17971158027648926, 0.2634960114955902, 0.28968364000320435, 0.10438087582588196, 0.31441330909729004, 0.28835564851760864, 0.7597911953926086, 0.4582086205482483, 0.36306989192962646, 0.8099856972694397, 0.35417479276657104, 0.2231958955526352, 0.3005549907684326, 0.6474955677986145, 0.47941267490386963, 0.29827308654785156, 0.3845522999763489, 0.27880972623825073, 0.10620037466287613, 0.16049852967262268, 0.30839014053344727, 0.13530194759368896, 0.10553906857967377, 0.17666780948638916, 0.30335426330566406, 0.285521000623703, 0.41132330894470215, 0.3453720211982727, 0.33891934156417847, 0.3169317841529846, 0.12899744510650635, 0.44611626863479614, 0.5865164399147034, 0.5923678874969482, 0.658149778842926, 0.4090365171432495, 0.967824399471283, 0.44385361671447754, 0.4045957922935486, 0.11616969108581543, 0.3276846706867218, 0.6604698300361633, 0.12348546087741852, 0.1586727350950241, 0.33180874586105347, 0.3512495160102844, 0.7288452982902527, 0.44434887170791626, 0.2281089872121811, 0.32416510581970215, 0.2605352997779846, 0.3632892370223999, 0.42946767807006836, 0.1449909657239914, 0.9594919085502625, 0.2505912482738495, 0.44879066944122314, 0.3241186738014221, 0.5936365723609924, 0.28879812359809875, 0.5536184310913086, 0.6107280850410461, 0.6406134366989136, 0.1879541128873825, 0.1944228708744049, 0.3365742564201355, 0.322989284992218, 0.2678912281990051, 0.2985694408416748, 0.27359652519226074, 0.35677051544189453, 0.453940749168396, 0.23106485605239868, 1.0038846731185913, 0.5297061800956726, 0.035133667290210724, 0.2173720747232437, 0.6494706869125366, 0.3054203987121582, 0.09929551184177399, 0.6848515868186951, 0.08974166214466095, 0.48280906677246094, 0.18819725513458252, 0.03662112355232239, 0.8889736533164978, 0.25131919980049133, 1.0721304416656494, 0.3341926336288452, 0.2293766736984253, 0.2316133677959442, 0.11818036437034607, 0.17249342799186707, 0.4617966413497925, 0.3732719123363495, 0.7633984088897705, 0.32764455676078796, 0.5812910795211792, 0.4110208749771118, 0.2674368619918823, 0.4371541142463684, 0.6038306355476379, 0.22371748089790344, 0.7137296199798584, 0.7089266180992126, 0.30568766593933105, 0.465529203414917, 0.3214316964149475, 0.262721985578537, 0.6587286591529846, 0.10121496766805649, 0.535922646522522, 0.32838624715805054, 0.7823739647865295, 0.40640342235565186, 0.26588672399520874, 0.1673813909292221, 0.6595762968063354, 0.9054927825927734, 0.25301796197891235, 0.6493387818336487, 0.3184124231338501, 0.35845261812210083, 0.24461445212364197, 0.3240448236465454, 0.5426025390625, 0.3524487614631653, 0.719064474105835, 0.420826256275177, 0.8465336561203003, 0.22127047181129456, 0.44455182552337646, 0.12320385128259659, 0.2875363230705261, 0.07849298417568207, 0.16410718858242035, 0.1928369700908661, 0.15571925044059753, 0.279880166053772, 0.3865731358528137, 0.15533098578453064, 0.5981552004814148, 0.4158925414085388, 0.24906575679779053, 0.504896879196167, 0.5291441679000854, 0.17435145378112793, 0.5088358521461487, 0.9841343760490417, 0.23457086086273193, 0.4037069082260132, 0.26759153604507446, 0.18226358294487, 0.6751809120178223, 0.1439586877822876, 0.10657808929681778, 0.32767385244369507, 0.419117271900177, 0.04605074226856232, 0.24767503142356873, 0.523580014705658, 0.18934020400047302, 0.8481557965278625, 0.17323477566242218, 0.3379652500152588, 0.45839327573776245, 0.34974759817123413, 0.3403041362762451, 0.19302615523338318, 0.7765472531318665, 0.4989914298057556, 0.5676223635673523, 0.2737997770309448, 0.7377859950065613, 0.3012263774871826, 0.30260902643203735, 0.5148159861564636, 0.2123214602470398, 0.36043959856033325, 0.9322226643562317, 0.6654996275901794, 0.17140980064868927, 0.5390359163284302, 0.7746539115905762, 0.3393573760986328, 0.25909513235092163, 0.45732802152633667, 0.7773935198783875, 0.2243688553571701, 0.33826732635498047, 0.11943915486335754, 0.4295274615287781, 0.6438485383987427, 0.2971881628036499, 0.5057163238525391, 0.24211743474006653, 0.23481813073158264, 0.816204845905304, 0.42779237031936646, 0.4314030408859253, 0.3848140239715576, 0.22313746809959412, 0.4325062036514282, 0.11284327507019043, 0.7353169322013855, 0.419796884059906, 0.3083641529083252, 0.17764365673065186, 0.26793739199638367, 0.10283942520618439, 0.9350060820579529, 0.1749276965856552, 0.11801711469888687, 0.16609233617782593, 0.3771994709968567, 0.6611338257789612, 0.2403518408536911, 0.9197505116462708, 0.3315105438232422, 0.277574360370636, 0.30059123039245605, 0.5462926030158997, 0.9497478008270264, 0.6574898362159729, 0.725809633731842, 0.3758432865142822, 0.20769117772579193, 0.36653196811676025, 0.2871295213699341, 0.3124651312828064, 0.4736487865447998, 0.21340028941631317, 0.11863890290260315, 0.1350180059671402, 0.8375174403190613, 0.3798799514770508, 0.1437753438949585, 0.5214242935180664, 0.750747799873352, 0.3388475775718689, 0.2820298671722412, 0.3637629747390747, 0.4457676410675049, 0.21002958714962006, 0.41058629751205444, 0.23588773608207703, 0.6725196242332458, 0.19140949845314026, 0.2801893949508667, 0.1337985247373581, 0.0540420264005661, 0.6822049021720886, 0.10792101174592972, 0.5030953884124756, 0.6759595274925232, 0.506066083908081, 0.21116875112056732, 0.8956556916236877, 0.17742472887039185, 0.37979239225387573, 0.26676875352859497, 0.4002681374549866, 0.22809550166130066, 0.47885316610336304, 0.620606005191803, 0.3192935585975647, 0.37420985102653503, 0.3043752908706665, 0.481120228767395, 0.44662266969680786, 0.2619338035583496, 0.7044070363044739, 0.21663129329681396, 0.050155654549598694, 0.4407344460487366, 0.32223355770111084, 0.16819503903388977, 0.32667627930641174, 0.12853719294071198, 0.3656615614891052, 0.37531840801239014, 0.6636954545974731, 0.3256995677947998, 0.8039862513542175, 0.10121847689151764, 0.06410494446754456, 0.12272502481937408, 0.42824381589889526, 0.39267075061798096, 0.30544334650039673, 0.2753891348838806, 0.21857641637325287, 0.930260956287384, 0.5806536674499512, 0.35671985149383545, 0.8654194474220276, 0.5381552577018738, 0.511344313621521, 0.30355966091156006, 0.13528943061828613, 0.21982626616954803, 0.5631065964698792, 0.5453500151634216, 0.15230399370193481, 0.4546726942062378, 0.3718114495277405, 0.4994168281555176, 0.2885597050189972, 0.20180411636829376, 0.6850230693817139, 0.20173653960227966, 0.7813094258308411, 0.6330420970916748, 0.14198154211044312, 0.32888495922088623, 0.25092455744743347, 0.08242195099592209, 0.14915749430656433, 0.11957047134637833, 0.2543347477912903, 0.593422532081604, 0.16991937160491943, 0.15732915699481964, 0.41909170150756836, 0.5468990802764893, 0.22911086678504944, 0.16297927498817444, 0.20300757884979248, 0.3728192150592804, 0.5011278390884399, 0.1068849265575409, 0.4467606544494629, 0.3796237111091614, 0.5070068836212158, 0.20719321072101593, 0.5357294082641602, 0.2218189835548401, 0.7398020625114441, 0.29437947273254395, 0.14197832345962524, 0.1681472659111023, 0.5231274366378784, 0.40926533937454224, 1.0160201787948608, 0.30776625871658325, 0.12615619599819183, 0.46516621112823486, 0.17037442326545715, 0.07274270802736282, 0.47694259881973267, 0.9931471943855286, 1.0186830759048462, 0.14628390967845917, 0.0874343067407608, 0.28902411460876465, 0.22090980410575867, 0.6846943497657776, 0.3659623861312866, 0.1875903159379959, 0.20334625244140625, 0.22924068570137024, 0.48186051845550537, 0.30797597765922546, 0.5375920534133911, 0.20984366536140442, 0.7880463004112244, 0.8264710307121277, 0.29007917642593384, 0.7198771834373474, 0.2003493309020996, 0.8372549414634705, 0.75506192445755, 0.9047346115112305, 0.8005644679069519, 0.34369564056396484, 0.8152270317077637, 0.16664837300777435, 0.11255668103694916, 0.29633551836013794, 0.21970921754837036, 0.12137345224618912, 0.4952148199081421, 0.20253843069076538, 0.167982280254364, 0.6963351964950562, 0.34742915630340576, 0.3309163451194763, 0.4887571930885315, 0.2878565192222595, 0.23327895998954773, 0.21852636337280273, 0.6702880263328552, 0.20600251853466034, 0.14642541110515594, 0.8465309143066406, 0.1801246553659439, 0.3454136252403259, 0.14447256922721863, 0.26045504212379456, 0.37072819471359253, 0.2100503295660019, 0.3529110550880432, 0.8946447968482971, 0.4409868121147156, 0.3415953516960144, 0.4948585629463196, 0.26490867137908936, 0.17093072831630707, 0.6453274488449097, 0.36079466342926025, 0.6713635325431824, 0.5874782204627991, 0.21015071868896484, 0.38201314210891724, 0.38541221618652344, 0.4291587471961975, 0.14068934321403503, 0.07457892596721649, 0.1918240487575531, 0.22616061568260193, 0.3096413016319275, 0.1840749979019165, 0.537122368812561, 0.5148598551750183, 0.3669877052307129, 0.8910053372383118, 0.6049721240997314, 0.438096284866333, 0.6523290276527405, 0.5087506771087646, 0.29732006788253784, 0.3064161539077759, 0.6412487626075745, 0.41135597229003906, 0.31083494424819946, 0.5921598672866821, 0.25020647048950195, 0.5391825437545776, 0.6388198733329773, 0.645117461681366, 0.44217967987060547, 0.42474365234375, 0.29749101400375366, 0.34631288051605225, 0.4325215220451355, 0.10468822717666626, 0.8383656740188599, 0.0661686509847641, 0.20096847414970398, 0.3557298183441162, 0.7494779229164124, 0.434451699256897, 0.24803060293197632, 0.5308353304862976, 0.2653612792491913, 0.8251321315765381, 0.3405909538269043, 0.12604835629463196, 0.19759368896484375, 0.9917656779289246, 0.29547107219696045, 1.0524595975875854, 1.0213512182235718, 0.5022454857826233, 0.22455060482025146, 0.6979803442955017, 0.4648634195327759, 0.267171174287796, 0.09544582664966583, 0.28248104453086853, 0.3318125605583191, 0.562826931476593, 0.48257559537887573, 0.44882792234420776, 0.7540594935417175, 0.7956205606460571, 0.32114076614379883, 0.4792287349700928, 0.3069087266921997, 0.6875165104866028, 0.8889995217323303, 0.7210214734077454, 0.6979963779449463, 0.44235819578170776, 0.26932618021965027, 0.9630442261695862, 0.6044361591339111, 0.3152081370353699, 0.06762924790382385, 0.7928215861320496, 0.47050923109054565, 0.4577677845954895, 0.5875110626220703, 0.0672634094953537, 0.3632270097732544, 0.6495052576065063, 0.7498628497123718, 0.360647976398468, 0.7880483269691467, 0.29179614782333374, 0.3683626055717468, 0.08888792991638184, 0.21716396510601044, 1.0249428749084473, 0.19200599193572998, 0.2213788628578186, 0.4566754102706909, 0.14451700448989868, 0.13387295603752136, 0.41192376613616943, 0.5742925405502319, 0.35215336084365845, 0.6950015425682068, 0.14422212541103363, 0.3002323806285858, 0.1888590157032013, 0.39324313402175903, 0.3144378662109375, 0.37631309032440186, 0.502377450466156, 0.3911462426185608, 0.7573860883712769, 0.52877277135849, 0.23872512578964233, 0.2092563658952713, 0.2285604178905487, 0.7678926587104797, 0.1841249167919159, 0.14055532217025757, 0.1868268847465515, 0.48243921995162964, 0.4997972846031189, 0.5787707567214966, 0.5594953298568726, 0.3332415819168091, 0.5810223817825317, 0.5584262609481812, 0.3342076539993286, 0.5447925925254822, 0.26028692722320557, 0.47190696001052856, 0.4672357439994812, 0.2796715795993805, 0.22488969564437866, 0.22388696670532227, 0.42338746786117554, 0.10588376969099045, 0.15002727508544922, 0.5698518753051758, 0.33545899391174316, 0.26575618982315063, 0.08073392510414124, 0.2418484389781952, 0.33721762895584106, 0.5853995084762573, 0.7864438891410828, 0.460316002368927, 0.5635525584220886, 0.11801832914352417, 0.47446900606155396, 0.21322107315063477, 0.27815860509872437, 0.8862494826316833, 0.7168165445327759, 0.34418267011642456, 0.357330858707428, 0.5588562488555908, 0.22160464525222778, 0.4739806652069092, 0.592658519744873, 1.0139509439468384, 0.5251863598823547, 0.7914562821388245, 0.5364854335784912, 0.21639616787433624, 0.4912618398666382, 0.918143093585968, 0.918144166469574, 0.11275138705968857, 0.6426761746406555, 0.9991554617881775, 0.5653617978096008, 0.24966536462306976, 0.19848614931106567, 0.2862151861190796, 0.16852813959121704, 0.6055692434310913, 0.4599188566207886, 0.7600597739219666, 0.24248775839805603, 0.41318202018737793, 0.6857089400291443, 0.1384032815694809, 0.3556082844734192, 0.05014464259147644, 0.12071375548839569, 0.11734329164028168, 0.2265559732913971, 0.4505664110183716, 0.29388755559921265, 0.12622344493865967, 0.7477685809135437, 0.14215941727161407, 0.6470017433166504, 0.2677045464515686, 0.25906145572662354, 0.37093237042427063, 0.422130823135376, 0.150203675031662, 0.29199039936065674, 0.4220890998840332, 0.4723091721534729, 0.25367218255996704, 0.14330781996250153, 0.45780473947525024, 0.7505834698677063, 0.2307981252670288, 0.20097306370735168, 0.5037896037101746, 0.09471529722213745, 0.19378459453582764, 0.28926897048950195, 0.5473071336746216, 0.16214588284492493, 0.2311590164899826, 0.6524303555488586, 0.5991240739822388, 0.13096866011619568, 0.14610198140144348, 0.383578896522522, 0.8317371010780334, 0.16769760847091675, 0.18041107058525085, 0.6133858561515808, 0.2681516110897064, 0.389340877532959, 0.12402047216892242, 0.21814432740211487, 0.0850311741232872, 0.3985498547554016, 0.5478551983833313, 0.2646541893482208, 0.47330981492996216, 0.0017540305852890015, 0.7761744260787964, 0.13078361749649048, 0.17074111104011536, 0.47130441665649414, 0.7390767335891724, 0.2826920747756958, 0.4020887613296509, 0.3347211480140686, 0.5552420020103455, 0.7388977408409119, 0.46239644289016724, 0.5098254084587097, 0.8779393434524536, 0.23246292769908905, 0.3648185729980469, 0.442241907119751, 0.284156858921051, 0.17970341444015503, 0.36217886209487915, 0.6937401294708252, 0.42581629753112793, 0.9138182997703552, 0.2036202996969223, 0.48320698738098145, 0.6438655853271484, 0.08393893390893936, 1.0277777910232544, 0.7972196936607361, 0.17264673113822937, 0.17772109806537628, 0.15280136466026306, 0.9841340780258179, 0.2441558837890625, 0.39617353677749634, 0.040828488767147064, 0.688961386680603, 1.0400426387786865, 0.5065573453903198, 0.19803956151008606, 0.28006815910339355, 0.33696281909942627, 0.5371149182319641, 0.5793029069900513, 0.13019418716430664, 0.45415276288986206, 0.9725379943847656, 0.4006558656692505, 0.2162466049194336, 0.18959230184555054, 0.35482877492904663, 0.2049424946308136, 0.7954709529876709, 0.2320646196603775, 0.5211020708084106, 0.2199118286371231, 0.6329289674758911, 0.668511152267456, 0.1788310706615448, 0.14962545037269592, 0.1288548707962036, 0.1185927614569664, 0.19958381354808807, 0.3483823537826538, 0.38833558559417725, 0.5992277264595032, 0.32714515924453735, 0.2832508385181427, 0.12741494178771973, 0.7354007363319397, 0.21664178371429443, 0.6279017329216003, 0.1983463168144226, 0.597518801689148, 0.0841132402420044, 0.060256630182266235, 0.2352423369884491, 0.4199584722518921, 0.4025983214378357, 0.9332302212715149, 0.2804315984249115, 0.5745454430580139, 0.3413987159729004, 0.392414391040802, 0.48764121532440186, 0.1626039445400238, 0.47613024711608887, 0.06350375711917877, 0.19418923556804657, 0.29355406761169434, 0.21671125292778015, 0.35054945945739746, 0.2832335829734802, 0.18382439017295837, 0.39542317390441895, 0.23928117752075195, 0.08822198957204819, 0.5155990719795227, 0.3284691572189331, 0.28378188610076904, 0.6149255037307739, 0.09271680563688278, 0.381281316280365, 0.12902936339378357, 0.7982583045959473, 0.5668277740478516, 0.5230211019515991, 0.10254918038845062, 0.42336565256118774, 0.21618270874023438, 0.2868053615093231, 0.19704261422157288, 0.5843429565429688, 0.3064090609550476, 0.3073607087135315, 0.6304144859313965, 0.3581547141075134, 0.37684160470962524, 0.09434712678194046, 0.30327707529067993, 0.17151078581809998, 0.10454568266868591, 0.375932514667511, 0.3442639708518982, 0.7122480869293213, 0.22412550449371338, 0.3770979642868042, 0.42318350076675415, 0.6137910485267639, 0.2178092747926712, 0.20925036072731018, 0.4844370484352112, 0.6339008808135986, 0.3747496008872986, 0.15217623114585876, 0.19862490892410278, 0.6644327640533447, 0.5759388208389282, 0.4321332573890686, 0.11029241979122162, 0.08644182235002518, 0.2707943916320801, 0.32007747888565063, 0.09651616215705872, 0.6473225951194763, 0.22617852687835693, 0.911163866519928, 0.6883285641670227, 0.6978508830070496, 0.25482118129730225, 0.9477805495262146, 0.33319228887557983, 0.6624164581298828, 0.6252413988113403, 0.43898653984069824, 0.15260091423988342, 0.6275535225868225, 0.19578081369400024, 0.5196964740753174, 1.0075541734695435, 0.5490984916687012, 0.6156554222106934, 0.4047282934188843, 0.3901863396167755, 0.2747764587402344, 0.14703315496444702, 0.32895851135253906, 0.2477828860282898, 0.1966671347618103, 0.07011280953884125, 0.7791954874992371, 0.16380925476551056, 0.4053316116333008, 0.4789356589317322, 0.4158981442451477, 0.5449565052986145, 0.39607006311416626, 0.42068278789520264, 0.4497554302215576, 0.537784993648529, 0.2163771241903305, 0.23401615023612976, 0.5655840039253235, 0.11368255317211151, 0.5339077115058899, 0.10690642148256302, 0.6695763468742371, 0.4141659140586853, 0.38019049167633057, 0.7322983145713806, 0.7914376854896545, 0.6518479585647583, 0.42491793632507324, 0.6013043522834778, 0.9071211218833923, 0.2795422375202179, 0.03352838754653931, 0.3078811764717102, 0.418923020362854, 0.15539103746414185, 0.7626184821128845, 0.1330445110797882, 0.1644527018070221, 0.25293079018592834, 0.7926172614097595, 0.35770201683044434, 0.15404129028320312, 0.29942357540130615, 0.33998751640319824, 0.11291062831878662, 0.2863079309463501, 0.5158814191818237, 0.2955569624900818, 0.5449284315109253, 0.4603455066680908, 0.3537907004356384, 0.3837663531303406, 0.3523247241973877, 0.4726138710975647, 0.4542914032936096, 0.6200686693191528, 0.4820019006729126, 0.16144083440303802, 0.3507418632507324, 0.29239481687545776, 0.33600908517837524, 0.5684581995010376, 0.3663938641548157, 0.15159137547016144, 0.5397487878799438, 0.22809848189353943, 0.1893380880355835, 0.4584188461303711, 0.2998807430267334, 0.30676132440567017, 0.23069283366203308, 0.28952398896217346, 0.6275064945220947, 0.513856053352356, 0.21882914006710052, 1.0721310377120972, 0.26026004552841187, 0.7138834595680237, 0.2328246682882309, 0.5371206998825073, 0.3534347414970398, 0.2249738872051239, 0.38160842657089233, 0.1792384684085846, 0.25608891248703003, 0.5174841284751892, 0.09227706491947174, 0.13628169894218445, 0.3065788149833679, 0.5891026258468628, 0.6988025307655334, 0.514038622379303, 0.13020819425582886, 0.6853237152099609, 0.4327812194824219, 0.5918034911155701, 0.19562214612960815, 0.18199482560157776, 0.0872080847620964, 0.8000930547714233, 0.4592224359512329, 0.39743131399154663, 0.5336841940879822, 0.574009120464325, 0.47531217336654663, 0.3869626522064209, 0.06198854744434357, 0.1288580596446991, 0.6934106945991516, 0.2756255865097046, 0.2991679906845093, 0.2353830486536026, 0.30247899889945984, 0.6127631664276123, 0.65058833360672, 0.29246366024017334, 0.14330655336380005, 0.17676836252212524, 0.12097031623125076, 0.1870710849761963, 0.2655794024467468, 0.0942097082734108, 1.0022473335266113, 0.4555986523628235, 0.6435552835464478, 0.6871472001075745, 0.31668972969055176, 0.2560274004936218, 0.6973220705986023, 0.733571469783783, 0.09048569202423096, 0.3954566717147827, 0.18791267275810242, 0.3446524143218994, 0.3802450895309448, 0.8443870544433594, 0.5753200650215149, 0.3590296804904938, 0.5018932223320007, 0.47951942682266235, 0.2330372929573059, 0.6451445817947388, 0.31749796867370605, 0.48063361644744873, 0.11908097565174103, 0.44793128967285156, 0.5403709411621094, 0.5274882316589355, 0.5396013259887695, 0.5003172755241394, 0.6214971542358398, 0.9990357756614685, 0.642231285572052, 0.3259090781211853, 0.6559860706329346, 0.5205643773078918, 0.1799057424068451, 0.3674958348274231, 0.1349462866783142, 0.36863723397254944, 0.4953063726425171, 0.0927758738398552, 0.16716697812080383, 0.6770972609519958, 0.9261069893836975, 0.32929766178131104, 0.8786606788635254, 0.3096610903739929, 0.1435668021440506, 0.5954086184501648, 0.6607033610343933, 0.20381778478622437, 0.510205864906311, 0.3697960376739502, 0.3323501944541931, 0.6204112768173218, 0.7030287384986877, 0.328188955783844, 0.7219103574752808, 0.4214221239089966, 0.2751210331916809, 0.49229902029037476, 0.7397462725639343, 0.790118396282196, 0.6342868208885193, 0.17413292825222015, 0.4643964171409607, 0.8091645836830139, 0.28424912691116333, 0.5233379602432251, 0.9854941368103027, 0.6613062024116516, 0.34574252367019653, 0.18249493837356567, 0.13747677206993103, 0.275665819644928, 0.6007751822471619, 0.8766146302223206, 1.0189709663391113, 0.707108199596405, 0.38763558864593506, 0.24318864941596985, 0.19419176876544952, 0.21184666454792023, 0.17740517854690552, 0.1718035638332367, 0.12932196259498596, 0.19326746463775635, 0.11937075853347778, 0.4275166988372803, 0.44543880224227905, 0.05113212764263153, 0.22119569778442383, 0.30660635232925415, 0.2620631456375122, 0.398578405380249, 0.08948655426502228, 0.27894681692123413, 0.1967543363571167, 0.8977293372154236, 0.8362380862236023, 0.2150181382894516, 0.5389363765716553, 0.8882135152816772, 0.24774062633514404, 1.0448566675186157, 0.43455976247787476, 0.715131402015686, 0.7404069304466248, 0.7526137232780457, 0.5372328162193298, 0.4153820276260376, 0.3558613061904907, 0.6612797379493713, 0.5003130435943604, 0.15421560406684875, 0.5501816272735596, 0.3505072593688965, 0.24631370604038239, 0.22134745121002197, 0.23342782258987427, 0.27428722381591797, 0.18285545706748962, 0.16740846633911133, 0.3138335943222046, 0.3498693108558655, 0.46914100646972656, 0.49456650018692017, 0.4266689419746399, 0.1551017165184021, 0.2807774543762207, 0.30007097125053406, 0.38784080743789673, 0.11714974790811539, 0.12863099575042725, 0.3054296374320984, 0.4545241594314575, 0.13122569024562836, 0.09723783284425735, 0.2552860975265503, 0.24752181768417358, 0.17010480165481567, 0.23637518286705017, 0.19085748493671417, 0.39154350757598877, 0.27277156710624695, 0.34027230739593506, 0.5365184545516968, 0.4800795912742615, 0.18934696912765503, 0.216312438249588, 0.3976418375968933, 0.40036582946777344, 0.41271764039993286, 0.7347082495689392, 0.6729307770729065, 0.2264217734336853, 0.8935356140136719, 0.6914992928504944, 0.35975027084350586, 0.5990974307060242, 0.15673331916332245, 0.8391387462615967, 0.4100216031074524, 0.17512397468090057, 0.39362549781799316, 0.24093729257583618, 0.6639031767845154, 0.4383302927017212, 0.20080535113811493, 0.6712459921836853, 0.23671817779541016, 0.5679442286491394, 0.28892630338668823, 0.3777279853820801, 0.1545070856809616, 0.30278027057647705, 0.1933760941028595, 0.1062086820602417, 0.1799841821193695, 0.1621266007423401, 0.4527691602706909, 0.2767369747161865, 0.6473627686500549, 0.43310123682022095, 0.1394195854663849, 0.07914634048938751, 0.5138794183731079, 0.08436022698879242, 0.21069179475307465, 0.10051336139440536, 0.1718587577342987, 0.5457875728607178, 0.6099219918251038, 0.36178117990493774, 0.2839242219924927, 0.49014532566070557, 0.9933390617370605, 0.4047005772590637, 0.6223705410957336, 0.29633820056915283, 0.3407941460609436, 0.4716888666152954, 0.22210459411144257, 0.42468082904815674, 0.12518206238746643, 0.3265334367752075, 0.4143151044845581, 0.5721340775489807, 0.11808514595031738, 0.26988685131073, 0.3606329560279846, 0.2855886220932007, 0.599842369556427, 0.423342764377594, 0.547748863697052, 0.13740761578083038, 0.2919656038284302, 0.6437198519706726, 0.05305154621601105, 0.7169368863105774, 0.21796035766601562, 0.07224653661251068, 0.26584485173225403, 0.08551566302776337, 0.2551043927669525, 0.43346256017684937, 0.34599795937538147, 0.3963335156440735, 0.5442888140678406, 0.14681309461593628, 0.15445177257061005, 0.7400970458984375, 0.31994301080703735, 0.6052374243736267, 0.73919278383255, 0.8779107332229614, 0.4689376950263977, 0.10326187312602997, 0.5541331171989441, 0.8374882340431213, 0.6350744366645813, 0.30153366923332214, 0.1537785530090332, 0.8466857671737671, 0.44936996698379517, 0.2076573371887207, 0.5019850134849548, 0.5183776021003723, 0.8982483148574829, 0.1876181811094284, 0.10742362588644028, 0.5106226801872253, 0.25280097126960754, 0.4694831967353821, 0.30167847871780396, 0.5196173787117004, 0.2574833333492279, 0.15571807324886322, 0.3665482997894287, 0.48802274465560913, 0.4259600043296814, 0.4535652995109558, 0.45135319232940674, 0.240825355052948, 0.22048959136009216, 0.12336473912000656, 0.2321719080209732, 0.49188411235809326, 0.44089430570602417, 0.6457425951957703, 0.5227688550949097, 0.17725589871406555, 0.6315579414367676, 0.8003497123718262, 0.4489514231681824, 0.5509282350540161, 0.14834502339363098, 0.1416168212890625, 0.8791919946670532, 0.6355977654457092, 0.4392760396003723, 0.2332131564617157, 0.33863186836242676, 0.3217325210571289, 0.2696293592453003, 0.0879039317369461, 0.2190180867910385, 0.04568707197904587, 0.5316798686981201, 0.33770573139190674, 0.28308627009391785, 0.1547519564628601, 0.28133338689804077, 0.6202290058135986, 0.25035497546195984, 0.1582401692867279, 0.3504047393798828, 0.7270404696464539, 0.3129778504371643, 0.461555540561676, 0.8004979491233826, 0.6279227137565613, 0.5594022870063782, 0.39709800481796265, 0.13653972744941711, 0.8269169926643372, 0.13003957271575928, 0.6374734044075012, 0.31816303730010986, 0.42270201444625854, 0.29600077867507935, 0.15124540030956268, 0.8216221928596497, 0.8362792134284973, 0.40259844064712524, 0.5760742425918579, 0.6759616732597351, 0.5608226656913757, 0.4464358687400818, 0.377551794052124, 0.14039596915245056, 0.2697291970252991, 0.4128270745277405, 0.11665323376655579, 0.07477924227714539, 0.12584373354911804, 0.31614750623703003, 0.15505415201187134, 0.7669245004653931, 0.4181324243545532, 0.14232906699180603, 0.11226215958595276, 0.13546758890151978, 0.5020454525947571, 0.5266091823577881, 0.22029317915439606, 0.4946150779724121, 0.39925217628479004, 0.090998575091362, 0.17358800768852234, 0.26281964778900146, 0.24752932786941528, 0.25746119022369385, 0.6802641749382019, 0.28117358684539795, 0.12678977847099304, 0.5988099575042725, 0.292797327041626, 0.4571172595024109, 0.39541423320770264, 0.7442923784255981, 0.17973768711090088, 0.3952223062515259, 0.41472870111465454, 0.5294029116630554, 0.8162345290184021, 0.5169880986213684, 0.7424460649490356, 0.6521407961845398, 0.7699612975120544, 0.5111052989959717, 0.5509615540504456, 0.35528653860092163, 0.4934605360031128, 0.8021106123924255, 0.5262982249259949, 0.21034443378448486, 0.4141716957092285, 0.24958164989948273, 0.21918755769729614, 0.933667004108429, 0.8108385801315308, 0.5110439658164978, 0.09980477392673492, 0.822729766368866, 0.09270806610584259, 0.138445645570755, 0.8263903260231018, 0.9197967648506165, 0.6663537621498108, 0.4845799207687378, 0.5649267435073853, 0.5792315602302551, 0.2590305507183075, 0.2766735553741455, 0.7587698101997375, 0.3580968379974365, 0.43665897846221924, 0.5178034901618958, 0.4794139266014099, 0.43390005826950073, 0.42650359869003296, 0.49161970615386963, 0.4089360237121582, 0.6163310408592224, 0.4225936532020569, 0.12863120436668396, 0.870280921459198, 0.49507617950439453, 0.4358259439468384, 0.37315455079078674, 1.0571351051330566, 0.33064305782318115, 0.41274040937423706, 0.07531027495861053, -0.005667522549629211, 0.7729634046554565, 0.4566744565963745, 0.2953053116798401, 0.510888397693634, 0.47467368841171265, 0.3120267391204834, 0.5211408734321594, 0.6243582963943481, 0.31558388471603394, 0.21479007601737976, 0.1992725282907486, 0.06701122224330902, 0.6456573009490967, 0.1798110157251358, 0.13907605409622192, 0.7735512852668762, 0.1706954836845398, 0.7669527530670166, 0.16640634834766388, 0.21284347772598267, 0.20750358700752258, 0.15377137064933777, 0.28375548124313354, 0.858792245388031, 0.27573978900909424, 0.6505205035209656, 0.4795435667037964, 0.8661134243011475, 0.09735193103551865, 0.3262443244457245, 0.5336062908172607, 0.4058080315589905, 0.591060221195221, 0.4696604609489441, 0.3611837327480316, 0.8156929612159729, 0.5489813089370728, 0.9956170916557312, 0.6001002192497253, 0.6265963315963745, 0.4552251696586609, 0.545160174369812, 0.3423185646533966, 0.32212013006210327, 0.5325580835342407, 0.07548905909061432, 0.23258328437805176, 0.36773574352264404, 0.3382055163383484, 0.2091127336025238, 0.29091161489486694, 0.475429892539978, 0.4948388338088989, 0.5281957983970642, 0.1739579439163208, 0.702842652797699, 0.1478320211172104, 0.27672192454338074, 0.08477556705474854, 0.4236663579940796, 0.17120832204818726, 0.34686189889907837, 0.2288341522216797, 0.15226057171821594, 0.2687324583530426, 0.7219836115837097, 0.7082658410072327, 1.0047707557678223, 0.5142254829406738, 0.2946953773498535, 0.16479410231113434, 0.7698801159858704, 0.5448783040046692, 0.13193106651306152, 0.5268266201019287, 0.9237096905708313, 0.9043672680854797, 0.2495340257883072, 0.4610069990158081, 0.3277052044868469, 0.23195791244506836, 0.44398605823516846, 0.15909498929977417, 0.39673104882240295, 0.5180441737174988, 0.34082484245300293, 0.2808757424354553, 0.2276971936225891, 0.40907853841781616, 0.34711241722106934, 0.5072100758552551, 0.6059455275535583, 0.21367549896240234, 0.1634264588356018, 0.24867787957191467, 0.18051835894584656, 0.6578239798545837, 0.6057959198951721, 0.43683457374572754, 0.3700500428676605, 0.42139095067977905, 0.8285022974014282, 0.37027257680892944, 0.32091349363327026, 0.5111372470855713, 0.3749018907546997, 0.2917807698249817, 0.7075262665748596, 0.1068456694483757, 0.5822475552558899, 0.6030047535896301, 0.26327261328697205, 0.41013485193252563, 0.3586713671684265, 0.7282206416130066, 0.41205406188964844, 0.7999411225318909, 0.23333247005939484, 0.23575320839881897, 0.2643040418624878, 0.1487257182598114, 0.0844358578324318, 0.5548509359359741, 0.352721631526947, 0.3651597499847412, 0.29515671730041504, 0.5034987330436707, 0.19305291771888733, 0.3548886775970459, 0.30554163455963135, 0.348707377910614, 0.44366729259490967, 0.27165716886520386, 0.6520676612854004, 0.29737794399261475, 0.09090390801429749, 0.3731265366077423, 0.18116788566112518, 0.5806781649589539, 0.4233682155609131, 0.5517356395721436, 0.6201258301734924, 0.07167404890060425, 0.506664514541626, 0.9967107772827148, 0.44316381216049194, 0.1932571828365326, 0.3144620358943939, 0.37574970722198486, 0.6904862523078918, 0.2503391206264496, 0.3109928369522095, 0.592287003993988, 0.24547596275806427, 0.20002633333206177, 0.8356463313102722, 0.311195433139801, 0.6451364755630493, 0.4182719588279724, 0.11766479164361954, 0.3716067373752594, 0.35499340295791626, 0.7081974744796753, 0.1287253499031067, 0.416404664516449, 0.2678648829460144, 0.13115552067756653, 0.4130820035934448, 0.2898123264312744, 0.09476546943187714, 0.43467479944229126, 0.2625136971473694, 0.3222672641277313, 0.7488848567008972, 0.3883981704711914, 0.19173231720924377, 0.6968806385993958, 0.42710989713668823, 0.17951975762844086, 0.2861899733543396, 0.3997392952442169, 0.31767457723617554, 0.7021017074584961, 0.3353593945503235, 0.32691699266433716, 0.21509963274002075, 0.557745099067688, 0.13510140776634216, 0.17783477902412415, 0.4931854009628296, 0.4017370939254761, 0.3356953263282776, 0.20984825491905212, 0.30094262957572937, 0.5816662311553955, 0.3725593686103821, 0.2864067554473877, 0.32334864139556885, 0.23076100647449493, 0.1771983504295349, 0.3656385540962219, 0.3030134439468384, 0.14703771471977234, 0.4864910840988159, 0.8085536360740662, 0.33408570289611816, 0.4281502366065979, 0.8132108449935913, 0.37581878900527954, 0.11397986859083176, 0.6334261298179626, 0.5127318501472473, 0.44320428371429443, 0.13323551416397095, 0.22889529168605804, 0.15950560569763184, 0.07183068990707397, 0.2906132936477661, 0.1674676537513733, 0.173087015748024, 0.22851364314556122, 0.28488558530807495, 0.30020177364349365, 0.7000313401222229, 0.7317602634429932, 0.08728397637605667, 0.11404520273208618, 0.4485993981361389, 0.22487930953502655, 0.39759814739227295, 0.49103641510009766, 0.48352593183517456, 0.863392174243927, 0.4875035285949707, 0.576988935470581, 0.6667798161506653, 0.6115258932113647, 0.04367566108703613, 0.38085150718688965, 0.8974023461341858, 0.19963902235031128, 0.19612348079681396, 0.6560985445976257, 0.2205992341041565, 0.35433316230773926, 0.5234376788139343, 0.4164712429046631, 0.3299511671066284, 0.753529965877533, 0.10271138697862625, 0.18774007260799408, 0.21439144015312195, 0.2702888548374176, 0.25107342004776, 0.07420925796031952, 0.33601099252700806, 0.270905464887619, 0.19769400358200073, 0.602860152721405, 0.43759042024612427, 0.2759769558906555, 0.5899035334587097, 0.5281388163566589, 0.48012441396713257, 0.6346430778503418, 0.41983556747436523, 0.13120998442173004, 0.11949250102043152, 0.396465539932251]}
results/polish/en2pl_ms_how2sign/test_tmp_pres.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/en2pl_ms_how2sign/test_tmp_refs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/en2pl_si_how2sign/bleurt_BLEURT-20.json ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/en2pl_si_how2sign/test_tmp_pres.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/en2pl_si_how2sign/test_tmp_refs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/pjm_pl_ms_how2sign/bleurt_BLEURT-20.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"n": 2987, "mean": 0.38329235600026346, "per_sample": [0.3918948769569397, 0.13081413507461548, 0.2034284770488739, 0.1427716314792633, 0.4978468418121338, 0.43580329418182373, 0.5620248913764954, 0.33894145488739014, 0.24650827050209045, 0.5993325114250183, 0.8451746106147766, 0.30690285563468933, 0.8317384719848633, 0.985565721988678, 0.8281484246253967, 0.9079141616821289, 0.24077995121479034, 1.0893592834472656, 0.62884122133255, 0.27315500378608704, 0.6871015429496765, 0.09675346314907074, 1.015010952949524, 0.3808317482471466, 0.1888837367296219, 0.3083930015563965, 0.639470100402832, 0.4544498324394226, 0.17547518014907837, 0.13227348029613495, 0.25133317708969116, 0.26314088702201843, 0.2199266254901886, 0.48909294605255127, 0.1726757287979126, 0.16320642828941345, 0.5671698451042175, 0.2726033329963684, 0.09125404804944992, 0.05221933126449585, 0.18210002779960632, 0.8847128748893738, 0.18288367986679077, 0.4130556583404541, 0.1544654667377472, 1.0464704036712646, 0.16853119432926178, 0.1472097933292389, 0.17914342880249023, 0.36289483308792114, 0.45746397972106934, 0.11208031326532364, 0.156937837600708, 0.22710692882537842, 0.2707340717315674, 0.280106782913208, 0.2619476616382599, 0.6670590043067932, 0.36358189582824707, 0.14665071666240692, 0.08954289555549622, 0.18780627846717834, 0.3834559917449951, 0.33624690771102905, 0.3039328455924988, 0.22996079921722412, 0.2740650773048401, 0.3716678023338318, 0.4253332018852234, 0.3087007403373718, 0.36974072456359863, 0.23032823204994202, 0.12250690162181854, 0.25442996621131897, 0.9974279999732971, 0.8985453248023987, 0.12564697861671448, 0.8872620463371277, 0.15400061011314392, 0.48359906673431396, 0.2975364327430725, 0.6858539581298828, 0.3985498547554016, 0.7462357878684998, 0.30935531854629517, 0.6277010440826416, 0.17130234837532043, 0.36666369438171387, 0.2200092375278473, 0.4505816698074341, 0.48386555910110474, 0.2977680265903473, 0.129050150513649, 0.27250999212265015, 0.11777400225400925, 0.3170836567878723, 0.27195608615875244, 0.07440860569477081, 0.2246341109275818, 0.515896201133728, 0.2319379448890686, 0.2656722962856293, 0.7124344110488892, 0.22902831435203552, 0.24381005764007568, 0.33669358491897583, 0.09396497905254364, 0.1436842679977417, 0.21408222615718842, 0.20207512378692627, 0.44449496269226074, 0.6968657374382019, 0.4813683032989502, 0.6578916907310486, 0.23627951741218567, 0.3131484389305115, 0.16524480283260345, 0.646661639213562, 0.2896468937397003, 0.1784982979297638, 0.2619832158088684, 0.4961698651313782, 0.8693802952766418, 0.6869561076164246, 0.6720532178878784, 0.25058186054229736, 0.5615630745887756, 0.23818136751651764, 0.4924953579902649, 0.7388796806335449, 0.5058685541152954, 0.273265540599823, 0.1912773996591568, 0.08621383458375931, 0.09127175807952881, 0.39455509185791016, 0.8382277488708496, 0.2645544707775116, 0.5269643068313599, 0.9302634000778198, 0.6535930037498474, 0.8582649827003479, 0.8547890782356262, 0.9012080430984497, 0.3052927851676941, 0.44947129487991333, 0.26403331756591797, 1.0028351545333862, 0.20047308504581451, 0.9781201481819153, 0.7370414733886719, 0.18912895023822784, 0.1794840395450592, 0.710006058216095, 0.06941665709018707, 0.4137292504310608, 0.49540144205093384, 0.0776086151599884, 0.2656383216381073, 0.37805527448654175, 0.19951754808425903, 0.3313499093055725, 0.4948442578315735, 0.5384178757667542, 0.15746206045150757, 0.5127003788948059, 0.24367326498031616, 0.42697906494140625, 0.1807258427143097, 0.39707162976264954, 0.23844574391841888, 0.3039957880973816, 0.5244308114051819, 0.12648722529411316, 0.3975975513458252, 0.9587145447731018, 0.1931481659412384, 0.4378255009651184, 0.2703608274459839, 0.36859041452407837, 0.07363791018724442, 0.819383442401886, 0.5453321933746338, 0.25435203313827515, 0.16703331470489502, 0.11423365026712418, 0.5061916708946228, 0.2943926453590393, 0.3621976971626282, 0.5917540192604065, 0.23004332184791565, 0.5796418190002441, 0.37466150522232056, 0.14893415570259094, 0.3805793225765228, 0.15108397603034973, 0.18114984035491943, 0.4593905806541443, 0.08396703004837036, 0.1006316989660263, 0.28932249546051025, 0.10899730026721954, 0.3970955014228821, 0.3206988573074341, 0.30063772201538086, 0.1242590844631195, 0.6652759909629822, 0.29087936878204346, 0.17823614180088043, 0.28097933530807495, 0.3605126738548279, 0.13702401518821716, 0.14565801620483398, 0.09773615002632141, 0.6643146276473999, 0.4437372088432312, 0.9710650444030762, 0.27487117052078247, 0.34824132919311523, 0.5533771514892578, 0.5924630165100098, 0.7356056571006775, 0.6779235005378723, 0.6532936692237854, 0.2757100760936737, 0.3419485092163086, 0.2652641236782074, 0.781883716583252, 0.8796104192733765, 0.7643119692802429, 0.26200202107429504, 0.4140790104866028, 0.37039506435394287, 0.126428484916687, 0.46355438232421875, 0.7152923345565796, 0.10908752679824829, 0.31728166341781616, 0.8465167880058289, 0.22868472337722778, 0.3285660743713379, 0.8046762943267822, 0.6516227126121521, 0.21919740736484528, 0.6959314942359924, 0.1527220904827118, 0.610230028629303, 0.5077978372573853, 0.4930461049079895, 0.5832327604293823, 0.21645742654800415, 0.16586291790008545, 0.19298501312732697, 0.24534747004508972, 0.29515188932418823, 0.3019118309020996, 0.1484798938035965, 0.3627132475376129, 0.17673176527023315, 0.814406156539917, 0.45517200231552124, 0.20355400443077087, 0.24756880104541779, 0.1397438943386078, 0.20783308148384094, 0.32707470655441284, 0.34299659729003906, 0.08303311467170715, 0.9967108964920044, 0.5125716924667358, 0.10959026217460632, 0.21740052103996277, 0.13060393929481506, 0.23714566230773926, 0.08873432874679565, 0.17786350846290588, 0.591771125793457, 0.5034274458885193, 0.26459693908691406, 0.8655926585197449, 0.21393725275993347, 0.8983496427536011, 0.29216378927230835, 0.820141077041626, 0.397344708442688, 0.7231064438819885, 0.06712640821933746, 0.09381277859210968, 0.24362069368362427, 0.8182273507118225, 0.22768956422805786, 0.1472187042236328, 0.7821081280708313, 0.16100138425827026, 0.6283755302429199, 0.15814734995365143, 0.13514477014541626, 0.12901157140731812, 0.19908545911312103, 0.2271808385848999, 0.7225624322891235, 0.09911231696605682, 0.16476915776729584, 0.2234315723180771, 0.11703076958656311, 0.05609901249408722, 1.0212559700012207, 0.7370308041572571, 0.13355346024036407, 0.16594548523426056, 0.6947981715202332, 0.3862602114677429, 0.08962341398000717, 0.13160046935081482, 0.11989787966012955, 0.27727848291397095, 0.897686779499054, 0.13111773133277893, 0.11292609572410583, 0.4921579360961914, 0.21597354114055634, 0.5043980479240417, 0.8781834244728088, 0.41919922828674316, 0.24196624755859375, 0.4197041988372803, 0.28189748525619507, 0.09439150989055634, 0.33153462409973145, 0.18710684776306152, 0.685782253742218, 0.8875072002410889, 0.2801966071128845, 0.11224629729986191, 0.7508710622787476, 0.39875173568725586, 0.5775862336158752, 0.251994252204895, 0.10857164859771729, 0.3794880211353302, 0.16683503985404968, 0.3243539333343506, 0.121900275349617, 0.2658143639564514, 0.13038116693496704, 0.39741986989974976, 0.3683772683143616, 0.4658912420272827, 0.14712123572826385, 0.5582588911056519, 0.3659136891365051, 0.09500260651111603, 0.82376629114151, 0.4684441089630127, 0.1559513807296753, 0.12427015602588654, 0.2544677257537842, 0.2341446429491043, 0.49214327335357666, 0.14899185299873352, 0.12998709082603455, 0.6518996357917786, 0.22464574873447418, 0.10000874102115631, 0.0918707475066185, 0.6494878530502319, 0.2158905565738678, 0.13774794340133667, 0.12884856760501862, 1.0120614767074585, 0.9841336607933044, 0.35319772362709045, 0.7900531888008118, 0.21827483177185059, 0.367197185754776, 0.25337326526641846, 0.7527973055839539, 0.24571913480758667, 0.16463589668273926, 0.5086426734924316, 0.6542250514030457, 0.8708821535110474, 0.24724668264389038, 0.7558601498603821, 0.27507150173187256, 0.6241233944892883, 0.10642395913600922, 0.5023096799850464, 0.874107301235199, 0.9046503901481628, 0.18501944839954376, 0.5586233735084534, 0.2964591979980469, 0.32652342319488525, 0.5051116347312927, 0.07476471364498138, 0.581404983997345, 0.4094058871269226, 0.4072900414466858, 0.4666603207588196, 0.22763743996620178, 0.1461980938911438, 0.20674161612987518, 0.5136732459068298, 0.22311806678771973, 0.3250638246536255, 0.31910401582717896, 0.22758954763412476, 0.35842984914779663, 0.329281747341156, 0.3028947114944458, 0.2584362030029297, 0.27196991443634033, 0.4730287194252014, 0.31771355867385864, 0.8844186663627625, 0.2104312926530838, 0.3974018692970276, 0.21782974898815155, 0.2268896847963333, 0.16349956393241882, 0.27800458669662476, 0.5721373558044434, 0.6785876154899597, 0.4259412884712219, 0.7891708612442017, 0.7213074564933777, 0.20964878797531128, 0.4203951954841614, 0.2084413766860962, 0.6647788882255554, 0.4856415390968323, 0.5050205588340759, 0.16884608566761017, 0.12589511275291443, 0.4301408529281616, 0.40169352293014526, 0.4683995842933655, 0.46444380283355713, 0.3691622018814087, 0.20213386416435242, 0.21174070239067078, 0.844631552696228, 0.09514737874269485, 0.04783579707145691, 0.2364702969789505, 0.3350989818572998, 0.16831596195697784, 0.6094110012054443, 0.23492100834846497, 0.468003511428833, 0.3304070830345154, 0.46414893865585327, 0.5170913338661194, 0.6362103819847107, 0.14609289169311523, 0.6033675074577332, 0.8010927438735962, 0.7668433785438538, 0.11500603705644608, 0.36909013986587524, 0.17781007289886475, 0.263069748878479, 0.9937654733657837, 0.5788993239402771, 0.1499292105436325, 0.5402255058288574, 0.6708515286445618, 0.22336778044700623, 0.1950191706418991, 0.6307811737060547, 0.2679072916507721, 0.20893064141273499, 0.1178765818476677, 0.3625880479812622, 0.2062835395336151, 0.34550148248672485, 0.21730956435203552, 0.1364201307296753, 0.3303084373474121, 0.3891027569770813, 0.1400168240070343, 0.3542203903198242, 0.24176403880119324, 0.3364003300666809, 0.5198346376419067, 0.9841336607933044, 0.31863582134246826, 0.5811667442321777, 0.5090175867080688, 0.25991374254226685, 0.19526875019073486, 0.4420871138572693, 0.07389678061008453, 0.16952577233314514, 0.19157469272613525, 0.21904413402080536, 0.3242035508155823, 0.16839845478534698, 0.5849506855010986, 0.11020475625991821, 0.20456941425800323, 0.3587270975112915, 0.714435875415802, 0.4345938563346863, 0.3575572371482849, 0.5866347551345825, 0.16268077492713928, 0.3877333402633667, 0.20716021955013275, 0.1740204095840454, 0.2257833182811737, 0.31067025661468506, 0.21195439994335175, 0.3892643451690674, 0.19251510500907898, 0.25842833518981934, 0.15953752398490906, 0.1361485719680786, 0.3389768600463867, 0.1725611388683319, 0.2669842839241028, 0.21362870931625366, 0.3075318932533264, 0.3680962324142456, 0.48146283626556396, 0.2487657517194748, 0.7633761763572693, 0.6361029148101807, 0.11712609231472015, 0.8357179164886475, 1.009782075881958, 0.21256542205810547, 0.5106483697891235, 0.703938364982605, 0.3808397352695465, 0.5070346593856812, 0.15654011070728302, 0.31716984510421753, 0.4450036883354187, 0.8828792572021484, 0.16902270913124084, 0.29987895488739014, 0.15625813603401184, 0.21533986926078796, 0.3035968244075775, 0.8598862886428833, 0.38513630628585815, 0.5462630987167358, 0.2950582504272461, 0.15585549175739288, 0.6185961365699768, 0.30915915966033936, 0.6793039441108704, 1.016162633895874, 0.3354417085647583, 0.3909722566604614, 0.2705957293510437, 0.30883151292800903, 0.22579987347126007, 0.23548486828804016, 0.22366157174110413, 0.4537663459777832, 0.5621899366378784, 0.5067389011383057, 0.8638080954551697, 0.2230021059513092, 0.25154292583465576, 0.3559933006763458, 0.1966792345046997, 0.42978912591934204, 0.36902934312820435, 0.16004420816898346, 0.5586181282997131, 0.8980220556259155, 0.17915984988212585, 0.6057971119880676, 0.35250169038772583, 0.16473546624183655, 0.23029595613479614, 0.540878176689148, 0.1764174997806549, 0.21563059091567993, 0.602741539478302, 0.21980737149715424, 0.252529501914978, 0.43334829807281494, 0.6412591934204102, 1.0139604806900024, 0.35976648330688477, 0.4525018334388733, 0.5652344226837158, 0.7354117631912231, 0.15276405215263367, 0.29839837551116943, 0.2792179584503174, 0.3713427186012268, 0.30480003356933594, 0.44535696506500244, 0.2774943709373474, 0.6401405334472656, 0.5403503179550171, 0.4785383939743042, 0.25256094336509705, 0.17195965349674225, 0.32270002365112305, 0.6615395545959473, 0.6510716676712036, 0.13603316247463226, 0.5181987285614014, 0.2076452672481537, 0.4869832992553711, 0.22647377848625183, 0.46856915950775146, 0.4402662515640259, 0.187674418091774, 0.2276066243648529, 0.8662386536598206, 0.1351895034313202, 0.23604345321655273, 0.3712392747402191, 0.23692414164543152, 0.41616570949554443, 0.7543744444847107, 0.3882828652858734, 0.25927138328552246, 0.22336512804031372, 0.22844338417053223, 0.24234387278556824, 0.22693468630313873, 0.45519620180130005, 0.3336155414581299, 0.5561918616294861, 0.28201770782470703, 0.6290690898895264, 0.6184352040290833, 0.170919269323349, 0.15225833654403687, 0.19984221458435059, 0.43283408880233765, 0.7042182087898254, 0.4286664128303528, 0.23851615190505981, 0.5271387696266174, 0.8487992882728577, 0.6115350127220154, 0.30846691131591797, 0.6072878241539001, 1.0448579788208008, 1.0448579788208008, 0.21998783946037292, 0.5502318143844604, 0.13160988688468933, 0.23568537831306458, 0.6249085664749146, 0.3319971561431885, 0.330244779586792, 0.38054078817367554, 0.2453947365283966, 0.368185818195343, 0.36157453060150146, 0.6708425283432007, 0.702013373374939, 0.2441137731075287, 0.2623387575149536, 0.25579532980918884, 0.44869160652160645, 0.20395317673683167, 0.2736459970474243, 0.4156225323677063, 0.37448692321777344, 0.22205953299999237, 0.17504897713661194, 0.44455546140670776, 0.2561657428741455, 0.26111456751823425, 0.8197588920593262, 0.3727991580963135, 0.30562615394592285, 0.8132102489471436, 0.7118759751319885, 0.2891707718372345, 0.11622987687587738, 0.24416260421276093, 0.8641652464866638, 0.5195149779319763, 0.29405808448791504, 0.09275534749031067, 0.28019091486930847, 0.15618367493152618, 0.2627880573272705, 0.4793514013290405, 0.1214384138584137, 0.231289803981781, 0.1359080672264099, 0.26206284761428833, 0.5048229694366455, 0.19930218160152435, 0.34550023078918457, 0.9135165810585022, 0.2766321301460266, 0.11652505397796631, 0.31546151638031006, 0.14679518342018127, 0.17822091281414032, 0.10964743793010712, 0.1248505562543869, 0.6324464678764343, 0.08654647320508957, 0.6036176085472107, 0.3217127323150635, 0.34364819526672363, 0.18253368139266968, 0.09102043509483337, 0.23551219701766968, 0.35514968633651733, 0.15245094895362854, 0.10402834415435791, 0.32218432426452637, 0.5796744227409363, 0.28830480575561523, 0.21922218799591064, 0.8539178967475891, 0.24769651889801025, 0.74452805519104, 0.13196608424186707, 0.1691894829273224, 0.2065153270959854, 0.3722672462463379, 0.19197820127010345, 0.4480358362197876, 0.28780776262283325, 0.5729338526725769, 0.5021607279777527, 0.16542726755142212, 0.22490623593330383, 0.5667808651924133, 0.2447742223739624, 0.37205207347869873, 0.15624651312828064, 0.33167070150375366, 0.4522334933280945, 0.2782328724861145, 0.11567924916744232, 0.2611047029495239, 0.6249825358390808, 0.22282320261001587, 0.7269421219825745, 0.21384140849113464, 0.15098915994167328, 0.3702433705329895, 0.18569621443748474, 0.5253068208694458, 0.4029639959335327, 0.36803025007247925, 0.2439124435186386, 0.12154567241668701, 0.4640094041824341, 0.35136014223098755, 0.14172884821891785, 0.18741273880004883, 0.4177076816558838, 0.0829128623008728, 0.45769351720809937, 0.15529188513755798, 0.8345101475715637, 0.36012113094329834, 0.9981159567832947, 0.7046769261360168, 0.2222771942615509, 0.23188430070877075, 0.6304214596748352, 0.41855019330978394, 0.5798503160476685, 0.24648095667362213, 0.4612545967102051, 0.28253287076950073, 0.137182354927063, 0.23714348673820496, 0.47239428758621216, 0.2784808874130249, 0.2882578372955322, 0.3835432529449463, 0.22081148624420166, 0.4499961733818054, 0.20636571943759918, 0.6040985584259033, 0.5703683495521545, 0.23510363698005676, 1.0149710178375244, 0.36658936738967896, 0.22458773851394653, 0.46565765142440796, 0.11540651321411133, 0.10509806126356125, 0.9453057646751404, 0.9790520668029785, 0.501714825630188, 0.1782664954662323, 0.2012646496295929, 0.21883195638656616, 0.7523066997528076, 0.19249233603477478, 0.1053900420665741, 0.08459388464689255, 0.36132532358169556, 0.23860234022140503, 0.21666713058948517, 0.18570248782634735, 0.1562572568655014, 0.32365334033966064, 0.2736181318759918, 0.3250839114189148, 0.21213483810424805, 0.14711925387382507, 0.2585509419441223, 0.2512040138244629, 0.1353714019060135, 0.44999605417251587, 0.1603277325630188, 0.254655659198761, 0.21957571804523468, 0.24024586379528046, 0.7894402742385864, 0.27735185623168945, 0.38059723377227783, 0.18488076329231262, 0.1956431269645691, 0.33329418301582336, 0.16876249015331268, 0.4302594065666199, 0.1316111832857132, 0.14401763677597046, 0.1715260148048401, 0.40363889932632446, 0.39327341318130493, 0.24872201681137085, 0.32378679513931274, 0.9063059687614441, 0.6851783990859985, 0.3070213198661804, 0.30404818058013916, 0.13659587502479553, 0.20420733094215393, 0.2015884667634964, 0.6840065121650696, 0.13177335262298584, 0.7797541618347168, 0.3715800344944, 0.47184157371520996, 0.23957547545433044, 0.10511292517185211, 0.22697502374649048, 0.3189178705215454, 0.4041633605957031, 0.36544084548950195, 0.17904165387153625, 0.6036890745162964, 0.2076902687549591, 0.264242559671402, 0.28588366508483887, 0.43570971488952637, 0.6160063147544861, 0.2032201886177063, 0.7357403635978699, 0.21774739027023315, 0.4165814518928528, 0.3156124949455261, 0.3870171308517456, 0.3137044906616211, 0.3086113929748535, 0.47183501720428467, 0.1851593255996704, 0.5078465938568115, 1.0186939239501953, 0.11033831536769867, 0.4281567335128784, 0.6670551896095276, 0.5083914995193481, 0.1072697639465332, 0.985866367816925, 0.16459424793720245, 0.10289324074983597, 0.12351024150848389, 0.22354596853256226, 0.5392351746559143, 0.5633260607719421, 0.41457343101501465, 0.45625823736190796, 0.15948110818862915, 0.34517088532447815, 0.15813079476356506, 0.06446084380149841, 0.6310049891471863, 0.5265436172485352, 0.8771807551383972, 0.6190525889396667, 0.3088948726654053, 0.8589795231819153, 0.42401063442230225, 0.21252907812595367, 0.2613404393196106, 0.5419028401374817, 0.7627359628677368, 0.5019571185112, 0.20402878522872925, 0.36714062094688416, 0.40274155139923096, 0.7522374987602234, 0.21656584739685059, 0.48357969522476196, 0.44536298513412476, 0.33975329995155334, 0.6916467547416687, 0.3331761956214905, 0.1233438104391098, 0.44782257080078125, 0.3384885787963867, 0.576819121837616, 0.1602109670639038, 0.5282034873962402, 0.37293094396591187, 0.4543704390525818, 0.5217667818069458, 0.25132960081100464, 0.4600293040275574, 0.21300742030143738, 0.19951480627059937, 0.39864811301231384, 0.12973438203334808, 0.7184281945228577, 0.17292051017284393, 0.6207966208457947, 0.34606820344924927, 0.18469104170799255, 0.25216683745384216, 0.16489160060882568, 0.8215569257736206, 0.2907586395740509, 0.17515137791633606, 0.45245951414108276, 0.1118626743555069, 0.1982783079147339, 0.11331112682819366, 0.23804226517677307, 0.5703893899917603, 0.1094307005405426, 0.3356817364692688, 0.28358912467956543, 0.2065807282924652, 0.3093932867050171, 0.5754639506340027, 0.36764565110206604, 0.1366751492023468, 0.13673047721385956, 0.2525078058242798, 0.575394868850708, 0.49923866987228394, 0.3802333474159241, 0.6151881814002991, 0.7209361791610718, 0.6679838299751282, 0.4533126950263977, 0.3341834545135498, 0.19271504878997803, 0.20953580737113953, 0.12451684474945068, 0.44150418043136597, 0.651222288608551, 0.1586630642414093, 0.3384377956390381, 0.19851671159267426, 0.19877378642559052, 0.43758314847946167, 0.3864051401615143, 0.1349063515663147, 0.4611815810203552, 0.6303609609603882, 0.586107611656189, 0.32397180795669556, 0.1817418783903122, 0.10787920653820038, 0.7512702345848083, 0.18909122049808502, 0.056633710861206055, 0.3167228102684021, 0.17443805932998657, 0.38226109743118286, 0.32350867986679077, 0.3947635293006897, 0.921945333480835, 0.40877610445022583, 0.6520830988883972, 0.291808545589447, 0.8616525530815125, 0.24487310647964478, 0.7309221625328064, 0.09412781894207001, 0.21824929118156433, 0.13250581920146942, 0.3936113119125366, 0.5238623023033142, 0.09519582241773605, 0.11467047035694122, 0.05681300163269043, 0.7266317009925842, 0.5932314395904541, 0.25445616245269775, 0.3350543975830078, 0.29966312646865845, 0.3726562261581421, 0.7507925033569336, 0.22878777980804443, 0.12097270041704178, 0.25282561779022217, 0.1654084026813507, 0.16725175082683563, 0.131338432431221, 0.544038712978363, 0.28739356994628906, 0.47109341621398926, 0.45072948932647705, 0.5294781923294067, 0.17275024950504303, 0.18273895978927612, 0.721926748752594, 0.21199573576450348, 0.4472625255584717, 0.6956824660301208, 0.18290777504444122, 0.18682512640953064, 0.45879316329956055, 0.14872613549232483, 0.559431791305542, 0.33997076749801636, 0.09646430611610413, 0.12971845269203186, 0.4528827667236328, 0.3035750389099121, 0.1292424499988556, 0.14746201038360596, 0.4034491777420044, 0.26773136854171753, 0.6817708015441895, 0.6668040156364441, 0.34284141659736633, 0.32351505756378174, 0.24321387708187103, 0.5530998110771179, 0.8376371264457703, 0.30503857135772705, 0.5022082924842834, 1.014690637588501, 0.18393391370773315, 0.21602310240268707, 0.48570847511291504, 0.3009384274482727, 0.1829218864440918, 0.33855652809143066, 0.8388347625732422, 0.5477783679962158, 0.20772960782051086, 0.3577694296836853, 0.6148391366004944, 0.14705149829387665, 0.12186611443758011, 0.493149995803833, 0.6647403240203857, 0.33502209186553955, 0.5610721111297607, 0.4880726933479309, 0.9060753583908081, 0.3797031044960022, 0.6466480493545532, 0.3595377802848816, 0.8375325202941895, 0.4182027578353882, 0.3784821629524231, 0.1864306777715683, 0.2919049561023712, 0.290321409702301, 0.11279015243053436, 0.25054746866226196, 0.18060311675071716, 0.11930906772613525, 0.3228258490562439, 0.2712894380092621, 0.2662052512168884, 0.6087527275085449, 0.23104391992092133, 0.36352062225341797, 0.11051225662231445, 0.5402498841285706, 0.44937658309936523, 0.3899986147880554, 0.6067478656768799, 0.337726891040802, 0.3635239005088806, 0.8393238186836243, 0.21394672989845276, 0.4629386067390442, 0.29750773310661316, 0.18445941805839539, 0.2087239921092987, 0.385029673576355, 0.3792153596878052, 0.8172990679740906, 0.32435154914855957, 0.6208515763282776, 0.6526893973350525, 0.4185180068016052, 0.2407514452934265, 0.45660531520843506, 0.5173328518867493, 0.4702147841453552, 0.23367980122566223, 0.16310682892799377, 0.07863682508468628, 0.3016388416290283, 0.9853898882865906, 1.0346322059631348, 0.12247982621192932, 0.24182921648025513, 0.41356557607650757, 0.07500937581062317, 0.5035650730133057, 0.4349830150604248, 0.2260943502187729, 0.9954480528831482, 0.24177837371826172, 0.4388573169708252, 0.15679128468036652, 0.4311688542366028, 0.7790605425834656, 0.5650104880332947, 0.38222867250442505, 0.40947842597961426, 0.46669453382492065, 0.6275636553764343, 0.15298309922218323, 0.4627092480659485, 0.3949888348579407, 0.34714922308921814, 0.3225364089012146, 0.1844266951084137, 0.2938394546508789, 0.611722469329834, 0.299316942691803, 0.39456361532211304, 0.6552280783653259, 0.39195966720581055, 0.5518328547477722, 0.4347737431526184, 0.20217469334602356, 0.5825307965278625, 0.15078195929527283, 0.4753551483154297, 0.4453394412994385, 0.25272873044013977, 0.3647748827934265, 0.5235971808433533, 0.4329832196235657, 0.6880703568458557, 0.17168954014778137, 0.3464626669883728, 0.20607048273086548, 0.10713798552751541, 0.5904392004013062, 0.3109460473060608, 0.52069091796875, 0.5970355272293091, 0.35259756445884705, 0.3030748963356018, 0.6124370694160461, 0.26711997389793396, 0.4900718331336975, 0.23248900473117828, 0.4982660412788391, 0.6713224649429321, 0.26494842767715454, 0.24264827370643616, 0.6727033257484436, 0.5729494094848633, 0.11331862211227417, 0.11483435332775116, 0.5905790328979492, 0.41327905654907227, 0.20669452846050262, 0.5824416875839233, 0.2809099853038788, 0.08350495249032974, 0.2543427050113678, 0.44264113903045654, 0.16151447594165802, 0.09930874407291412, 0.2986888885498047, 0.32711338996887207, 0.3560200333595276, 0.06398835778236389, 0.2653646767139435, 0.43144941329956055, 0.07816055417060852, 0.4111858010292053, 0.1266537755727768, 0.4713897109031677, 0.16011309623718262, 0.18755048513412476, 0.18122559785842896, 0.4215216636657715, 0.41833609342575073, 0.5451287627220154, 0.7938357591629028, 0.6753160357475281, 0.7968028783798218, 0.21002516150474548, 0.11027445644140244, 0.47086483240127563, 0.22710660099983215, 0.1848638355731964, 0.1318231225013733, 0.45416033267974854, 0.2809211015701294, 0.350074827671051, 0.27297160029411316, 0.18423599004745483, 0.19575747847557068, 0.16113027930259705, 0.30213332176208496, 0.30927765369415283, 0.40948909521102905, 0.13826331496238708, 0.0736183449625969, 0.17511871457099915, 0.6574441194534302, 0.10577934980392456, 0.1347779929637909, 0.170632004737854, 0.1877211034297943, 0.40584200620651245, 0.7564695477485657, 0.8303640484809875, 0.08447275310754776, 0.42357337474823, 0.3112284541130066, 0.17414411902427673, 0.4983387589454651, 0.5203980803489685, 0.33170387148857117, 0.6421573758125305, 0.27331167459487915, 0.14724987745285034, 0.7101534605026245, 0.36342543363571167, 0.19726303219795227, 0.3856251835823059, 0.913579523563385, 0.5409545302391052, 0.4982507824897766, 0.3877304494380951, 0.23772136867046356, 0.47657305002212524, 0.155368834733963, 0.6093971133232117, 0.3110576868057251, 0.48750871419906616, 0.3221398591995239, 0.1921020895242691, 0.26184138655662537, 0.47437942028045654, 0.06702885031700134, 0.32253098487854004, 1.0273871421813965, 0.22977718710899353, 0.5441593527793884, 0.5245972871780396, 0.14713579416275024, 0.2030002474784851, 0.1698276698589325, 0.13722974061965942, 0.23412957787513733, 0.45695191621780396, 0.24661529064178467, 0.3960230350494385, 0.3270324468612671, 0.1151430755853653, 0.34688901901245117, 0.884065568447113, 0.8986294865608215, 0.09791385382413864, 0.4332950711250305, 0.4243372082710266, 0.07095354795455933, 0.16848739981651306, 0.8240972757339478, 0.5555577278137207, 0.4235411286354065, 0.566243052482605, 0.5556272864341736, 0.10922370851039886, 0.20218618214130402, 0.628311276435852, 0.4002699851989746, 0.18358612060546875, 0.09542211145162582, 0.791281521320343, 0.1407921314239502, 0.3947489857673645, 0.6219609975814819, 0.3196171522140503, 0.3849826455116272, 0.9098139405250549, 0.7670613527297974, 0.08654871582984924, 0.837421715259552, 0.7523460984230042, 0.6539759039878845, 0.28228574991226196, 0.5673851370811462, 0.4614229202270508, 0.6463607549667358, 0.28060251474380493, 0.3710464537143707, 0.19337505102157593, 0.11310809850692749, 0.3404826521873474, 0.30417007207870483, 0.32909876108169556, 0.3425294756889343, 0.6398177742958069, 0.46065592765808105, 0.06859002262353897, 0.212190181016922, 0.7717453241348267, 0.30434858798980713, 0.15565985441207886, 0.15436097979545593, 0.3343735337257385, 0.4534289836883545, 0.7882854342460632, 0.3639938235282898, 0.6509265303611755, 0.37785470485687256, 0.8192490339279175, 0.25130146741867065, 0.5876461267471313, 0.33885663747787476, 0.13685405254364014, 0.4640618562698364, 0.31196358799934387, 0.25352194905281067, 0.3845583498477936, 0.2393992394208908, 0.14085569977760315, 0.6179609298706055, 0.3201804757118225, 0.3810615539550781, 0.33833301067352295, 0.5690833330154419, 0.13557052612304688, 0.330463171005249, 0.38837599754333496, 0.6290675401687622, 0.16736045479774475, 0.24466334283351898, 0.8294703960418701, 0.43640047311782837, 0.0736607015132904, 0.12268190085887909, 0.7436032891273499, 1.0217682123184204, 0.4265390634536743, 0.5083677768707275, 0.39791542291641235, 0.11767739802598953, 0.8407863974571228, 0.7286409735679626, 0.2985399663448334, 0.6411707997322083, 0.39285334944725037, 0.41859596967697144, 0.10981350392103195, 0.17531731724739075, 0.12935784459114075, 0.6481297016143799, 0.37341684103012085, 0.13909122347831726, 0.19260194897651672, 0.7198981046676636, 0.1468247026205063, 0.36533933877944946, 0.11278508603572845, 0.6327425837516785, 1.02195405960083, 0.25283879041671753, 0.3332294225692749, 0.6208187341690063, 0.8328650593757629, 0.3482816815376282, 0.8341023325920105, 0.197379469871521, 0.3776611089706421, 0.19273880124092102, 0.17265403270721436, 0.4447539448738098, 0.3029692769050598, 0.16787779331207275, 0.30333542823791504, 0.5868109464645386, 0.2992812991142273, 0.2915913760662079, 0.19402289390563965, 0.20677831768989563, 0.2688920497894287, 0.22660139203071594, 0.14649897813796997, 0.21486780047416687, 0.7750613689422607, 0.27998799085617065, 0.20108629763126373, 0.11858735978603363, 0.89920973777771, 0.568520724773407, 0.0660858303308487, 0.5913360714912415, 0.3485357165336609, 0.24127990007400513, 0.18883468210697174, 0.2288663536310196, 0.33185964822769165, 0.8842884302139282, 0.5712534189224243, 0.04383714497089386, 0.7027897834777832, 0.169821098446846, 0.3595491647720337, 0.16491328179836273, 0.16385307908058167, 0.7791600227355957, 0.1560865193605423, 0.14026159048080444, 0.2174108624458313, 0.48272478580474854, 0.2553076446056366, 0.5261624455451965, 0.23270389437675476, 0.1622108668088913, 0.17001543939113617, 0.14993108808994293, 0.19461917877197266, 0.6684054136276245, 0.3776260018348694, 0.08653931319713593, 0.289453387260437, 0.18832458555698395, 0.2540268003940582, 0.2815750539302826, 1.0038846731185913, 0.2622518837451935, 0.07882392406463623, 0.8203266859054565, 0.455507755279541, 0.2863110303878784, 0.17620007693767548, 0.7906888127326965, 0.23025229573249817, 0.6947696208953857, 0.3659438490867615, 0.04234905540943146, 0.6020858883857727, 0.37866300344467163, 1.0721304416656494, 0.3200494050979614, 0.20074278116226196, 0.24989205598831177, 0.3481752276420593, 0.2514324188232422, 0.6021742224693298, 0.3348497152328491, 0.7514389753341675, 0.3274450898170471, 0.5158051252365112, 0.4757971167564392, 0.2867480516433716, 0.5984163880348206, 0.6192559599876404, 0.3794066309928894, 0.6797067523002625, 0.5297417640686035, 0.1631045788526535, 0.5497081279754639, 0.5998928546905518, 0.12235113978385925, 0.37602919340133667, 0.26297786831855774, 0.373251736164093, 0.28476661443710327, 0.7012500166893005, 0.8025534749031067, 0.1413077712059021, 0.24181243777275085, 0.2278328537940979, 0.16276958584785461, 0.5659260153770447, 0.314980685710907, 0.17688415944576263, 0.48298180103302, 0.6628621220588684, 0.3304392099380493, 0.5198981761932373, 0.24081316590309143, 0.2843537926673889, 0.4305388331413269, 0.7655577063560486, 0.7776280045509338, 0.3120303452014923, 0.06042943894863129, 0.12944535911083221, 0.37202155590057373, 0.29255589842796326, 0.22821611166000366, 0.13788333535194397, 0.1386927366256714, 0.3693828582763672, 0.38443320989608765, 0.7347268462181091, 0.3150268793106079, 0.46283262968063354, 0.5893074870109558, 0.27552250027656555, 0.8983668684959412, 0.43123525381088257, 0.861855685710907, 0.14275570213794708, 0.563711941242218, 0.34328627586364746, 0.41423869132995605, 0.19908174872398376, 0.13468119502067566, 0.12084513157606125, 0.44291311502456665, 0.12336225807666779, 0.14651167392730713, 0.27247074246406555, 0.7211584448814392, 0.3765941858291626, 0.8329204320907593, 0.3378716707229614, 0.8183829188346863, 0.23747193813323975, 0.3099546432495117, 0.12780261039733887, 0.2661197781562805, 0.3691216707229614, 0.2432570457458496, 0.26296520233154297, 0.2503894567489624, 0.6403411030769348, 0.22363100945949554, 0.08205301314592361, 0.5687094926834106, 0.47906816005706787, 0.3102880120277405, 0.5545686483383179, 0.742300808429718, 0.2468416839838028, 0.603877067565918, 0.5495575666427612, 0.3703341484069824, 0.13786932826042175, 0.25107342004776, 0.5322505831718445, 0.4162144660949707, 0.32674601674079895, 0.0647595226764679, 0.2095949351787567, 0.39656633138656616, 0.4116900563240051, 0.38629788160324097, 0.425426185131073, 0.27050015330314636, 0.47392815351486206, 0.5887471437454224, 0.4807804226875305, 0.2487691342830658, 0.7647209763526917, 0.1136598214507103, 0.09585894644260406, 0.7230937480926514, 0.45195478200912476, 0.4060075283050537, 0.20436444878578186, 0.24924243986606598, 0.1759561002254486, 0.47045332193374634, 0.2998572587966919, 0.4023711681365967, 0.08685782551765442, 0.4957987666130066, 0.1084810271859169, 0.20412178337574005, 0.8791673183441162, 0.6108828783035278, 0.277574360370636, 0.2025519609451294, 0.5462926030158997, 0.915808379650116, 0.410525918006897, 0.4059757590293884, 0.27345120906829834, 0.6143907904624939, 0.35623058676719666, 0.20137324929237366, 0.30746227502822876, 0.6532931923866272, 0.21872879564762115, 0.2586537301540375, 0.5984125733375549, 0.4601840376853943, 0.3034095764160156, 0.3463047742843628, 0.692685067653656, 0.45297110080718994, 0.7278575301170349, 0.29105764627456665, 0.27358707785606384, 0.23613479733467102, 0.2790202498435974, 0.48191410303115845, 0.43849658966064453, 0.3294207751750946, 0.2843441367149353, 0.4651975631713867, 0.2934166193008423, 0.07321714609861374, 0.3279532194137573, 0.14193934202194214, 0.14552369713783264, 0.15662695467472076, 0.4781187176704407, 0.13943231105804443, 0.5893290042877197, 0.33425623178482056, 0.4878643751144409, 0.43660247325897217, 0.5405353903770447, 0.27917173504829407, 0.7483667731285095, 0.35333821177482605, 0.25295475125312805, 0.13069754838943481, 0.2665361762046814, 0.37131446599960327, 0.07491952925920486, 0.26193511486053467, 0.5417242646217346, 0.25370854139328003, 0.10080935806035995, 0.6211541891098022, 0.23450998961925507, 0.37699195742607117, 0.22890502214431763, 0.2369394153356552, 0.6206432580947876, 0.3134201169013977, 0.40894538164138794, 0.3299790620803833, 0.8635488152503967, 0.17410193383693695, 0.14949198067188263, 0.036343082785606384, 0.9949653148651123, 0.3749062418937683, 0.3326428532600403, 0.2079501450061798, 0.23431257903575897, 0.930260956287384, 0.5458335280418396, 0.9994010329246521, 0.599639892578125, 0.31785470247268677, 0.31366682052612305, 0.2433624565601349, 0.24987006187438965, 0.5487035512924194, 0.312509685754776, 0.3924557566642761, 0.2626284062862396, 0.5452912449836731, 0.5870087146759033, 0.33046719431877136, 0.2532653212547302, 0.18302831053733826, 0.6439919471740723, 0.6916174292564392, 0.3881041407585144, 0.2893257141113281, 0.18827728927135468, 0.7071115374565125, 0.2555020749568939, 0.09302294999361038, 0.13060328364372253, 0.18457382917404175, 0.14164374768733978, 0.2012600153684616, 0.3288286328315735, 0.26595035195350647, 0.45715492963790894, 0.24786680936813354, 0.1299084722995758, 0.2552821636199951, 0.1330127716064453, 0.5411873459815979, 0.5380663275718689, 0.17584070563316345, 0.43707817792892456, 0.36628663539886475, 0.5580734014511108, 0.253223180770874, 0.41201239824295044, 0.20480820536613464, 0.28333181142807007, 0.3199649453163147, 0.625924825668335, 0.12007767707109451, 0.5583598613739014, 0.2870986759662628, 0.74615478515625, 0.5219600796699524, 0.1218603104352951, 0.3956682085990906, 0.4136515259742737, 0.09680722653865814, 0.2466411292552948, 0.7463725209236145, 0.9155184030532837, 0.1461723893880844, 0.3487684726715088, 0.4917738437652588, 0.3018046021461487, 0.22207781672477722, 0.2930561304092407, 0.18082809448242188, 0.36376744508743286, 0.24292276799678802, 0.2826884388923645, 0.18816515803337097, 0.740373432636261, 0.48665618896484375, 0.7880476713180542, 0.9822149872779846, 0.3228197693824768, 0.17027969658374786, 0.10952706634998322, 0.8156552314758301, 0.24941633641719818, 0.9047349095344543, 0.35648828744888306, 0.43828636407852173, 1.0351914167404175, 0.17691004276275635, 0.2161971777677536, 0.25873950123786926, 0.5472332239151001, 0.22823897004127502, 0.3826305866241455, 0.18613457679748535, 0.10908626019954681, 0.4552079439163208, 0.11423039436340332, 0.26527053117752075, 0.30664217472076416, 0.7111193537712097, 0.4199487566947937, 0.19351458549499512, 0.5867691040039062, 0.12031129002571106, 0.18064269423484802, 0.4504743814468384, 0.24108192324638367, 0.4239698052406311, 0.09863949567079544, 0.36941924691200256, 0.3773821294307709, 0.5046683549880981, 0.12945017218589783, 0.21656787395477295, 0.32673537731170654, 0.4606977701187134, 0.22681644558906555, 0.2038830816745758, 0.2403503954410553, 0.5888498425483704, 0.07170337438583374, 0.8810228705406189, 0.5051928162574768, 0.2768300771713257, 0.15201106667518616, 0.323768675327301, 0.39913445711135864, 0.19984853267669678, 0.32218044996261597, 0.13260459899902344, 0.1659163534641266, 0.16892364621162415, 0.6362899541854858, 0.416817843914032, 0.6179976463317871, 0.20683354139328003, 0.5851600766181946, 0.39099520444869995, 0.41490399837493896, 0.36767834424972534, 0.34707725048065186, 0.16316385567188263, 0.3969372510910034, 0.7221386432647705, 0.42575883865356445, 0.1849278211593628, 0.8254044651985168, 0.26760706305503845, 0.43157845735549927, 0.3217853605747223, 0.29963362216949463, 0.27713608741760254, 0.3350536823272705, 0.853435218334198, 0.3306742012500763, 0.479820191860199, 0.30099570751190186, 0.12826445698738098, 0.2258446216583252, 0.18215514719486237, 0.5290635228157043, 0.8485978841781616, 0.2524715065956116, 0.2045174092054367, 0.23969554901123047, 0.2187982201576233, 0.5754337310791016, 0.33417582511901855, 0.274630069732666, 0.11144296824932098, 0.77068692445755, 0.2016991376876831, 0.7785853147506714, 0.8587220311164856, 0.6907785534858704, 0.33927178382873535, 0.6331576108932495, 0.14070744812488556, 0.24224591255187988, 0.3875678777694702, 0.28113120794296265, 0.38485097885131836, 0.30958640575408936, 0.08740353584289551, 0.35592854022979736, 0.7977057695388794, 0.466633141040802, 0.4636504054069519, 0.5709050297737122, 0.41990554332733154, 0.6710145473480225, 0.9212780594825745, 0.6966543197631836, 0.6232874393463135, 0.36533963680267334, 0.6864103674888611, 0.14523757994174957, 0.40738171339035034, 0.18437877297401428, 0.07079896330833435, 0.7809891700744629, 0.3214958906173706, 0.298955500125885, 0.4655416011810303, 0.034227609634399414, 1.0097817182540894, 0.5573322176933289, 0.5698526501655579, 0.20499643683433533, 0.37830573320388794, 0.42214417457580566, 0.31246674060821533, 0.19945046305656433, 0.26021817326545715, 0.6523194909095764, 0.2764739990234375, 0.10388432443141937, 0.4802475571632385, 0.13926316797733307, 0.24287861585617065, 0.3065034747123718, 0.3366314768791199, 0.18328936398029327, 0.23420143127441406, 0.6972377896308899, 0.40463578701019287, 0.42396992444992065, 0.2574659585952759, 0.19030694663524628, 0.2758120894432068, 0.3636886477470398, 0.738416314125061, 0.8478215336799622, 0.5126222372055054, 0.4608570337295532, 0.774324357509613, 0.21302562952041626, 0.7646183371543884, 0.6721606850624084, 0.14554673433303833, 0.08497361838817596, 0.3732621669769287, 0.607024610042572, 0.17108452320098877, 0.8383805751800537, 0.8628592491149902, 0.7724499702453613, 1.0721317529678345, 0.39164698123931885, 0.5651108026504517, 0.6857443451881409, 0.33421164751052856, 0.25881919264793396, 0.49941307306289673, 0.12538477778434753, 0.2141146957874298, 0.2979392409324646, 0.22632578015327454, 0.2556408941745758, 0.4640217423439026, 0.4463500380516052, 0.2944713234901428, 0.21307264268398285, 0.22027012705802917, 0.3533703088760376, 0.693561851978302, 0.3601531982421875, 0.36298656463623047, 0.32083553075790405, 0.4188404679298401, 0.3755009174346924, 0.18203651905059814, 0.22237634658813477, 0.6392937302589417, 0.5214574337005615, 0.47451192140579224, 0.14369437098503113, 0.32471776008605957, 0.0772843062877655, 0.5836796760559082, 0.34344208240509033, 0.612318217754364, 0.37754708528518677, 0.22875811159610748, 0.43832963705062866, 0.19765904545783997, 0.4662495255470276, 0.44325894117355347, 0.9967108964920044, 0.14633557200431824, 0.33712711930274963, 0.8892598152160645, 0.06890663504600525, 0.3375856280326843, 0.3332271873950958, 0.16499543190002441, 0.4569591283798218, 0.13906177878379822, 0.4049805998802185, 1.0344102382659912, 0.40774089097976685, 0.2423821985721588, 0.6201977133750916, 0.5438123941421509, 0.19275692105293274, 0.06522546708583832, 0.3884810209274292, 0.4577808976173401, 0.35070300102233887, 0.38334763050079346, 0.09333470463752747, 0.12344647198915482, 0.5572866201400757, 0.32768428325653076, 0.48777228593826294, 0.11492153257131577, 0.16944660246372223, 0.14782212674617767, 0.565552294254303, 0.47994983196258545, 0.18758799135684967, 0.13506338000297546, 0.4410701394081116, 0.2590828239917755, 0.3260379433631897, 0.4305555820465088, 0.4935832619667053, 0.19185277819633484, 0.7450870275497437, 0.19051343202590942, 0.2608565092086792, 0.15048940479755402, 0.1409902572631836, 0.6797499060630798, 0.1314580887556076, 0.26065772771835327, 0.2214711308479309, 0.6845576763153076, 0.22032621502876282, 0.24012672901153564, 0.3608771562576294, 0.8486963510513306, 0.27628690004348755, 0.7888458967208862, 0.6598215103149414, 0.49991345405578613, 0.6554095149040222, 0.12697595357894897, 0.4692586660385132, 0.5930840969085693, 0.6020956635475159, 0.44218629598617554, 0.7707399725914001, 0.2971460819244385, 0.042474523186683655, 0.05093178153038025, 0.26413172483444214, 0.29261302947998047, 0.6740468144416809, 0.642386794090271, 0.19060979783535004, 0.44745343923568726, 0.23010951280593872, 0.8374108076095581, 0.3969663381576538, 0.5539493560791016, 0.7080454230308533, 0.8802694082260132, 0.21907523274421692, 0.09096423536539078, 0.3255878686904907, 0.2618895471096039, 0.11459379643201828, 0.36217886209487915, 0.6276103258132935, 0.35051459074020386, 0.6551405787467957, 0.17826718091964722, 0.6943532824516296, 0.6206909418106079, 0.2980826497077942, 0.5217803120613098, 0.5281776189804077, 0.09886927902698517, 0.11430519074201584, 0.10322773456573486, 0.5911137461662292, 0.5180385708808899, 0.2662074565887451, 0.36073100566864014, 0.4433303475379944, 1.0400426387786865, 0.3761970102787018, 0.15910199284553528, 0.35943710803985596, 0.4656296372413635, 0.54354327917099, 0.5084365606307983, 0.11295001953840256, 0.20225602388381958, 0.8676310181617737, 0.11221963912248611, 0.566970944404602, 0.054424360394477844, 0.18648847937583923, 0.18604320287704468, 0.538833498954773, 0.08973462879657745, 0.5501601099967957, 0.22828204929828644, 0.53533536195755, 0.6445026993751526, 0.38522857427597046, 0.09853552281856537, 0.2036580592393875, 0.042669862508773804, 0.3053717017173767, 0.5052693486213684, 0.45871615409851074, 0.0951145812869072, 0.11181873083114624, 0.2704167068004608, 0.24023759365081787, 0.637002170085907, 0.2909533381462097, 0.562957763671875, 0.8091016411781311, 0.4282454252243042, 0.09773480892181396, 0.4363359808921814, 0.280009925365448, 0.34952569007873535, 0.13714386522769928, 0.2816413640975952, 0.26530835032463074, 0.4282307028770447, 0.331693172454834, 0.2972126603126526, 0.6088297963142395, 0.11389753222465515, 0.34284156560897827, 0.14177078008651733, 0.4106382727622986, 0.3791194558143616, 0.7223008871078491, 0.28778719902038574, 0.27442312240600586, 0.17395344376564026, 0.5923450589179993, 0.4134199619293213, 0.20219793915748596, 0.7416297793388367, 0.328860342502594, 0.41443097591400146, 0.2813575863838196, 0.1875103861093521, 0.20284008979797363, 0.2258528769016266, 0.5909633040428162, 0.4577106237411499, 0.2906809449195862, 0.0847698226571083, 0.9815718531608582, 0.45501798391342163, 0.2912939786911011, 0.6909639239311218, 0.835501492023468, 0.7280168533325195, 0.22980880737304688, 0.3141043186187744, 0.624069094657898, 0.3471444547176361, 0.13245508074760437, 0.45066195726394653, 0.1692090630531311, 0.1883566677570343, 0.37508976459503174, 0.1434878706932068, 0.3275643587112427, 0.10490527004003525, 0.36042338609695435, 0.27564311027526855, 0.8622220754623413, 0.17016717791557312, 0.5408132672309875, 0.13113661110401154, 0.6827396750450134, 0.3746100068092346, 0.11244456470012665, 0.3165023922920227, 0.26005613803863525, 0.28917694091796875, 0.2610000967979431, 0.23992004990577698, 0.08026181161403656, 0.15187716484069824, 0.4146344065666199, 0.16373783349990845, 0.7305232286453247, 0.20027463138103485, 0.9003183245658875, 0.49307554960250854, 0.5022247433662415, 0.46575045585632324, 1.0122885704040527, 0.12396381795406342, 0.9883233904838562, 0.7971846461296082, 0.21431885659694672, 0.34189435839653015, 0.3568730056285858, 0.19319766759872437, 0.49792104959487915, 1.0075541734695435, 0.19448161125183105, 0.3404061198234558, 0.33668720722198486, 0.08425241708755493, 0.3468526601791382, 0.4343133568763733, 0.09024517238140106, 0.18661507964134216, 0.37175747752189636, 0.1863740086555481, 0.3260132074356079, 0.23695215582847595, 0.15610475838184357, 0.4857691526412964, 0.18402430415153503, 0.18313835561275482, 0.47287052869796753, 0.6653583645820618, 0.5357607007026672, 0.47369563579559326, 0.2670571208000183, 0.1540798842906952, 0.38409802317619324, 0.16131842136383057, 0.35396313667297363, 0.22224333882331848, 0.6158577799797058, 0.41414833068847656, 0.4218252897262573, 0.4903622269630432, 0.3021129071712494, 0.32312101125717163, 0.1174207255244255, 0.5418664813041687, 0.9071212410926819, 0.45412003993988037, 0.033528149127960205, 0.2805224657058716, 0.43971312046051025, 0.29881536960601807, 0.211138516664505, 0.24083736538887024, 0.30750107765197754, 0.39217057824134827, 0.4218851923942566, 0.4290313720703125, 0.7922989130020142, 0.357486367225647, 0.832452118396759, 0.17080962657928467, 0.3279716372489929, 0.2794986963272095, 0.31326889991760254, 0.5354873538017273, 0.6141058206558228, 0.33396315574645996, 0.12557320296764374, 0.33044618368148804, 0.5332766771316528, 0.1836530864238739, 0.54079270362854, 0.48523610830307007, 0.1598813384771347, 0.4505056142807007, 0.3528115153312683, 0.8015699982643127, 0.5967984795570374, 0.4767862558364868, 0.312349796295166, 0.2561695873737335, 0.2155294418334961, 0.33465903997421265, 0.2754240334033966, 0.8667030334472656, 0.2956621050834656, 0.5040574669837952, 0.26331278681755066, 0.6791586875915527, 0.1889754831790924, 0.3893951177597046, 0.47924649715423584, 0.6284773349761963, 0.3845537304878235, 0.24185200035572052, 0.17550936341285706, 0.5641794204711914, 0.44967204332351685, 0.3063720464706421, 0.25708895921707153, 0.24710020422935486, 0.6315463781356812, 0.18229949474334717, 0.16259613633155823, 0.28615647554397583, 0.39761197566986084, 0.655182421207428, 0.5504665374755859, 0.13383622467517853, 0.5272820591926575, 0.151988685131073, 0.46016108989715576, 0.18047821521759033, 0.1499401181936264, 0.15055815875530243, 0.8466458320617676, 0.6734258532524109, 0.6768397688865662, 0.2589476406574249, 0.7314798831939697, 0.3125886917114258, 0.5219036936759949, 0.0802830308675766, 0.46560704708099365, 0.5723691582679749, 0.3334040641784668, 0.04131917655467987, 0.16837799549102783, 0.2038605660200119, 0.520614743232727, 0.4348011612892151, 0.2796850800514221, 0.16424855589866638, 0.11143523454666138, 0.365419864654541, 0.17167556285858154, 0.16943414509296417, 0.13211596012115479, 1.0022484064102173, 0.23980559408664703, 0.22629156708717346, 0.23485180735588074, 0.14902366697788239, 0.3390124440193176, 0.3072848618030548, 0.5908059477806091, 0.20369859039783478, 0.29735249280929565, 0.26926282048225403, 0.3733898401260376, 0.257999986410141, 0.556786298751831, 0.4756612181663513, 0.2760460376739502, 0.5499020218849182, 0.21445700526237488, 0.22139811515808105, 0.29965001344680786, 0.04696236550807953, 0.4332450032234192, 0.09438599646091461, 0.473926305770874, 0.4285009503364563, 0.732222318649292, 0.8964778780937195, 0.33631986379623413, 0.14567244052886963, 0.9990360140800476, 0.3959923982620239, 0.18164238333702087, 0.5114776492118835, 0.3606770634651184, 0.2392362356185913, 0.34444743394851685, 0.3171514868736267, 0.5029731392860413, 0.3258504867553711, 0.12343571335077286, 0.1986083984375, 0.31414681673049927, 0.5475518703460693, 0.5987464189529419, 0.12665891647338867, 0.2643277645111084, 0.13464850187301636, 0.452602744102478, 0.562564492225647, 0.13732999563217163, 0.2472124695777893, 0.33442598581314087, 0.6846941113471985, 0.6221733093261719, 0.70302814245224, 0.5238828659057617, 0.6910586953163147, 0.11906619369983673, 0.1350448727607727, 0.5253187417984009, 0.4476645588874817, 0.6547354459762573, 0.62388014793396, 0.15095481276512146, 0.17435815930366516, 0.6781776547431946, 0.35391369462013245, 0.3295961022377014, 0.20900267362594604, 0.8355934023857117, 0.5349653959274292, 0.596409261226654, 0.2681116461753845, 0.28445714712142944, 0.45490390062332153, 0.7534030079841614, 0.278944194316864, 0.784989058971405, 0.387635201215744, 0.41998714208602905, 0.1708274483680725, 0.2502235770225525, 0.24084095656871796, 0.5884535908699036, 0.10656100511550903, 0.380745530128479, 0.17725901305675507, 0.16635103523731232, 0.34607192873954773, 0.05309300124645233, 0.2903207540512085, 0.725283682346344, 0.21619760990142822, 0.6024960279464722, 0.128325417637825, 0.42840248346328735, 0.4136979579925537, 0.5630790591239929, 0.5695810914039612, 0.20317807793617249, 0.8975575566291809, 0.24521958827972412, 0.3353883624076843, 0.7653428316116333, 0.27098456025123596, 0.7950872778892517, 0.6440951824188232, 0.6620096564292908, 0.7024474740028381, 0.3943168520927429, 0.177322655916214, 0.5453740358352661, 0.5338379144668579, 0.29208138585090637, 0.2564932107925415, 0.5926567316055298, 0.21533998847007751, 0.34008705615997314, 0.23016150295734406, 0.33202746510505676, 0.18285545706748962, 0.26908543705940247, 0.15747851133346558, 0.1398191750049591, 0.30297648906707764, 0.3849099278450012, 0.4554640054702759, 0.2143680453300476, 0.6545119881629944, 0.6880600452423096, 0.36808842420578003, 0.25330281257629395, 0.10107234120368958, 0.4320215582847595, 0.17993751168251038, 0.09843961894512177, 0.08403648436069489, 0.19301092624664307, 0.3646922707557678, 0.26609939336776733, 0.23554354906082153, 0.21155260503292084, 0.18892937898635864, 0.37949246168136597, 0.1617833375930786, 0.5526270866394043, 0.42827171087265015, 0.33899015188217163, 0.20060670375823975, 0.295538067817688, 0.5505247116088867, 0.5609247088432312, 0.7294676899909973, 0.09866968542337418, 0.4851539134979248, 0.8935350775718689, 0.5209978818893433, 0.2860869765281677, 0.49274468421936035, 0.10558782517910004, 0.8391387462615967, 0.7613391280174255, 0.2266632467508316, 0.19334083795547485, 0.28197234869003296, 0.7141460180282593, 0.22926759719848633, 0.12248434126377106, 0.13363376259803772, 0.3345867395401001, 0.33191365003585815, 0.3110833466053009, 0.26458290219306946, 0.15065637230873108, 0.1827116310596466, 0.1947658360004425, 0.40715116262435913, 0.12347814440727234, 0.1907917708158493, 0.10180595517158508, 0.31740617752075195, 0.4721778631210327, 0.157382071018219, 0.11364147067070007, 0.04450768232345581, 0.6813578605651855, 0.07986815273761749, 0.3282073736190796, 0.10156141221523285, 0.12452931702136993, 0.5598187446594238, 0.6544215083122253, 0.5883423089981079, 0.2687866687774658, 0.3791661858558655, 0.8587127923965454, 0.2717253565788269, 0.6749867796897888, 0.14683476090431213, 0.1553594470024109, 0.647815465927124, 0.34634554386138916, 0.4576481580734253, 0.229539692401886, 0.28801968693733215, 0.32006025314331055, 0.5322317481040955, 0.16484609246253967, 0.1362490952014923, 0.3270079493522644, 0.28592365980148315, 0.5303896069526672, 0.45005476474761963, 0.4234541654586792, 0.15838119387626648, 0.35485541820526123, 0.42253267765045166, 0.12377538532018661, 0.3706432580947876, 0.3058208227157593, 0.22911463677883148, 0.7414507269859314, 0.15581095218658447, 0.5128389000892639, 0.4122616648674011, 0.5727378726005554, 0.8300345540046692, 0.5275405645370483, 0.12155719101428986, 0.2451423704624176, 0.23218905925750732, 0.20563292503356934, 0.35980820655822754, 0.6988228559494019, 0.8699198961257935, 0.6607397198677063, 0.23776808381080627, 0.521737813949585, 0.42196792364120483, 0.7353590130805969, 0.0885595753788948, 0.1589539796113968, 0.7450971007347107, 0.5497007369995117, 0.2855914831161499, 0.2012554407119751, 0.44032084941864014, 0.8696617484092712, 0.1428796499967575, 0.18636810779571533, 0.7102928757667542, 0.10358992218971252, 0.6703433990478516, 0.30874913930892944, 0.27894461154937744, 0.47923099994659424, 0.15571807324886322, 0.8895519375801086, 0.4320383071899414, 0.24941304326057434, 0.3710605502128601, 1.0295934677124023, 0.19020217657089233, 0.588749885559082, 0.14547428488731384, 0.5985265374183655, 0.6171314120292664, 0.2346378117799759, 0.7589537501335144, 0.36684033274650574, 0.14018678665161133, 0.7988089919090271, 0.7918647527694702, 0.38104379177093506, 0.23487958312034607, 0.3297436833381653, 0.22173388302326202, 0.2006010115146637, 0.7875848412513733, 0.3343554735183716, 0.13528358936309814, 0.20349952578544617, 0.38209134340286255, 0.1551203429698944, 0.4373273253440857, 0.1440005749464035, 0.09714658558368683, 0.8384981751441956, 0.3577619791030884, 0.48228228092193604, 0.25719717144966125, 0.14847882091999054, 0.5241491198539734, 0.11893485486507416, 0.12847113609313965, 0.24036893248558044, 0.5139402151107788, 0.1786251962184906, 0.36224380135536194, 0.8092705011367798, 0.29296672344207764, 0.6107614636421204, 0.35452723503112793, 0.15119051933288574, 0.4662010669708252, 0.15169477462768555, 0.37240350246429443, 0.41813069581985474, 0.16743943095207214, 0.1413244605064392, 0.26923665404319763, 1.0308773517608643, 0.5644707679748535, 0.791102409362793, 0.2580975294113159, 0.5745455622673035, 0.3600006103515625, 0.763641893863678, 0.7315042614936829, 0.3886449933052063, 0.3022504448890686, 0.41282665729522705, 0.17970293760299683, 0.12155617773532867, 0.2500442862510681, 0.17011773586273193, 0.11626755446195602, 0.8867329359054565, 0.54970782995224, 0.3107774257659912, 0.18753471970558167, 0.27555257081985474, 0.34661102294921875, 0.2374715507030487, 0.08276596665382385, 0.5078233480453491, 0.4286339282989502, 0.16124466061592102, 0.24577666819095612, 0.32415348291397095, 0.20626316964626312, 0.1529661864042282, 0.6802642345428467, 0.2912302017211914, 0.18559563159942627, 0.19202592968940735, 0.27154919505119324, 0.5172598958015442, 0.42960745096206665, 0.3743857741355896, 0.4743024706840515, 0.22537335753440857, 0.12460767477750778, 0.6577298045158386, 0.7132704854011536, 0.6105668544769287, 0.8241499662399292, 0.5669461488723755, 0.8222866058349609, 0.8424705862998962, 0.6054602265357971, 0.4077279567718506, 0.8090746998786926, 1.0283669233322144, 0.4552190899848938, 0.20163345336914062, 0.3278942108154297, 0.6519311666488647, 1.0069867372512817, 1.0123895406723022, 0.09294135868549347, 0.6754207015037537, 0.10439597815275192, 0.8319563865661621, 0.9967108964920044, 1.006986379623413, 1.021187424659729, 0.7824955582618713, 0.2519453763961792, 0.6889159679412842, 0.49534833431243896, 0.32402312755584717, 0.6433138847351074, 0.3535463809967041, 0.8186962604522705, 0.4136970043182373, 0.2156963050365448, 0.6203827857971191, 0.4383620619773865, 0.26550447940826416, 0.4521762728691101, 0.29801493883132935, 0.2926369309425354, 0.6311038732528687, 0.2258121371269226, 0.23833942413330078, 0.8702818751335144, 0.23439934849739075, 0.26244810223579407, 0.45031803846359253, 0.44444137811660767, 0.22415176033973694, 0.2628301680088043, 0.37542277574539185, 0.06113643944263458, 0.6350322961807251, 0.49392473697662354, 0.22037211060523987, 0.39591604471206665, 0.3353543281555176, 0.32449454069137573, 0.4274212718009949, 0.44536304473876953, 0.371929407119751, 0.21553699672222137, 0.16753286123275757, 0.1377176195383072, 0.522747814655304, 0.8797469139099121, 0.2712286710739136, 0.3516390919685364, 0.13896512985229492, 0.3370159864425659, 0.22944018244743347, 0.4240199327468872, 0.22461917996406555, 0.1454773098230362, 0.20749184489250183, 0.6275050640106201, 0.2682912349700928, 0.9484135508537292, 0.5762437582015991, 0.14831212162971497, 0.12362700700759888, 0.3383222222328186, 0.27882349491119385, 0.33742308616638184, 0.6346433162689209, 0.51036536693573, 0.35605305433273315, 0.7949042916297913, 0.45641809701919556, 0.626166045665741, 0.4626457691192627, 0.49192875623703003, 0.44698768854141235, 0.7460128664970398, 0.2427540123462677, 0.4537809491157532, 0.45593321323394775, 0.08797243237495422, 0.2778896689414978, 0.6254627108573914, 0.35194262862205505, 0.20670798420906067, 0.17695850133895874, 0.6937729120254517, 0.44311559200286865, 0.49166786670684814, 0.120566725730896, 0.35079652070999146, 0.2867298126220703, 0.4635933041572571, 0.06967359036207199, 0.13343144953250885, 0.10067535191774368, 0.8822049498558044, 0.19468969106674194, 0.32183149456977844, 0.1325705200433731, 0.3542711138725281, 0.4579038619995117, 1.0047718286514282, 0.3158469498157501, 0.5095521807670593, 0.11599060148000717, 0.8945266604423523, 0.7095709443092346, 0.2702638506889343, 0.142361581325531, 0.8633509874343872, 0.8142979741096497, 0.12539663910865784, 0.22382092475891113, 0.4605334997177124, 0.63965904712677, 0.15342681109905243, 0.15983107686042786, 0.20907869935035706, 0.14158836007118225, 0.3518812656402588, 0.17812258005142212, 0.40248388051986694, 0.2603135108947754, 0.25265151262283325, 0.28602778911590576, 0.6314160823822021, 0.22300532460212708, 0.18969212472438812, 0.6055589914321899, 0.32502782344818115, 0.5123653411865234, 0.694857120513916, 0.5656772255897522, 0.46141576766967773, 0.6412640810012817, 0.7393105030059814, 0.21670441329479218, 0.39167845249176025, 0.4497171640396118, 0.4006269574165344, 0.47377604246139526, 0.5873594880104065, 0.1830196976661682, 0.4593639373779297, 0.3534277081489563, 0.36887019872665405, 0.5548250079154968, 0.2944505214691162, 0.45420682430267334, 0.48612868785858154, 0.5783664584159851, 0.17633463442325592, 0.3057153820991516, 0.1711650937795639, 0.10977759957313538, 0.28317517042160034, 0.2720855176448822, 0.35456591844558716, 0.17820927500724792, 0.8207314014434814, 0.5806164145469666, 0.1680462658405304, 0.4569830894470215, 0.47178661823272705, 0.42078113555908203, 0.1555846631526947, 0.1842297613620758, 0.45242518186569214, 0.3002794086933136, 1.0067166090011597, 0.29040732979774475, 0.22285541892051697, 0.44719547033309937, 0.22009648382663727, 0.5437346696853638, 0.7474048137664795, 0.6195181012153625, 0.31644052267074585, 0.9967113137245178, 0.6087314486503601, 0.9222543239593506, 0.205149844288826, 0.37574970722198486, 0.636718213558197, 0.7466327548027039, 0.44134193658828735, 0.6528220176696777, 0.21497198939323425, 0.09698560833930969, 0.049596428871154785, 0.3084389269351959, 0.30514559149742126, 0.43617528676986694, 0.13043534755706787, 0.11212360113859177, 0.4667317271232605, 0.474020779132843, 0.14547184109687805, 0.5740248560905457, 0.15914417803287506, 0.23017337918281555, 0.6187700033187866, 0.19115179777145386, 0.05267391353845596, 0.5121909379959106, 0.35852718353271484, 0.3521376848220825, 0.6517686247825623, 0.23266904056072235, 0.16332969069480896, 0.1747075915336609, 0.5298874974250793, 0.25787705183029175, 0.5274760723114014, 0.2038135826587677, 0.1387380063533783, 0.6421757340431213, 0.5282168388366699, 0.2382938712835312, 0.23935449123382568, 0.1262066662311554, 0.13755586743354797, 0.20422467589378357, 0.31411659717559814, 0.4951884150505066, 0.18796341121196747, 0.16240103542804718, 0.46119028329849243, 0.4303010106086731, 0.5337068438529968, 0.25390860438346863, 0.39186355471611023, 0.20608827471733093, 0.2140018343925476, 0.42731207609176636, 0.24400663375854492, 0.14327551424503326, 0.2611757516860962, 0.3065682053565979, 0.10318385064601898, 0.6860145330429077, 0.7164451479911804, 0.47656166553497314, 0.304161012172699, 0.8067029118537903, 0.49560546875, 0.14619103074073792, 0.14680644869804382, 0.13324537873268127, 0.13566450774669647, 0.10394895076751709, 0.23641568422317505, 0.33485981822013855, 0.2648553252220154, 0.15104076266288757, 0.33013033866882324, 0.6454058289527893, 0.33284127712249756, 0.2859819829463959, 0.3315712809562683, 0.08400516211986542, 0.13167893886566162, 0.35731175541877747, 0.7472570538520813, 0.3290014863014221, 0.653832733631134, 0.2442343533039093, 0.38226836919784546, 0.22226440906524658, 0.3925997018814087, 0.8683132529258728, 0.16984650492668152, 0.5778424143791199, 0.8974023461341858, 0.28949564695358276, 0.11316485702991486, 0.702153205871582, 0.1513742208480835, 0.24699890613555908, 0.45873767137527466, 0.11085925996303558, 0.11923186480998993, 0.8562077283859253, 0.17753952741622925, 0.3678630292415619, 0.2817468047142029, 0.3317106068134308, 0.13112512230873108, 0.02347637712955475, 0.19365167617797852, 0.13284790515899658, 0.38088303804397583, 0.228446364402771, 0.3722103238105774, 0.45901942253112793, 0.5106631517410278, 0.392458438873291, 0.45112287998199463, 0.5790096521377563, 0.5716410279273987, 0.31274890899658203, 0.15081052482128143, 0.19508397579193115]}
results/polish/pjm_pl_ms_how2sign/log.txt ADDED
@@ -0,0 +1,331 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [2026-10-31 22:29:18,766] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2
+ | distributed init (rank 0): env://
3
+ [2026-10-31 22:29:19,361] [INFO] [comm.py:652:init_distributed] cdb=None
4
+ [2026-10-31 22:29:19,361] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
5
+ Namespace(batch_size=8, gradient_accumulation_steps=8, gradient_clipping=1.0, epochs=20, world_size=1, dist_url='env://', local_rank=0, hidden_dim=256, finetune='out/polish/pjm_pl_ms_how2sign/best_checkpoint.pth', opt='adamw', opt_eps=1e-09, opt_betas=None, clip_grad=None, momentum=0.9, weight_decay=0.0001, sched='cosine', lr=0.001, min_lr=1e-08, warmup_epochs=0, output_dir='out/polish/eval_pjm_pl_ms_how2sign', seed=42, eval=True, num_workers=4, pin_mem=True, offload=False, dtype='bf16', zero_stage=2, compute_fp32_loss=False, quick_break=0, rgb_support=False, max_length=256, dataset='PJM', wandb=False, wandb_project='uni-sign', wandb_dir='./wandb_logs', bertscore=False, num_examples=5, patience=0, pjm_train_texts='', pjm_train_texts_p=1.0, pjm_train_csv='', pjm_texts='../CrocoSign/data/texts_pl_fixed.h5', pjm_lang='Polish', pjm_split='ms', lora=False, lora_rank=16, lora_alpha=32, lora_dropout=0.05, lora_target='q,v', lora_ckpt='', freeze_visual=False, task='SLT', label_smoothing=0.2, online_video='', rank=0, gpu=0, distributed=True, dist_backend='nccl')
6
+ Creating dataset:
7
+ PJM split family: ms (suffix='_ms')
8
+ <datasets.S2T_Dataset_PJM object at 0x732d41d86650>
9
+ <datasets.S2T_Dataset_PJM object at 0x732c78d0f520>
10
+ <datasets.S2T_Dataset_PJM object at 0x732c78d0f850>
11
+ Creating model:
12
+ /home/croco/Uni-Sign/.venv/lib/python3.10/site-packages/torch/_utils.py:831: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
13
+ return self.fget.__get__(instance, owner)()
14
+ ***********************************
15
+ Load Checkpoint...
16
+ ***********************************
17
+ Missing keys:
18
+
19
+ Unexpected keys:
20
+
21
+ number of params: 587.747368M
22
+ Using deepspeed to train...
23
+ Initializing deepspeed...
24
+ [2026-10-31 22:29:22,436] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed info: version=0.16.3, git-hash=unknown, git-branch=unknown
25
+ [2026-10-31 22:29:22,436] [INFO] [comm.py:677:init_distributed] Distributed backend already initialized
26
+ [2026-10-31 22:29:22,436] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 1
27
+ [2026-10-31 22:29:22,468] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Flops Profiler Enabled: False
28
+ [2026-10-31 22:29:22,468] [INFO] [logging.py:128:log_dist] [Rank 0] Using client Optimizer as basic optimizer
29
+ [2026-10-31 22:29:22,468] [INFO] [logging.py:128:log_dist] [Rank 0] Removing param_group that has no 'params' in the basic Optimizer
30
+ [2026-10-31 22:29:22,476] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Basic Optimizer = AdamW
31
+ [2026-10-31 22:29:22,477] [INFO] [utils.py:59:is_zero_supported_optimizer] Checking ZeRO support for optimizer=AdamW type=<class 'torch.optim.adamw.AdamW'>
32
+ [2026-10-31 22:29:22,477] [INFO] [logging.py:128:log_dist] [Rank 0] Creating torch.bfloat16 ZeRO stage 2 optimizer
33
+ [2026-10-31 22:29:22,477] [INFO] [stage_1_and_2.py:149:__init__] Reduce bucket size 500000000
34
+ [2026-10-31 22:29:22,477] [INFO] [stage_1_and_2.py:150:__init__] Allgather bucket size 500000000
35
+ [2026-10-31 22:29:22,477] [INFO] [stage_1_and_2.py:151:__init__] CPU Offload: False
36
+ [2026-10-31 22:29:22,477] [INFO] [stage_1_and_2.py:152:__init__] Round robin gradient partitioning: False
37
+ [2026-10-31 22:29:22,912] [INFO] [utils.py:781:see_memory_usage] Before initializing optimizer states
38
+ [2026-10-31 22:29:22,912] [INFO] [utils.py:782:see_memory_usage] MA 5.48 GB Max_MA 6.57 GB CA 7.31 GB Max_CA 7 GB
39
+ [2026-10-31 22:29:22,913] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 6.57 GB, percent = 10.9%
40
+ [2026-10-31 22:29:22,975] [INFO] [utils.py:781:see_memory_usage] After initializing optimizer states
41
+ [2026-10-31 22:29:22,975] [INFO] [utils.py:782:see_memory_usage] MA 5.48 GB Max_MA 7.66 GB CA 9.5 GB Max_CA 10 GB
42
+ [2026-10-31 22:29:22,975] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 6.57 GB, percent = 10.9%
43
+ [2026-10-31 22:29:22,975] [INFO] [stage_1_and_2.py:545:__init__] optimizer state initialized
44
+ [2026-10-31 22:29:23,036] [INFO] [utils.py:781:see_memory_usage] After initializing ZeRO optimizer
45
+ [2026-10-31 22:29:23,036] [INFO] [utils.py:782:see_memory_usage] MA 5.48 GB Max_MA 5.48 GB CA 9.5 GB Max_CA 10 GB
46
+ [2026-10-31 22:29:23,036] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 6.57 GB, percent = 10.9%
47
+ [2026-10-31 22:29:23,038] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Final Optimizer = DeepSpeedZeroOptimizer
48
+ [2026-10-31 22:29:23,038] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed using client LR scheduler
49
+ [2026-10-31 22:29:23,039] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed LR Scheduler = <torch.optim.lr_scheduler.LambdaLR object at 0x732c5592f8b0>
50
+ [2026-10-31 22:29:23,039] [INFO] [logging.py:128:log_dist] [Rank 0] step=0, skipped=0, lr=[0.001, 0.001], mom=[(0.9, 0.999), (0.9, 0.999)]
51
+ [2026-10-31 22:29:23,039] [INFO] [config.py:999:print] DeepSpeedEngine configuration:
52
+ [2026-10-31 22:29:23,039] [INFO] [config.py:1003:print] activation_checkpointing_config {
53
+ "partition_activations": false,
54
+ "contiguous_memory_optimization": false,
55
+ "cpu_checkpointing": false,
56
+ "number_checkpoints": null,
57
+ "synchronize_checkpoint_boundary": false,
58
+ "profile": false
59
+ }
60
+ [2026-10-31 22:29:23,039] [INFO] [config.py:1003:print] aio_config ................... {'block_size': 1048576, 'queue_depth': 8, 'thread_count': 1, 'single_submit': False, 'overlap_events': True, 'use_gds': False}
61
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] amp_enabled .................. False
62
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] amp_params ................... False
63
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] autotuning_config ............ {
64
+ "enabled": false,
65
+ "start_step": null,
66
+ "end_step": null,
67
+ "metric_path": null,
68
+ "arg_mappings": null,
69
+ "metric": "throughput",
70
+ "model_info": null,
71
+ "results_dir": "autotuning_results",
72
+ "exps_dir": "autotuning_exps",
73
+ "overwrite": true,
74
+ "fast": true,
75
+ "start_profile_step": 3,
76
+ "end_profile_step": 5,
77
+ "tuner_type": "gridsearch",
78
+ "tuner_early_stopping": 5,
79
+ "tuner_num_trials": 50,
80
+ "model_info_path": null,
81
+ "mp_size": 1,
82
+ "max_train_batch_size": null,
83
+ "min_train_batch_size": 1,
84
+ "max_train_micro_batch_size_per_gpu": 1.024000e+03,
85
+ "min_train_micro_batch_size_per_gpu": 1,
86
+ "num_tuning_micro_batch_sizes": 3
87
+ }
88
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] bfloat16_enabled ............. True
89
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] bfloat16_immediate_grad_update False
90
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] checkpoint_parallel_write_pipeline False
91
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] checkpoint_tag_validation_enabled True
92
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] checkpoint_tag_validation_fail False
93
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] comms_config ................. <deepspeed.comm.config.DeepSpeedCommsConfig object at 0x732c545d0f40>
94
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] communication_data_type ...... None
95
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] compression_config ........... {'weight_quantization': {'shared_parameters': {'enabled': False, 'quantizer_kernel': False, 'schedule_offset': 0, 'quantize_groups': 1, 'quantize_verbose': False, 'quantization_type': 'symmetric', 'quantize_weight_in_forward': False, 'rounding': 'nearest', 'fp16_mixed_quantize': False, 'quantize_change_ratio': 0.001}, 'different_groups': {}}, 'activation_quantization': {'shared_parameters': {'enabled': False, 'quantization_type': 'symmetric', 'range_calibration': 'dynamic', 'schedule_offset': 1000}, 'different_groups': {}}, 'sparse_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'row_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'head_pruning': {'shared_parameters': {'enabled': False, 'method': 'topk', 'schedule_offset': 1000}, 'different_groups': {}}, 'channel_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'layer_reduction': {'enabled': False}}
96
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] curriculum_enabled_legacy .... False
97
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] curriculum_params_legacy ..... False
98
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] data_efficiency_config ....... {'enabled': False, 'seed': 1234, 'data_sampling': {'enabled': False, 'num_epochs': 1000, 'num_workers': 0, 'curriculum_learning': {'enabled': False}}, 'data_routing': {'enabled': False, 'random_ltd': {'enabled': False, 'layer_token_lr_schedule': {'enabled': False}}}}
99
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] data_efficiency_enabled ...... False
100
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] dataloader_drop_last ......... False
101
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] disable_allgather ............ False
102
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] dump_state ................... False
103
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] dynamic_loss_scale_args ...... None
104
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] eigenvalue_enabled ........... False
105
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] eigenvalue_gas_boundary_resolution 1
106
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] eigenvalue_layer_name ........ bert.encoder.layer
107
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] eigenvalue_layer_num ......... 0
108
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] eigenvalue_max_iter .......... 100
109
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] eigenvalue_stability ......... 1e-06
110
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] eigenvalue_tol ............... 0.01
111
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] eigenvalue_verbose ........... False
112
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] elasticity_enabled ........... False
113
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] flops_profiler_config ........ {
114
+ "enabled": false,
115
+ "recompute_fwd_factor": 0.0,
116
+ "profile_step": 1,
117
+ "module_depth": -1,
118
+ "top_modules": 1,
119
+ "detailed": true,
120
+ "output_file": null
121
+ }
122
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] fp16_auto_cast ............... None
123
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] fp16_enabled ................. False
124
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] fp16_master_weights_and_gradients False
125
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] global_rank .................. 0
126
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] grad_accum_dtype ............. None
127
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] gradient_accumulation_steps .. 8
128
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] gradient_clipping ............ 1.0
129
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] gradient_predivide_factor .... 1.0
130
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] graph_harvesting ............. False
131
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] hybrid_engine ................ enabled=False max_out_tokens=512 inference_tp_size=1 release_inference_cache=False pin_parameters=True tp_gather_partition_size=8
132
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] initial_dynamic_scale ........ 1
133
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] load_universal_checkpoint .... False
134
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] loss_scale ................... 1.0
135
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] memory_breakdown ............. False
136
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] mics_hierarchial_params_gather False
137
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] mics_shard_size .............. -1
138
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] monitor_config ............... tensorboard=TensorBoardConfig(enabled=False, output_path='/ds_tensorboard_logs/', job_name='_tensorboard') comet=CometConfig(enabled=False, samples_log_interval=100, project=None, workspace=None, api_key=None, experiment_name=None, experiment_key=None, online=None, mode=None) wandb=WandbConfig(enabled=False, group=None, team=None, project='deepspeed') csv_monitor=CSVConfig(enabled=False, output_path='', job_name='DeepSpeedJobName')
139
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] nebula_config ................ {
140
+ "enabled": false,
141
+ "persistent_storage_path": null,
142
+ "persistent_time_interval": 100,
143
+ "num_of_version_in_retention": 2,
144
+ "enable_nebula_load": true,
145
+ "load_path": null
146
+ }
147
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] optimizer_legacy_fusion ...... False
148
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] optimizer_name ............... None
149
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] optimizer_params ............. None
150
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] pipeline ..................... {'stages': 'auto', 'partition': 'best', 'seed_layers': False, 'activation_checkpoint_interval': 0, 'pipe_partitioned': True, 'grad_partitioned': True}
151
+ [2026-10-31 22:29:23,040] [INFO] [config.py:1003:print] pld_enabled .................. False
152
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] pld_params ................... False
153
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] prescale_gradients ........... False
154
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] scheduler_name ............... None
155
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] scheduler_params ............. None
156
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] seq_parallel_communication_data_type torch.float32
157
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] sparse_attention ............. None
158
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] sparse_gradients_enabled ..... False
159
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] steps_per_print .............. 10
160
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] timers_config ................ enabled=True synchronized=True
161
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] train_batch_size ............. 64
162
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] train_micro_batch_size_per_gpu 8
163
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] use_data_before_expert_parallel_ False
164
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] use_node_local_storage ....... False
165
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] wall_clock_breakdown ......... False
166
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] weight_quantization_config ... None
167
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] world_size ................... 1
168
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] zero_allow_untested_optimizer False
169
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] zero_config .................. stage=2 contiguous_gradients=True reduce_scatter=True reduce_bucket_size=500000000 use_multi_rank_bucket_allreduce=True allgather_partitions=True allgather_bucket_size=500000000 overlap_comm=False load_from_fp32_weights=True elastic_checkpoint=False offload_param=DeepSpeedZeroOffloadParamConfig(device='none', nvme_path=None, buffer_count=5, buffer_size=100000000, max_in_cpu=1000000000, pin_memory=False) offload_optimizer=DeepSpeedZeroOffloadOptimizerConfig(device='none', nvme_path=None, buffer_count=4, pin_memory=False, pipeline_read=False, pipeline_write=False, fast_init=False, ratio=1.0) sub_group_size=1000000000 cpu_offload_param=None cpu_offload_use_pin_memory=None cpu_offload=None prefetch_bucket_size=30000000 param_persistence_threshold=10000 model_persistence_threshold=9223372036854775807 max_live_parameters=30000000 max_reuse_distance=1000000000 gather_16bit_weights_on_model_save=False module_granularity_threshold=0 use_all_reduce_for_fetch_params=False stage3_gather_fp16_weights_on_model_save=False ignore_unused_parameters=True legacy_stage1=False round_robin_gradients=False zero_hpz_partition_size=1 zero_quantized_weights=False zero_quantized_nontrainable_weights=False zero_quantized_gradients=False zeropp_loco_param=None mics_shard_size=-1 mics_hierarchical_params_gather=False memory_efficient_linear=False pipeline_loading_checkpoint=False override_module_apply=True
170
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] zero_enabled ................. True
171
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] zero_force_ds_cpu_optimizer .. True
172
+ [2026-10-31 22:29:23,041] [INFO] [config.py:1003:print] zero_optimization_stage ...... 2
173
+ [2026-10-31 22:29:23,041] [INFO] [config.py:989:print_user_config] json = {
174
+ "steps_per_print": 10,
175
+ "zero_optimization": {
176
+ "stage": 2,
177
+ "offload_param": {
178
+ "device": "none"
179
+ },
180
+ "offload_optimizer": {
181
+ "device": "none"
182
+ },
183
+ "stage3_param_persistence_threshold": 1.000000e+04,
184
+ "stage3_max_live_parameters": 3.000000e+07,
185
+ "stage3_prefetch_bucket_size": 3.000000e+07,
186
+ "memory_efficient_linear": false
187
+ },
188
+ "bfloat16": {
189
+ "enabled": true
190
+ },
191
+ "gradient_clipping": 1.0,
192
+ "prescale_gradients": false,
193
+ "wall_clock_breakdown": false,
194
+ "hybrid_engine": {
195
+ "enabled": false,
196
+ "max_out_tokens": 512,
197
+ "inference_tp_size": 1,
198
+ "release_inference_cache": false,
199
+ "pin_parameters": true,
200
+ "tp_gather_partition_size": 8
201
+ },
202
+ "tensorboard": {
203
+ "enabled": false,
204
+ "output_path": "/ds_tensorboard_logs/",
205
+ "job_name": "_tensorboard"
206
+ },
207
+ "train_micro_batch_size_per_gpu": 8,
208
+ "gradient_accumulation_steps": 8
209
+ }
210
+ <deepspeed.runtime.zero.stage_1_and_2.DeepSpeedZeroOptimizer object at 0x732c545d33a0>
211
+ πŸ“„ dev result
212
+ Asking to truncate to max_length but no maximum length is provided and the model has no predefined maximum length. Default to no truncation.
213
+ Test: [ 0/375] eta: 0:07:14 loss: 5.4062 (5.4062) time: 1.1579 data: 0.1248 max mem: 5848
214
+ Test: [ 10/375] eta: 0:04:50 loss: 5.2500 (5.0426) time: 0.7952 data: 0.0114 max mem: 6164
215
+ Test: [ 20/375] eta: 0:04:23 loss: 4.8750 (4.8929) time: 0.7229 data: 0.0001 max mem: 6164
216
+ Test: [ 30/375] eta: 0:04:07 loss: 5.0000 (5.0696) time: 0.6753 data: 0.0001 max mem: 6469
217
+ Test: [ 40/375] eta: 0:04:02 loss: 5.3125 (5.0777) time: 0.7023 data: 0.0001 max mem: 6469
218
+ Test: [ 50/375] eta: 0:03:49 loss: 5.1250 (5.0741) time: 0.6854 data: 0.0001 max mem: 6469
219
+ Test: [ 60/375] eta: 0:03:36 loss: 5.0000 (5.0845) time: 0.6173 data: 0.0001 max mem: 6469
220
+ Test: [ 70/375] eta: 0:03:32 loss: 4.9688 (5.0678) time: 0.6730 data: 0.0001 max mem: 6469
221
+ Test: [ 80/375] eta: 0:03:22 loss: 4.8750 (5.0440) time: 0.6749 data: 0.0001 max mem: 6469
222
+ Test: [ 90/375] eta: 0:03:11 loss: 4.8750 (5.0268) time: 0.5926 data: 0.0001 max mem: 6469
223
+ Test: [100/375] eta: 0:03:04 loss: 4.9062 (5.0121) time: 0.6085 data: 0.0001 max mem: 6472
224
+ Test: [110/375] eta: 0:02:56 loss: 4.7500 (4.9885) time: 0.6231 data: 0.0001 max mem: 6472
225
+ Test: [120/375] eta: 0:02:48 loss: 4.9375 (5.0142) time: 0.6165 data: 0.0001 max mem: 6472
226
+ Test: [130/375] eta: 0:02:42 loss: 5.1562 (5.0095) time: 0.6590 data: 0.0001 max mem: 6472
227
+ Test: [140/375] eta: 0:02:34 loss: 5.0000 (5.0098) time: 0.6441 data: 0.0001 max mem: 6472
228
+ Test: [150/375] eta: 0:02:25 loss: 5.0625 (5.0097) time: 0.5494 data: 0.0001 max mem: 6472
229
+ Test: [160/375] eta: 0:02:17 loss: 5.0625 (5.0056) time: 0.5174 data: 0.0001 max mem: 6472
230
+ Test: [170/375] eta: 0:02:08 loss: 5.1250 (5.0207) time: 0.4627 data: 0.0001 max mem: 6472
231
+ Test: [180/375] eta: 0:02:01 loss: 5.1875 (5.0271) time: 0.4836 data: 0.0001 max mem: 6472
232
+ Test: [190/375] eta: 0:01:55 loss: 5.1250 (5.0301) time: 0.5908 data: 0.0001 max mem: 6505
233
+ Test: [200/375] eta: 0:01:48 loss: 5.1250 (5.0337) time: 0.5576 data: 0.0001 max mem: 6505
234
+ Test: [210/375] eta: 0:01:40 loss: 5.0000 (5.0317) time: 0.4505 data: 0.0001 max mem: 6505
235
+ Test: [220/375] eta: 0:01:33 loss: 4.9688 (5.0294) time: 0.4882 data: 0.0001 max mem: 6624
236
+ Test: [230/375] eta: 0:01:27 loss: 4.8125 (5.0225) time: 0.5747 data: 0.0001 max mem: 6624
237
+ Test: [240/375] eta: 0:01:20 loss: 4.8125 (5.0179) time: 0.4957 data: 0.0001 max mem: 6624
238
+ Test: [250/375] eta: 0:01:14 loss: 4.9375 (5.0209) time: 0.4796 data: 0.0001 max mem: 6624
239
+ Test: [260/375] eta: 0:01:07 loss: 5.0625 (5.0250) time: 0.4752 data: 0.0001 max mem: 6624
240
+ Test: [270/375] eta: 0:01:00 loss: 5.0312 (5.0269) time: 0.3971 data: 0.0001 max mem: 6624
241
+ Test: [280/375] eta: 0:00:54 loss: 5.0625 (5.0289) time: 0.4485 data: 0.0001 max mem: 6624
242
+ Test: [290/375] eta: 0:00:48 loss: 5.0625 (5.0319) time: 0.4807 data: 0.0001 max mem: 6624
243
+ Test: [300/375] eta: 0:00:42 loss: 5.0625 (5.0298) time: 0.4347 data: 0.0000 max mem: 6624
244
+ Test: [310/375] eta: 0:00:36 loss: 5.2812 (5.0434) time: 0.4209 data: 0.0001 max mem: 6624
245
+ Test: [320/375] eta: 0:00:30 loss: 5.3125 (5.0468) time: 0.3519 data: 0.0001 max mem: 6624
246
+ Test: [330/375] eta: 0:00:24 loss: 5.1250 (5.0457) time: 0.3905 data: 0.0001 max mem: 6624
247
+ Test: [340/375] eta: 0:00:19 loss: 4.9375 (5.0390) time: 0.3773 data: 0.0000 max mem: 6624
248
+ Test: [350/375] eta: 0:00:13 loss: 4.9062 (5.0438) time: 0.2881 data: 0.0000 max mem: 6624
249
+ Test: [360/375] eta: 0:00:08 loss: 5.1250 (5.0435) time: 0.3782 data: 0.0000 max mem: 6624
250
+ Test: [370/375] eta: 0:00:02 loss: 5.0000 (5.0435) time: 0.3957 data: 0.0000 max mem: 6624
251
+ Test: [374/375] eta: 0:00:00 loss: 4.9375 (5.0412) time: 0.4326 data: 0.0000 max mem: 6624
252
+ Test: Total time: 0:03:18 (0.5297 s / it)
253
+ {'bleu1': 29.90381993071833, 'bleu2': 15.852641429872563, 'bleu3': 10.06348870225436, 'bleu4': 6.752617336925911, 'chrf': 24.1800995739229, 'avg_ref_len': 6.857666666666667, 'avg_hyp_len': 6.467333333333333, 'length_ratio': 0.9430807368881544, 'pct_empty': 0.0, 'pct_very_short': 8.666666666666666, 'pct_repetitive': 0.13333333333333333}
254
+ Rouge: 17.18
255
+ --- 5 example translations (dev) ---
256
+ [183_033_R]
257
+ ref: Bo nie zdΔ…ΕΌyΕ‚.
258
+ hyp: I wtedy siΔ™ uda.
259
+ [183_126_R]
260
+ ref: Jak migasz "Ε‚awka"?
261
+ hyp: W ogΓ³le nie mam Ε‚awki.
262
+ [183_137_R]
263
+ ref: Ja migam dwa razy.
264
+ hyp: Ja jestem wolny.
265
+ [183_006_R]
266
+ ref: OstroΕΌnie, bo jest Ε›lisko.
267
+ hyp: W jakim miejscu, gdzie?
268
+ [183_134_R]
269
+ ref: Pytam - ja gΕ‚ucha.
270
+ hyp: Myszka Miki nie wie.
271
+ --- end examples ---
272
+ πŸ“„ test result
273
+ Test: [ 0/374] eta: 0:02:06 loss: 5.5625 (5.5625) time: 0.3382 data: 0.1282 max mem: 6624
274
+ Test: [ 10/374] eta: 0:02:05 loss: 5.0938 (5.1534) time: 0.3438 data: 0.0117 max mem: 6624
275
+ Test: [ 20/374] eta: 0:01:50 loss: 5.0000 (5.0908) time: 0.3100 data: 0.0000 max mem: 6624
276
+ Test: [ 30/374] eta: 0:01:53 loss: 5.0000 (5.1270) time: 0.3208 data: 0.0000 max mem: 6624
277
+ Test: [ 40/374] eta: 0:01:48 loss: 5.1250 (5.1181) time: 0.3377 data: 0.0000 max mem: 6624
278
+ Test: [ 50/374] eta: 0:01:47 loss: 5.0938 (5.1091) time: 0.3393 data: 0.0000 max mem: 6624
279
+ Test: [ 60/374] eta: 0:01:39 loss: 5.0938 (5.1199) time: 0.2971 data: 0.0000 max mem: 6624
280
+ Test: [ 70/374] eta: 0:01:41 loss: 5.1250 (5.1232) time: 0.3323 data: 0.0000 max mem: 6624
281
+ Test: [ 80/374] eta: 0:01:37 loss: 5.1250 (5.1100) time: 0.3809 data: 0.0000 max mem: 6624
282
+ Test: [ 90/374] eta: 0:01:33 loss: 5.0000 (5.0913) time: 0.3189 data: 0.0000 max mem: 6624
283
+ Test: [100/374] eta: 0:01:29 loss: 5.0000 (5.0919) time: 0.3096 data: 0.0000 max mem: 6624
284
+ Test: [110/374] eta: 0:01:27 loss: 5.0938 (5.0977) time: 0.3351 data: 0.0000 max mem: 6624
285
+ Test: [120/374] eta: 0:01:23 loss: 5.2188 (5.1338) time: 0.3345 data: 0.0000 max mem: 6624
286
+ Test: [130/374] eta: 0:01:19 loss: 5.1875 (5.1322) time: 0.2882 data: 0.0000 max mem: 6624
287
+ Test: [140/374] eta: 0:01:14 loss: 4.9688 (5.1206) time: 0.2659 data: 0.0000 max mem: 6624
288
+ Test: [150/374] eta: 0:01:11 loss: 4.7812 (5.1002) time: 0.2754 data: 0.0000 max mem: 6624
289
+ Test: [160/374] eta: 0:01:07 loss: 4.9375 (5.1017) time: 0.2741 data: 0.0000 max mem: 6624
290
+ Test: [170/374] eta: 0:01:03 loss: 5.1875 (5.1210) time: 0.2431 data: 0.0000 max mem: 6624
291
+ Test: [180/374] eta: 0:01:01 loss: 4.9375 (5.1172) time: 0.3244 data: 0.0000 max mem: 6624
292
+ Test: [190/374] eta: 0:00:57 loss: 4.8750 (5.1083) time: 0.3473 data: 0.0000 max mem: 6624
293
+ Test: [200/374] eta: 0:00:54 loss: 4.9375 (5.1161) time: 0.3230 data: 0.0001 max mem: 6624
294
+ Test: [210/374] eta: 0:00:52 loss: 5.2500 (5.1294) time: 0.3584 data: 0.0000 max mem: 6624
295
+ Test: [220/374] eta: 0:00:48 loss: 5.1562 (5.1322) time: 0.3169 data: 0.0000 max mem: 6624
296
+ Test: [230/374] eta: 0:00:45 loss: 5.1250 (5.1353) time: 0.2744 data: 0.0000 max mem: 6624
297
+ Test: [240/374] eta: 0:00:42 loss: 5.1875 (5.1338) time: 0.3059 data: 0.0000 max mem: 6624
298
+ Test: [250/374] eta: 0:00:38 loss: 5.0000 (5.1271) time: 0.3086 data: 0.0000 max mem: 6624
299
+ Test: [260/374] eta: 0:00:35 loss: 4.8750 (5.1189) time: 0.2682 data: 0.0000 max mem: 6624
300
+ Test: [270/374] eta: 0:00:32 loss: 5.0625 (5.1191) time: 0.2557 data: 0.0000 max mem: 6624
301
+ Test: [280/374] eta: 0:00:28 loss: 5.0625 (5.1151) time: 0.2586 data: 0.0000 max mem: 6624
302
+ Test: [290/374] eta: 0:00:25 loss: 4.8438 (5.1040) time: 0.2907 data: 0.0000 max mem: 6624
303
+ Test: [300/374] eta: 0:00:22 loss: 4.8750 (5.1049) time: 0.2692 data: 0.0000 max mem: 6624
304
+ Test: [310/374] eta: 0:00:19 loss: 5.0625 (5.1068) time: 0.3305 data: 0.0001 max mem: 6624
305
+ Test: [320/374] eta: 0:00:16 loss: 5.0625 (5.1077) time: 0.3477 data: 0.0001 max mem: 6624
306
+ Test: [330/374] eta: 0:00:13 loss: 5.0000 (5.1034) time: 0.2828 data: 0.0000 max mem: 6624
307
+ Test: [340/374] eta: 0:00:10 loss: 4.9688 (5.1037) time: 0.2605 data: 0.0000 max mem: 6624
308
+ Test: [350/374] eta: 0:00:07 loss: 5.0625 (5.1039) time: 0.2508 data: 0.0000 max mem: 6624
309
+ Test: [360/374] eta: 0:00:04 loss: 5.0000 (5.0999) time: 0.3307 data: 0.0001 max mem: 6624
310
+ Test: [370/374] eta: 0:00:01 loss: 5.0000 (5.0997) time: 0.3533 data: 0.0001 max mem: 6624
311
+ Test: [373/374] eta: 0:00:00 loss: 5.0312 (5.0981) time: 0.3636 data: 0.0000 max mem: 6624
312
+ Test: Total time: 0:01:55 (0.3080 s / it)
313
+ {'bleu1': 28.91094895192965, 'bleu2': 14.841459509327095, 'bleu3': 9.212056123525025, 'bleu4': 5.989543995054258, 'chrf': 23.211310693350974, 'avg_ref_len': 6.882490793438232, 'avg_hyp_len': 6.443588885169066, 'length_ratio': 0.9362292051756008, 'pct_empty': 0.0, 'pct_very_short': 9.13960495480415, 'pct_repetitive': 0.1004352192835621}
314
+ Rouge: 15.79
315
+ --- 5 example translations (test) ---
316
+ [183_116_R]
317
+ ref: WymyΕ›liΕ‚ to i na tej podstawie to robi, to fajnie.
318
+ hyp: Dokładnie zamigać nie wolno.
319
+ [472_011_M]
320
+ ref: Kradnie kosz i stawia jΔ… na rower.
321
+ hyp: ProwadziΕ‚ kosz na rowerze.
322
+ [247_042_R]
323
+ ref: Wiesz, pΕ‚ot....
324
+ hyp: UciekajΔ… i uciekajΔ….
325
+ [183_002_R]
326
+ ref: Jest ślisko i można się przewrócić.
327
+ hyp: No tak, tak.
328
+ [001_003_M]
329
+ ref: MΓ³wiΕ‚am, pies patrzy z gΓ³ry na ΕΌabΔ™ siedzΔ…cΔ… w sΕ‚oju.
330
+ hyp: Pies patrzy w gΓ³rΔ™ i patrzy w gΓ³rΔ™.
331
+ --- end examples ---
results/polish/pjm_pl_ms_how2sign/test_tmp_pres.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/pjm_pl_ms_how2sign/test_tmp_refs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/pjm_pl_ms_how2sign/train.log.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da965acb9711f87005f3d8d623a8c5e509107b870ffa62d675d891576ff0d9bf
3
+ size 234027
results/polish/pjm_pl_si_how2sign/bleurt_BLEURT-20.json ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/pjm_pl_si_how2sign/log.txt ADDED
@@ -0,0 +1,504 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [2026-11-01 05:55:30,381] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
2
+ | distributed init (rank 0): env://
3
+ [2026-11-01 05:55:30,918] [INFO] [comm.py:652:init_distributed] cdb=None
4
+ [2026-11-01 05:55:30,918] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
5
+ Namespace(batch_size=8, gradient_accumulation_steps=8, gradient_clipping=1.0, epochs=20, world_size=1, dist_url='env://', local_rank=0, hidden_dim=256, finetune='out/polish/pjm_pl_si_how2sign/best_checkpoint.pth', opt='adamw', opt_eps=1e-09, opt_betas=None, clip_grad=None, momentum=0.9, weight_decay=0.0001, sched='cosine', lr=0.001, min_lr=1e-08, warmup_epochs=0, output_dir='out/polish/eval_pjm_pl_si_how2sign', seed=42, eval=True, num_workers=4, pin_mem=True, offload=False, dtype='bf16', zero_stage=2, compute_fp32_loss=False, quick_break=0, rgb_support=False, max_length=256, dataset='PJM', wandb=False, wandb_project='uni-sign', wandb_dir='./wandb_logs', bertscore=False, num_examples=5, patience=0, pjm_train_texts='', pjm_train_texts_p=1.0, pjm_train_csv='', pjm_texts='../CrocoSign/data/texts_pl_fixed.h5', pjm_lang='Polish', pjm_split='filtered', lora=False, lora_rank=16, lora_alpha=32, lora_dropout=0.05, lora_target='q,v', lora_ckpt='', freeze_visual=False, task='SLT', label_smoothing=0.2, online_video='', rank=0, gpu=0, distributed=True, dist_backend='nccl')
6
+ Creating dataset:
7
+ PJM split family: filtered (suffix='_filtered')
8
+ <datasets.S2T_Dataset_PJM object at 0x7a31e6b86650>
9
+ <datasets.S2T_Dataset_PJM object at 0x7a312190b4f0>
10
+ <datasets.S2T_Dataset_PJM object at 0x7a312190b820>
11
+ Creating model:
12
+ /home/croco/Uni-Sign/.venv/lib/python3.10/site-packages/torch/_utils.py:831: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()
13
+ return self.fget.__get__(instance, owner)()
14
+ ***********************************
15
+ Load Checkpoint...
16
+ ***********************************
17
+ Missing keys:
18
+
19
+ Unexpected keys:
20
+
21
+ number of params: 587.747368M
22
+ Using deepspeed to train...
23
+ Initializing deepspeed...
24
+ [2026-11-01 05:55:33,962] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed info: version=0.16.3, git-hash=unknown, git-branch=unknown
25
+ [2026-11-01 05:55:33,962] [INFO] [comm.py:677:init_distributed] Distributed backend already initialized
26
+ [2026-11-01 05:55:33,962] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 1
27
+ [2026-11-01 05:55:33,994] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Flops Profiler Enabled: False
28
+ [2026-11-01 05:55:33,994] [INFO] [logging.py:128:log_dist] [Rank 0] Using client Optimizer as basic optimizer
29
+ [2026-11-01 05:55:33,994] [INFO] [logging.py:128:log_dist] [Rank 0] Removing param_group that has no 'params' in the basic Optimizer
30
+ [2026-11-01 05:55:34,003] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Basic Optimizer = AdamW
31
+ [2026-11-01 05:55:34,003] [INFO] [utils.py:59:is_zero_supported_optimizer] Checking ZeRO support for optimizer=AdamW type=<class 'torch.optim.adamw.AdamW'>
32
+ [2026-11-01 05:55:34,003] [INFO] [logging.py:128:log_dist] [Rank 0] Creating torch.bfloat16 ZeRO stage 2 optimizer
33
+ [2026-11-01 05:55:34,003] [INFO] [stage_1_and_2.py:149:__init__] Reduce bucket size 500000000
34
+ [2026-11-01 05:55:34,003] [INFO] [stage_1_and_2.py:150:__init__] Allgather bucket size 500000000
35
+ [2026-11-01 05:55:34,003] [INFO] [stage_1_and_2.py:151:__init__] CPU Offload: False
36
+ [2026-11-01 05:55:34,003] [INFO] [stage_1_and_2.py:152:__init__] Round robin gradient partitioning: False
37
+ [2026-11-01 05:55:34,439] [INFO] [utils.py:781:see_memory_usage] Before initializing optimizer states
38
+ [2026-11-01 05:55:34,439] [INFO] [utils.py:782:see_memory_usage] MA 5.48 GB Max_MA 6.57 GB CA 7.31 GB Max_CA 7 GB
39
+ [2026-11-01 05:55:34,439] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 5.95 GB, percent = 9.8%
40
+ [2026-11-01 05:55:34,501] [INFO] [utils.py:781:see_memory_usage] After initializing optimizer states
41
+ [2026-11-01 05:55:34,501] [INFO] [utils.py:782:see_memory_usage] MA 5.48 GB Max_MA 7.66 GB CA 9.5 GB Max_CA 10 GB
42
+ [2026-11-01 05:55:34,501] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 5.95 GB, percent = 9.8%
43
+ [2026-11-01 05:55:34,501] [INFO] [stage_1_and_2.py:545:__init__] optimizer state initialized
44
+ [2026-11-01 05:55:34,561] [INFO] [utils.py:781:see_memory_usage] After initializing ZeRO optimizer
45
+ [2026-11-01 05:55:34,561] [INFO] [utils.py:782:see_memory_usage] MA 5.48 GB Max_MA 5.48 GB CA 9.5 GB Max_CA 10 GB
46
+ [2026-11-01 05:55:34,561] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 5.95 GB, percent = 9.8%
47
+ [2026-11-01 05:55:34,564] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Final Optimizer = DeepSpeedZeroOptimizer
48
+ [2026-11-01 05:55:34,564] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed using client LR scheduler
49
+ [2026-11-01 05:55:34,564] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed LR Scheduler = <torch.optim.lr_scheduler.LambdaLR object at 0x7a30ed607880>
50
+ [2026-11-01 05:55:34,564] [INFO] [logging.py:128:log_dist] [Rank 0] step=0, skipped=0, lr=[0.001, 0.001], mom=[(0.9, 0.999), (0.9, 0.999)]
51
+ [2026-11-01 05:55:34,565] [INFO] [config.py:999:print] DeepSpeedEngine configuration:
52
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] activation_checkpointing_config {
53
+ "partition_activations": false,
54
+ "contiguous_memory_optimization": false,
55
+ "cpu_checkpointing": false,
56
+ "number_checkpoints": null,
57
+ "synchronize_checkpoint_boundary": false,
58
+ "profile": false
59
+ }
60
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] aio_config ................... {'block_size': 1048576, 'queue_depth': 8, 'thread_count': 1, 'single_submit': False, 'overlap_events': True, 'use_gds': False}
61
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] amp_enabled .................. False
62
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] amp_params ................... False
63
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] autotuning_config ............ {
64
+ "enabled": false,
65
+ "start_step": null,
66
+ "end_step": null,
67
+ "metric_path": null,
68
+ "arg_mappings": null,
69
+ "metric": "throughput",
70
+ "model_info": null,
71
+ "results_dir": "autotuning_results",
72
+ "exps_dir": "autotuning_exps",
73
+ "overwrite": true,
74
+ "fast": true,
75
+ "start_profile_step": 3,
76
+ "end_profile_step": 5,
77
+ "tuner_type": "gridsearch",
78
+ "tuner_early_stopping": 5,
79
+ "tuner_num_trials": 50,
80
+ "model_info_path": null,
81
+ "mp_size": 1,
82
+ "max_train_batch_size": null,
83
+ "min_train_batch_size": 1,
84
+ "max_train_micro_batch_size_per_gpu": 1.024000e+03,
85
+ "min_train_micro_batch_size_per_gpu": 1,
86
+ "num_tuning_micro_batch_sizes": 3
87
+ }
88
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] bfloat16_enabled ............. True
89
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] bfloat16_immediate_grad_update False
90
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] checkpoint_parallel_write_pipeline False
91
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] checkpoint_tag_validation_enabled True
92
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] checkpoint_tag_validation_fail False
93
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] comms_config ................. <deepspeed.comm.config.DeepSpeedCommsConfig object at 0x7a30ec4d8f10>
94
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] communication_data_type ...... None
95
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] compression_config ........... {'weight_quantization': {'shared_parameters': {'enabled': False, 'quantizer_kernel': False, 'schedule_offset': 0, 'quantize_groups': 1, 'quantize_verbose': False, 'quantization_type': 'symmetric', 'quantize_weight_in_forward': False, 'rounding': 'nearest', 'fp16_mixed_quantize': False, 'quantize_change_ratio': 0.001}, 'different_groups': {}}, 'activation_quantization': {'shared_parameters': {'enabled': False, 'quantization_type': 'symmetric', 'range_calibration': 'dynamic', 'schedule_offset': 1000}, 'different_groups': {}}, 'sparse_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'row_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'head_pruning': {'shared_parameters': {'enabled': False, 'method': 'topk', 'schedule_offset': 1000}, 'different_groups': {}}, 'channel_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'layer_reduction': {'enabled': False}}
96
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] curriculum_enabled_legacy .... False
97
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] curriculum_params_legacy ..... False
98
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] data_efficiency_config ....... {'enabled': False, 'seed': 1234, 'data_sampling': {'enabled': False, 'num_epochs': 1000, 'num_workers': 0, 'curriculum_learning': {'enabled': False}}, 'data_routing': {'enabled': False, 'random_ltd': {'enabled': False, 'layer_token_lr_schedule': {'enabled': False}}}}
99
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] data_efficiency_enabled ...... False
100
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] dataloader_drop_last ......... False
101
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] disable_allgather ............ False
102
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] dump_state ................... False
103
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] dynamic_loss_scale_args ...... None
104
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] eigenvalue_enabled ........... False
105
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] eigenvalue_gas_boundary_resolution 1
106
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] eigenvalue_layer_name ........ bert.encoder.layer
107
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] eigenvalue_layer_num ......... 0
108
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] eigenvalue_max_iter .......... 100
109
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] eigenvalue_stability ......... 1e-06
110
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] eigenvalue_tol ............... 0.01
111
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] eigenvalue_verbose ........... False
112
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] elasticity_enabled ........... False
113
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] flops_profiler_config ........ {
114
+ "enabled": false,
115
+ "recompute_fwd_factor": 0.0,
116
+ "profile_step": 1,
117
+ "module_depth": -1,
118
+ "top_modules": 1,
119
+ "detailed": true,
120
+ "output_file": null
121
+ }
122
+ [2026-11-01 05:55:34,565] [INFO] [config.py:1003:print] fp16_auto_cast ............... None
123
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] fp16_enabled ................. False
124
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] fp16_master_weights_and_gradients False
125
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] global_rank .................. 0
126
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] grad_accum_dtype ............. None
127
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] gradient_accumulation_steps .. 8
128
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] gradient_clipping ............ 1.0
129
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] gradient_predivide_factor .... 1.0
130
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] graph_harvesting ............. False
131
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] hybrid_engine ................ enabled=False max_out_tokens=512 inference_tp_size=1 release_inference_cache=False pin_parameters=True tp_gather_partition_size=8
132
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] initial_dynamic_scale ........ 1
133
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] load_universal_checkpoint .... False
134
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] loss_scale ................... 1.0
135
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] memory_breakdown ............. False
136
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] mics_hierarchial_params_gather False
137
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] mics_shard_size .............. -1
138
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] monitor_config ............... tensorboard=TensorBoardConfig(enabled=False, output_path='/ds_tensorboard_logs/', job_name='_tensorboard') comet=CometConfig(enabled=False, samples_log_interval=100, project=None, workspace=None, api_key=None, experiment_name=None, experiment_key=None, online=None, mode=None) wandb=WandbConfig(enabled=False, group=None, team=None, project='deepspeed') csv_monitor=CSVConfig(enabled=False, output_path='', job_name='DeepSpeedJobName')
139
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] nebula_config ................ {
140
+ "enabled": false,
141
+ "persistent_storage_path": null,
142
+ "persistent_time_interval": 100,
143
+ "num_of_version_in_retention": 2,
144
+ "enable_nebula_load": true,
145
+ "load_path": null
146
+ }
147
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] optimizer_legacy_fusion ...... False
148
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] optimizer_name ............... None
149
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] optimizer_params ............. None
150
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] pipeline ..................... {'stages': 'auto', 'partition': 'best', 'seed_layers': False, 'activation_checkpoint_interval': 0, 'pipe_partitioned': True, 'grad_partitioned': True}
151
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] pld_enabled .................. False
152
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] pld_params ................... False
153
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] prescale_gradients ........... False
154
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] scheduler_name ............... None
155
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] scheduler_params ............. None
156
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] seq_parallel_communication_data_type torch.float32
157
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] sparse_attention ............. None
158
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] sparse_gradients_enabled ..... False
159
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] steps_per_print .............. 10
160
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] timers_config ................ enabled=True synchronized=True
161
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] train_batch_size ............. 64
162
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] train_micro_batch_size_per_gpu 8
163
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] use_data_before_expert_parallel_ False
164
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] use_node_local_storage ....... False
165
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] wall_clock_breakdown ......... False
166
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] weight_quantization_config ... None
167
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] world_size ................... 1
168
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] zero_allow_untested_optimizer False
169
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] zero_config .................. stage=2 contiguous_gradients=True reduce_scatter=True reduce_bucket_size=500000000 use_multi_rank_bucket_allreduce=True allgather_partitions=True allgather_bucket_size=500000000 overlap_comm=False load_from_fp32_weights=True elastic_checkpoint=False offload_param=DeepSpeedZeroOffloadParamConfig(device='none', nvme_path=None, buffer_count=5, buffer_size=100000000, max_in_cpu=1000000000, pin_memory=False) offload_optimizer=DeepSpeedZeroOffloadOptimizerConfig(device='none', nvme_path=None, buffer_count=4, pin_memory=False, pipeline_read=False, pipeline_write=False, fast_init=False, ratio=1.0) sub_group_size=1000000000 cpu_offload_param=None cpu_offload_use_pin_memory=None cpu_offload=None prefetch_bucket_size=30000000 param_persistence_threshold=10000 model_persistence_threshold=9223372036854775807 max_live_parameters=30000000 max_reuse_distance=1000000000 gather_16bit_weights_on_model_save=False module_granularity_threshold=0 use_all_reduce_for_fetch_params=False stage3_gather_fp16_weights_on_model_save=False ignore_unused_parameters=True legacy_stage1=False round_robin_gradients=False zero_hpz_partition_size=1 zero_quantized_weights=False zero_quantized_nontrainable_weights=False zero_quantized_gradients=False zeropp_loco_param=None mics_shard_size=-1 mics_hierarchical_params_gather=False memory_efficient_linear=False pipeline_loading_checkpoint=False override_module_apply=True
170
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] zero_enabled ................. True
171
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] zero_force_ds_cpu_optimizer .. True
172
+ [2026-11-01 05:55:34,566] [INFO] [config.py:1003:print] zero_optimization_stage ...... 2
173
+ [2026-11-01 05:55:34,566] [INFO] [config.py:989:print_user_config] json = {
174
+ "steps_per_print": 10,
175
+ "zero_optimization": {
176
+ "stage": 2,
177
+ "offload_param": {
178
+ "device": "none"
179
+ },
180
+ "offload_optimizer": {
181
+ "device": "none"
182
+ },
183
+ "stage3_param_persistence_threshold": 1.000000e+04,
184
+ "stage3_max_live_parameters": 3.000000e+07,
185
+ "stage3_prefetch_bucket_size": 3.000000e+07,
186
+ "memory_efficient_linear": false
187
+ },
188
+ "bfloat16": {
189
+ "enabled": true
190
+ },
191
+ "gradient_clipping": 1.0,
192
+ "prescale_gradients": false,
193
+ "wall_clock_breakdown": false,
194
+ "hybrid_engine": {
195
+ "enabled": false,
196
+ "max_out_tokens": 512,
197
+ "inference_tp_size": 1,
198
+ "release_inference_cache": false,
199
+ "pin_parameters": true,
200
+ "tp_gather_partition_size": 8
201
+ },
202
+ "tensorboard": {
203
+ "enabled": false,
204
+ "output_path": "/ds_tensorboard_logs/",
205
+ "job_name": "_tensorboard"
206
+ },
207
+ "train_micro_batch_size_per_gpu": 8,
208
+ "gradient_accumulation_steps": 8
209
+ }
210
+ <deepspeed.runtime.zero.stage_1_and_2.DeepSpeedZeroOptimizer object at 0x7a30ec4db3d0>
211
+ πŸ“„ dev result
212
+ Asking to truncate to max_length but no maximum length is provided and the model has no predefined maximum length. Default to no truncation.
213
+ Test: [ 0/1245] eta: 0:25:46 loss: 7.3125 (7.3125) time: 1.2418 data: 0.1366 max mem: 6083
214
+ Test: [ 10/1245] eta: 0:17:28 loss: 7.0625 (6.9545) time: 0.8489 data: 0.0125 max mem: 6123
215
+ Test: [ 20/1245] eta: 0:17:19 loss: 6.5000 (6.6071) time: 0.8287 data: 0.0001 max mem: 6457
216
+ Test: [ 30/1245] eta: 0:17:17 loss: 5.6250 (6.1734) time: 0.8569 data: 0.0001 max mem: 6457
217
+ Test: [ 40/1245] eta: 0:16:14 loss: 5.6250 (6.1288) time: 0.7679 data: 0.0001 max mem: 6463
218
+ Test: [ 50/1245] eta: 0:15:20 loss: 6.1250 (6.1373) time: 0.6414 data: 0.0001 max mem: 6463
219
+ Test: [ 60/1245] eta: 0:14:44 loss: 5.8125 (6.0384) time: 0.6170 data: 0.0001 max mem: 6463
220
+ Test: [ 70/1245] eta: 0:14:51 loss: 5.6562 (6.0057) time: 0.7295 data: 0.0001 max mem: 6463
221
+ Test: [ 80/1245] eta: 0:14:14 loss: 5.6250 (5.9286) time: 0.6962 data: 0.0001 max mem: 6463
222
+ Test: [ 90/1245] eta: 0:13:44 loss: 5.8125 (5.9677) time: 0.5537 data: 0.0001 max mem: 6463
223
+ Test: [ 100/1245] eta: 0:13:37 loss: 5.8125 (5.9134) time: 0.6345 data: 0.0001 max mem: 6463
224
+ Test: [ 110/1245] eta: 0:12:48 loss: 5.5625 (5.9226) time: 0.5098 data: 0.0001 max mem: 6463
225
+ Test: [ 120/1245] eta: 0:12:16 loss: 6.1562 (5.9587) time: 0.3546 data: 0.0000 max mem: 6463
226
+ Test: [ 130/1245] eta: 0:11:57 loss: 6.0938 (5.9656) time: 0.4590 data: 0.0000 max mem: 6463
227
+ Test: [ 140/1245] eta: 0:11:28 loss: 6.0000 (5.9681) time: 0.4336 data: 0.0001 max mem: 6463
228
+ Test: [ 150/1245] eta: 0:11:20 loss: 6.0000 (5.9888) time: 0.4716 data: 0.0001 max mem: 6463
229
+ Test: [ 160/1245] eta: 0:11:05 loss: 6.4375 (6.0140) time: 0.5457 data: 0.0001 max mem: 6463
230
+ Test: [ 170/1245] eta: 0:10:47 loss: 6.0625 (5.9892) time: 0.4588 data: 0.0001 max mem: 6463
231
+ Test: [ 180/1245] eta: 0:10:31 loss: 5.8125 (5.9833) time: 0.4229 data: 0.0001 max mem: 6463
232
+ Test: [ 190/1245] eta: 0:10:12 loss: 5.9375 (5.9959) time: 0.3996 data: 0.0001 max mem: 6463
233
+ Test: [ 200/1245] eta: 0:09:58 loss: 6.1875 (6.0118) time: 0.3931 data: 0.0001 max mem: 6463
234
+ Test: [ 210/1245] eta: 0:09:43 loss: 6.1875 (6.0188) time: 0.3992 data: 0.0001 max mem: 6465
235
+ Test: [ 220/1245] eta: 0:09:32 loss: 6.0625 (6.0233) time: 0.4188 data: 0.0001 max mem: 6465
236
+ Test: [ 230/1245] eta: 0:09:25 loss: 5.7500 (6.0093) time: 0.4886 data: 0.0001 max mem: 6465
237
+ Test: [ 240/1245] eta: 0:09:08 loss: 5.6250 (6.0027) time: 0.3980 data: 0.0001 max mem: 6465
238
+ Test: [ 250/1245] eta: 0:08:59 loss: 5.8750 (5.9912) time: 0.3702 data: 0.0001 max mem: 6465
239
+ Test: [ 260/1245] eta: 0:08:53 loss: 6.0312 (5.9981) time: 0.4902 data: 0.0001 max mem: 6465
240
+ Test: [ 270/1245] eta: 0:08:36 loss: 5.9375 (5.9903) time: 0.3785 data: 0.0001 max mem: 6465
241
+ Test: [ 280/1245] eta: 0:08:22 loss: 5.6562 (5.9722) time: 0.2521 data: 0.0000 max mem: 6465
242
+ Test: [ 290/1245] eta: 0:08:12 loss: 5.7500 (5.9726) time: 0.3124 data: 0.0001 max mem: 6465
243
+ Test: [ 300/1245] eta: 0:08:05 loss: 5.7500 (5.9595) time: 0.4173 data: 0.0001 max mem: 6465
244
+ Test: [ 310/1245] eta: 0:07:54 loss: 5.4375 (5.9506) time: 0.3916 data: 0.0001 max mem: 6504
245
+ Test: [ 320/1245] eta: 0:07:44 loss: 6.2500 (5.9835) time: 0.3289 data: 0.0001 max mem: 6504
246
+ Test: [ 330/1245] eta: 0:07:41 loss: 6.2500 (5.9721) time: 0.4585 data: 0.0001 max mem: 6504
247
+ Test: [ 340/1245] eta: 0:07:34 loss: 5.7812 (5.9748) time: 0.4960 data: 0.0001 max mem: 6504
248
+ Test: [ 350/1245] eta: 0:07:27 loss: 6.0625 (5.9808) time: 0.4198 data: 0.0001 max mem: 6504
249
+ Test: [ 360/1245] eta: 0:07:16 loss: 5.9375 (5.9757) time: 0.3547 data: 0.0001 max mem: 6504
250
+ Test: [ 370/1245] eta: 0:07:06 loss: 5.6875 (5.9639) time: 0.2751 data: 0.0001 max mem: 6504
251
+ Test: [ 380/1245] eta: 0:06:55 loss: 5.6875 (5.9619) time: 0.2427 data: 0.0000 max mem: 6504
252
+ Test: [ 390/1245] eta: 0:06:44 loss: 5.8125 (5.9602) time: 0.2132 data: 0.0000 max mem: 6504
253
+ Test: [ 400/1245] eta: 0:06:40 loss: 5.9375 (5.9637) time: 0.3592 data: 0.0001 max mem: 6504
254
+ Test: [ 410/1245] eta: 0:06:35 loss: 6.1250 (5.9635) time: 0.4749 data: 0.0001 max mem: 6504
255
+ Test: [ 420/1245] eta: 0:06:28 loss: 5.6875 (5.9630) time: 0.3910 data: 0.0001 max mem: 6504
256
+ Test: [ 430/1245] eta: 0:06:22 loss: 5.6250 (5.9598) time: 0.3772 data: 0.0001 max mem: 6504
257
+ Test: [ 440/1245] eta: 0:06:13 loss: 5.5625 (5.9599) time: 0.3334 data: 0.0000 max mem: 6504
258
+ Test: [ 450/1245] eta: 0:06:08 loss: 5.5000 (5.9525) time: 0.3560 data: 0.0001 max mem: 6504
259
+ Test: [ 460/1245] eta: 0:06:00 loss: 5.7500 (5.9496) time: 0.3601 data: 0.0001 max mem: 6504
260
+ Test: [ 470/1245] eta: 0:05:53 loss: 5.7500 (5.9455) time: 0.2833 data: 0.0000 max mem: 6504
261
+ Test: [ 480/1245] eta: 0:05:48 loss: 5.8125 (5.9490) time: 0.3463 data: 0.0001 max mem: 6504
262
+ Test: [ 490/1245] eta: 0:05:41 loss: 6.0000 (5.9515) time: 0.3669 data: 0.0001 max mem: 6504
263
+ Test: [ 500/1245] eta: 0:05:34 loss: 5.9688 (5.9489) time: 0.3016 data: 0.0000 max mem: 6504
264
+ Test: [ 510/1245] eta: 0:05:26 loss: 5.9062 (5.9535) time: 0.2372 data: 0.0000 max mem: 6504
265
+ Test: [ 520/1245] eta: 0:05:21 loss: 6.1250 (5.9535) time: 0.2998 data: 0.0000 max mem: 6504
266
+ Test: [ 530/1245] eta: 0:05:15 loss: 5.8750 (5.9499) time: 0.3475 data: 0.0000 max mem: 6504
267
+ Test: [ 540/1245] eta: 0:05:09 loss: 5.7500 (5.9476) time: 0.3409 data: 0.0001 max mem: 6504
268
+ Test: [ 550/1245] eta: 0:05:03 loss: 5.7500 (5.9447) time: 0.3218 data: 0.0001 max mem: 6504
269
+ Test: [ 560/1245] eta: 0:04:55 loss: 6.0938 (5.9547) time: 0.2287 data: 0.0000 max mem: 6504
270
+ Test: [ 570/1245] eta: 0:04:49 loss: 6.3750 (5.9610) time: 0.2308 data: 0.0000 max mem: 6504
271
+ Test: [ 580/1245] eta: 0:04:42 loss: 6.4375 (5.9678) time: 0.2439 data: 0.0001 max mem: 6504
272
+ Test: [ 590/1245] eta: 0:04:38 loss: 6.6250 (5.9810) time: 0.3267 data: 0.0001 max mem: 6504
273
+ Test: [ 600/1245] eta: 0:04:34 loss: 6.3750 (5.9879) time: 0.4060 data: 0.0001 max mem: 6504
274
+ Test: [ 610/1245] eta: 0:04:29 loss: 6.2500 (5.9835) time: 0.3790 data: 0.0001 max mem: 6504
275
+ Test: [ 620/1245] eta: 0:04:22 loss: 5.5625 (5.9776) time: 0.2982 data: 0.0001 max mem: 6504
276
+ Test: [ 630/1245] eta: 0:04:17 loss: 6.0000 (5.9850) time: 0.2518 data: 0.0001 max mem: 6504
277
+ Test: [ 640/1245] eta: 0:04:12 loss: 6.2500 (5.9878) time: 0.2913 data: 0.0001 max mem: 6504
278
+ Test: [ 650/1245] eta: 0:04:06 loss: 6.0000 (5.9868) time: 0.2589 data: 0.0000 max mem: 6504
279
+ Test: [ 660/1245] eta: 0:04:01 loss: 6.0000 (5.9896) time: 0.3047 data: 0.0001 max mem: 6504
280
+ Test: [ 670/1245] eta: 0:03:56 loss: 6.0938 (5.9905) time: 0.3505 data: 0.0001 max mem: 6504
281
+ Test: [ 680/1245] eta: 0:03:51 loss: 5.7812 (5.9806) time: 0.2937 data: 0.0000 max mem: 6504
282
+ Test: [ 690/1245] eta: 0:03:46 loss: 5.6250 (5.9807) time: 0.2785 data: 0.0001 max mem: 6504
283
+ Test: [ 700/1245] eta: 0:03:41 loss: 6.0625 (5.9837) time: 0.3187 data: 0.0000 max mem: 6504
284
+ Test: [ 710/1245] eta: 0:03:37 loss: 5.6875 (5.9783) time: 0.3345 data: 0.0001 max mem: 6504
285
+ Test: [ 720/1245] eta: 0:03:32 loss: 5.6562 (5.9746) time: 0.2917 data: 0.0001 max mem: 6504
286
+ Test: [ 730/1245] eta: 0:03:27 loss: 5.6875 (5.9705) time: 0.2693 data: 0.0000 max mem: 6504
287
+ Test: [ 740/1245] eta: 0:03:23 loss: 5.8125 (5.9716) time: 0.3354 data: 0.0001 max mem: 6504
288
+ Test: [ 750/1245] eta: 0:03:18 loss: 6.0312 (5.9777) time: 0.3677 data: 0.0001 max mem: 6506
289
+ Test: [ 760/1245] eta: 0:03:14 loss: 6.0938 (5.9794) time: 0.3232 data: 0.0000 max mem: 6510
290
+ Test: [ 770/1245] eta: 0:03:08 loss: 6.1562 (5.9818) time: 0.2716 data: 0.0000 max mem: 6510
291
+ Test: [ 780/1245] eta: 0:03:03 loss: 5.9375 (5.9781) time: 0.2250 data: 0.0000 max mem: 6510
292
+ Test: [ 790/1245] eta: 0:02:59 loss: 6.1562 (5.9837) time: 0.2944 data: 0.0000 max mem: 6510
293
+ Test: [ 800/1245] eta: 0:02:55 loss: 6.0000 (5.9792) time: 0.3374 data: 0.0000 max mem: 6510
294
+ Test: [ 810/1245] eta: 0:02:50 loss: 5.9688 (5.9823) time: 0.2564 data: 0.0000 max mem: 6510
295
+ Test: [ 820/1245] eta: 0:02:45 loss: 6.1250 (5.9830) time: 0.2097 data: 0.0000 max mem: 6510
296
+ Test: [ 830/1245] eta: 0:02:40 loss: 5.9688 (5.9851) time: 0.2270 data: 0.0000 max mem: 6510
297
+ Test: [ 840/1245] eta: 0:02:37 loss: 5.9688 (5.9866) time: 0.3272 data: 0.0001 max mem: 6510
298
+ Test: [ 850/1245] eta: 0:02:33 loss: 6.2188 (5.9934) time: 0.4264 data: 0.0001 max mem: 6510
299
+ Test: [ 860/1245] eta: 0:02:29 loss: 6.3125 (5.9964) time: 0.3483 data: 0.0001 max mem: 6510
300
+ Test: [ 870/1245] eta: 0:02:24 loss: 6.3750 (6.0050) time: 0.2837 data: 0.0000 max mem: 6510
301
+ Test: [ 880/1245] eta: 0:02:20 loss: 6.1250 (6.0052) time: 0.3253 data: 0.0001 max mem: 6510
302
+ Test: [ 890/1245] eta: 0:02:17 loss: 6.0000 (6.0047) time: 0.3923 data: 0.0001 max mem: 6510
303
+ Test: [ 900/1245] eta: 0:02:13 loss: 5.8750 (6.0019) time: 0.4094 data: 0.0001 max mem: 6510
304
+ Test: [ 910/1245] eta: 0:02:08 loss: 5.7500 (6.0015) time: 0.3091 data: 0.0001 max mem: 6510
305
+ Test: [ 920/1245] eta: 0:02:04 loss: 6.0000 (6.0011) time: 0.2355 data: 0.0001 max mem: 6510
306
+ Test: [ 930/1245] eta: 0:02:00 loss: 5.9062 (5.9986) time: 0.2350 data: 0.0000 max mem: 6510
307
+ Test: [ 940/1245] eta: 0:01:56 loss: 5.8125 (5.9961) time: 0.2703 data: 0.0000 max mem: 6510
308
+ Test: [ 950/1245] eta: 0:01:51 loss: 5.9375 (5.9991) time: 0.2670 data: 0.0000 max mem: 6510
309
+ Test: [ 960/1245] eta: 0:01:48 loss: 5.9375 (5.9950) time: 0.3271 data: 0.0000 max mem: 6510
310
+ Test: [ 970/1245] eta: 0:01:44 loss: 5.8750 (5.9967) time: 0.3945 data: 0.0001 max mem: 6510
311
+ Test: [ 980/1245] eta: 0:01:40 loss: 5.9375 (5.9965) time: 0.3620 data: 0.0001 max mem: 6510
312
+ Test: [ 990/1245] eta: 0:01:36 loss: 6.1875 (5.9994) time: 0.2955 data: 0.0001 max mem: 6510
313
+ Test: [1000/1245] eta: 0:01:32 loss: 6.0938 (5.9967) time: 0.2243 data: 0.0000 max mem: 6510
314
+ Test: [1010/1245] eta: 0:01:28 loss: 5.9375 (5.9975) time: 0.2960 data: 0.0001 max mem: 6510
315
+ Test: [1020/1245] eta: 0:01:24 loss: 6.1250 (6.0018) time: 0.3741 data: 0.0001 max mem: 6510
316
+ Test: [1030/1245] eta: 0:01:20 loss: 6.2188 (6.0029) time: 0.3091 data: 0.0000 max mem: 6510
317
+ Test: [1040/1245] eta: 0:01:16 loss: 5.9375 (5.9991) time: 0.3163 data: 0.0001 max mem: 6510
318
+ Test: [1050/1245] eta: 0:01:12 loss: 5.3125 (5.9933) time: 0.3460 data: 0.0001 max mem: 6510
319
+ Test: [1060/1245] eta: 0:01:09 loss: 5.4375 (5.9880) time: 0.3189 data: 0.0001 max mem: 6510
320
+ Test: [1070/1245] eta: 0:01:05 loss: 5.6250 (5.9883) time: 0.2926 data: 0.0001 max mem: 6510
321
+ Test: [1080/1245] eta: 0:01:01 loss: 5.7188 (5.9838) time: 0.2442 data: 0.0000 max mem: 6510
322
+ Test: [1090/1245] eta: 0:00:57 loss: 5.6875 (5.9829) time: 0.2234 data: 0.0000 max mem: 6510
323
+ Test: [1100/1245] eta: 0:00:53 loss: 5.7500 (5.9812) time: 0.2402 data: 0.0000 max mem: 6510
324
+ Test: [1110/1245] eta: 0:00:49 loss: 5.6250 (5.9775) time: 0.2960 data: 0.0000 max mem: 6510
325
+ Test: [1120/1245] eta: 0:00:45 loss: 5.8438 (5.9766) time: 0.3053 data: 0.0000 max mem: 6510
326
+ Test: [1130/1245] eta: 0:00:42 loss: 5.8438 (5.9746) time: 0.2457 data: 0.0000 max mem: 6510
327
+ Test: [1140/1245] eta: 0:00:38 loss: 5.6250 (5.9715) time: 0.2806 data: 0.0001 max mem: 6510
328
+ Test: [1150/1245] eta: 0:00:34 loss: 5.6562 (5.9699) time: 0.3190 data: 0.0001 max mem: 6510
329
+ Test: [1160/1245] eta: 0:00:31 loss: 6.0000 (5.9713) time: 0.3065 data: 0.0000 max mem: 6510
330
+ Test: [1170/1245] eta: 0:00:27 loss: 6.0000 (5.9706) time: 0.3095 data: 0.0001 max mem: 6510
331
+ Test: [1180/1245] eta: 0:00:23 loss: 5.7500 (5.9699) time: 0.3104 data: 0.0001 max mem: 6510
332
+ Test: [1190/1245] eta: 0:00:20 loss: 5.6875 (5.9683) time: 0.3102 data: 0.0001 max mem: 6510
333
+ Test: [1200/1245] eta: 0:00:16 loss: 5.9375 (5.9691) time: 0.3458 data: 0.0001 max mem: 6510
334
+ Test: [1210/1245] eta: 0:00:12 loss: 6.0000 (5.9690) time: 0.3397 data: 0.0001 max mem: 6510
335
+ Test: [1220/1245] eta: 0:00:09 loss: 6.1875 (5.9733) time: 0.3130 data: 0.0001 max mem: 6510
336
+ Test: [1230/1245] eta: 0:00:05 loss: 6.2188 (5.9730) time: 0.2852 data: 0.0001 max mem: 6510
337
+ Test: [1240/1245] eta: 0:00:01 loss: 6.1250 (5.9728) time: 0.2153 data: 0.0000 max mem: 6510
338
+ Test: [1244/1245] eta: 0:00:00 loss: 5.9375 (5.9730) time: 0.2898 data: 0.0000 max mem: 6510
339
+ Test: Total time: 0:07:30 (0.3617 s / it)
340
+ {'bleu1': 26.02170573595225, 'bleu2': 11.683104437935318, 'bleu3': 6.650106518366639, 'bleu4': 4.080432761834349, 'chrf': 20.339850290025495, 'avg_ref_len': 7.021193250301326, 'avg_hyp_len': 6.862093210124548, 'length_ratio': 0.9773400283249646, 'pct_empty': 0.0, 'pct_very_short': 7.382482924869425, 'pct_repetitive': 0.020088388911209322}
341
+ Rouge: 12.01
342
+ --- 5 example translations (dev) ---
343
+ [008_002_L]
344
+ ref: W poniedziaΕ‚ek nie pracowaΕ‚em.
345
+ hyp: Od poniedziaΕ‚ku do piΔ…tku pracujΔ™.
346
+ [008_007_L]
347
+ ref: Ja w poniedziaΕ‚ek zawsze odprowadzam kogoΕ›.
348
+ hyp: Ja nie udawaΕ‚em, ΕΌe ten czΕ‚owiek przychodzi do lekarza i krΔ™ci gΕ‚owΔ….
349
+ [008_008_L]
350
+ ref: Odprowadzam go za rΔ™kΔ™, dlatego nie mogΔ™ w tym terminie.
351
+ hyp: On bierze zamach i dotyka rΔ™kΔ… policjanta.
352
+ [008_009_L]
353
+ ref: Odprowadzam maΕ‚ego wnuka do przedszkola.
354
+ hyp: Dobrze, nie mogΔ™, ale pies szybko biegnie i wpada do wody.
355
+ [008_010_L]
356
+ ref: Wnuk zawsze gra z dziećmi w piłkę nożną.
357
+ hyp: SΔ… rolki oraz deskorolka.
358
+ --- end examples ---
359
+ πŸ“„ test result
360
+ Test: [ 0/1239] eta: 0:06:21 loss: 6.6250 (6.6250) time: 0.3081 data: 0.1291 max mem: 6510
361
+ Test: [ 10/1239] eta: 0:04:58 loss: 6.5000 (6.4545) time: 0.2429 data: 0.0118 max mem: 6510
362
+ Test: [ 20/1239] eta: 0:04:46 loss: 6.5000 (6.6592) time: 0.2318 data: 0.0001 max mem: 6510
363
+ Test: [ 30/1239] eta: 0:04:47 loss: 6.2812 (6.4607) time: 0.2352 data: 0.0001 max mem: 6510
364
+ Test: [ 40/1239] eta: 0:04:50 loss: 5.9375 (6.2370) time: 0.2491 data: 0.0001 max mem: 6510
365
+ Test: [ 50/1239] eta: 0:04:50 loss: 5.7500 (6.2181) time: 0.2548 data: 0.0001 max mem: 6510
366
+ Test: [ 60/1239] eta: 0:04:57 loss: 6.1562 (6.2177) time: 0.2724 data: 0.0001 max mem: 6510
367
+ Test: [ 70/1239] eta: 0:04:52 loss: 5.9062 (6.1673) time: 0.2653 data: 0.0001 max mem: 6510
368
+ Test: [ 80/1239] eta: 0:04:45 loss: 5.6875 (6.1215) time: 0.2291 data: 0.0001 max mem: 6510
369
+ Test: [ 90/1239] eta: 0:04:36 loss: 5.1875 (6.0062) time: 0.2065 data: 0.0001 max mem: 6510
370
+ Test: [ 100/1239] eta: 0:04:29 loss: 5.3438 (6.0294) time: 0.1987 data: 0.0001 max mem: 6510
371
+ Test: [ 110/1239] eta: 0:04:23 loss: 6.3125 (6.0828) time: 0.2021 data: 0.0000 max mem: 6510
372
+ Test: [ 120/1239] eta: 0:04:17 loss: 6.8125 (6.1606) time: 0.1952 data: 0.0000 max mem: 6510
373
+ Test: [ 130/1239] eta: 0:04:12 loss: 6.8125 (6.1951) time: 0.1954 data: 0.0000 max mem: 6510
374
+ Test: [ 140/1239] eta: 0:04:07 loss: 6.7500 (6.2371) time: 0.1980 data: 0.0001 max mem: 6510
375
+ Test: [ 150/1239] eta: 0:04:04 loss: 6.3438 (6.2169) time: 0.2031 data: 0.0001 max mem: 6510
376
+ Test: [ 160/1239] eta: 0:04:04 loss: 5.8125 (6.1904) time: 0.2378 data: 0.0000 max mem: 6510
377
+ Test: [ 170/1239] eta: 0:03:58 loss: 5.9375 (6.1895) time: 0.2149 data: 0.0000 max mem: 6510
378
+ Test: [ 180/1239] eta: 0:03:55 loss: 6.0625 (6.1768) time: 0.1832 data: 0.0000 max mem: 6510
379
+ Test: [ 190/1239] eta: 0:03:53 loss: 6.0000 (6.1718) time: 0.2118 data: 0.0001 max mem: 6510
380
+ Test: [ 200/1239] eta: 0:03:53 loss: 6.0000 (6.1608) time: 0.2460 data: 0.0001 max mem: 6510
381
+ Test: [ 210/1239] eta: 0:03:51 loss: 5.8125 (6.1475) time: 0.2494 data: 0.0001 max mem: 6510
382
+ Test: [ 220/1239] eta: 0:03:52 loss: 6.0000 (6.1455) time: 0.2689 data: 0.0001 max mem: 6510
383
+ Test: [ 230/1239] eta: 0:03:50 loss: 6.0625 (6.1403) time: 0.2691 data: 0.0001 max mem: 6510
384
+ Test: [ 240/1239] eta: 0:03:48 loss: 5.9688 (6.1249) time: 0.2303 data: 0.0001 max mem: 6510
385
+ Test: [ 250/1239] eta: 0:03:48 loss: 5.8750 (6.1128) time: 0.2525 data: 0.0001 max mem: 6510
386
+ Test: [ 260/1239] eta: 0:03:47 loss: 5.7188 (6.0965) time: 0.2783 data: 0.0001 max mem: 6510
387
+ Test: [ 270/1239] eta: 0:03:45 loss: 5.6250 (6.0814) time: 0.2656 data: 0.0001 max mem: 6510
388
+ Test: [ 280/1239] eta: 0:03:43 loss: 5.5000 (6.0656) time: 0.2404 data: 0.0001 max mem: 6510
389
+ Test: [ 290/1239] eta: 0:03:39 loss: 5.5000 (6.0563) time: 0.2118 data: 0.0001 max mem: 6510
390
+ Test: [ 300/1239] eta: 0:03:37 loss: 5.6875 (6.0472) time: 0.2170 data: 0.0000 max mem: 6510
391
+ Test: [ 310/1239] eta: 0:03:35 loss: 5.8125 (6.0438) time: 0.2326 data: 0.0001 max mem: 6510
392
+ Test: [ 320/1239] eta: 0:03:33 loss: 5.9062 (6.0404) time: 0.2424 data: 0.0001 max mem: 6510
393
+ Test: [ 330/1239] eta: 0:03:32 loss: 5.7500 (6.0329) time: 0.2707 data: 0.0001 max mem: 6517
394
+ Test: [ 340/1239] eta: 0:03:29 loss: 5.6875 (6.0251) time: 0.2468 data: 0.0000 max mem: 6517
395
+ Test: [ 350/1239] eta: 0:03:26 loss: 5.6875 (6.0143) time: 0.2110 data: 0.0000 max mem: 6517
396
+ Test: [ 360/1239] eta: 0:03:25 loss: 5.7812 (6.0182) time: 0.2373 data: 0.0001 max mem: 6517
397
+ Test: [ 370/1239] eta: 0:03:25 loss: 6.1250 (6.0156) time: 0.2943 data: 0.0001 max mem: 6517
398
+ Test: [ 380/1239] eta: 0:03:23 loss: 5.9062 (6.0160) time: 0.2934 data: 0.0001 max mem: 6517
399
+ Test: [ 390/1239] eta: 0:03:20 loss: 5.9375 (6.0165) time: 0.2425 data: 0.0001 max mem: 6517
400
+ Test: [ 400/1239] eta: 0:03:18 loss: 5.8750 (6.0166) time: 0.2366 data: 0.0000 max mem: 6517
401
+ Test: [ 410/1239] eta: 0:03:15 loss: 5.9375 (6.0186) time: 0.2230 data: 0.0000 max mem: 6517
402
+ Test: [ 420/1239] eta: 0:03:13 loss: 5.9375 (6.0139) time: 0.2376 data: 0.0000 max mem: 6517
403
+ Test: [ 430/1239] eta: 0:03:10 loss: 5.8125 (6.0143) time: 0.2394 data: 0.0000 max mem: 6517
404
+ Test: [ 440/1239] eta: 0:03:08 loss: 6.4375 (6.0303) time: 0.2143 data: 0.0001 max mem: 6517
405
+ Test: [ 450/1239] eta: 0:03:07 loss: 6.5000 (6.0365) time: 0.2722 data: 0.0001 max mem: 6517
406
+ Test: [ 460/1239] eta: 0:03:04 loss: 6.0000 (6.0299) time: 0.2732 data: 0.0000 max mem: 6517
407
+ Test: [ 470/1239] eta: 0:03:03 loss: 5.9062 (6.0304) time: 0.2706 data: 0.0000 max mem: 6517
408
+ Test: [ 480/1239] eta: 0:03:02 loss: 6.0000 (6.0328) time: 0.3227 data: 0.0001 max mem: 6517
409
+ Test: [ 490/1239] eta: 0:03:00 loss: 5.8125 (6.0258) time: 0.3044 data: 0.0001 max mem: 6517
410
+ Test: [ 500/1239] eta: 0:02:59 loss: 6.0625 (6.0293) time: 0.2785 data: 0.0001 max mem: 6517
411
+ Test: [ 510/1239] eta: 0:02:56 loss: 6.1250 (6.0322) time: 0.2668 data: 0.0001 max mem: 6517
412
+ Test: [ 520/1239] eta: 0:02:53 loss: 5.8125 (6.0277) time: 0.2252 data: 0.0001 max mem: 6517
413
+ Test: [ 530/1239] eta: 0:02:51 loss: 5.5625 (6.0182) time: 0.2250 data: 0.0000 max mem: 6517
414
+ Test: [ 540/1239] eta: 0:02:48 loss: 5.4062 (6.0087) time: 0.2251 data: 0.0000 max mem: 6517
415
+ Test: [ 550/1239] eta: 0:02:46 loss: 5.6250 (6.0096) time: 0.2215 data: 0.0000 max mem: 6517
416
+ Test: [ 560/1239] eta: 0:02:43 loss: 5.8750 (6.0078) time: 0.2295 data: 0.0000 max mem: 6517
417
+ Test: [ 570/1239] eta: 0:02:41 loss: 5.8125 (6.0044) time: 0.2359 data: 0.0000 max mem: 6517
418
+ Test: [ 580/1239] eta: 0:02:38 loss: 5.8438 (6.0069) time: 0.2498 data: 0.0000 max mem: 6517
419
+ Test: [ 590/1239] eta: 0:02:37 loss: 5.9375 (6.0060) time: 0.2850 data: 0.0001 max mem: 6517
420
+ Test: [ 600/1239] eta: 0:02:35 loss: 5.9688 (6.0067) time: 0.3126 data: 0.0001 max mem: 6517
421
+ Test: [ 610/1239] eta: 0:02:34 loss: 5.5000 (5.9993) time: 0.3410 data: 0.0001 max mem: 6517
422
+ Test: [ 620/1239] eta: 0:02:33 loss: 5.9688 (6.0068) time: 0.3636 data: 0.0001 max mem: 6517
423
+ Test: [ 630/1239] eta: 0:02:30 loss: 5.8750 (5.9967) time: 0.2902 data: 0.0000 max mem: 6517
424
+ Test: [ 640/1239] eta: 0:02:29 loss: 5.3438 (5.9926) time: 0.2925 data: 0.0000 max mem: 6517
425
+ Test: [ 650/1239] eta: 0:02:26 loss: 5.4375 (5.9876) time: 0.2982 data: 0.0000 max mem: 6517
426
+ Test: [ 660/1239] eta: 0:02:23 loss: 5.5000 (5.9858) time: 0.2453 data: 0.0000 max mem: 6517
427
+ Test: [ 670/1239] eta: 0:02:21 loss: 5.8438 (5.9843) time: 0.2537 data: 0.0000 max mem: 6517
428
+ Test: [ 680/1239] eta: 0:02:19 loss: 5.6250 (5.9825) time: 0.2612 data: 0.0000 max mem: 6517
429
+ Test: [ 690/1239] eta: 0:02:16 loss: 5.7500 (5.9797) time: 0.2725 data: 0.0001 max mem: 6517
430
+ Test: [ 700/1239] eta: 0:02:14 loss: 5.7812 (5.9790) time: 0.2452 data: 0.0001 max mem: 6517
431
+ Test: [ 710/1239] eta: 0:02:11 loss: 5.5625 (5.9716) time: 0.2151 data: 0.0000 max mem: 6517
432
+ Test: [ 720/1239] eta: 0:02:09 loss: 5.8125 (5.9768) time: 0.2552 data: 0.0000 max mem: 6517
433
+ Test: [ 730/1239] eta: 0:02:07 loss: 6.1875 (5.9804) time: 0.3010 data: 0.0001 max mem: 6517
434
+ Test: [ 740/1239] eta: 0:02:04 loss: 6.1875 (5.9815) time: 0.2858 data: 0.0000 max mem: 6517
435
+ Test: [ 750/1239] eta: 0:02:01 loss: 6.2500 (5.9892) time: 0.2253 data: 0.0000 max mem: 6517
436
+ Test: [ 760/1239] eta: 0:01:59 loss: 6.3750 (5.9903) time: 0.1924 data: 0.0000 max mem: 6517
437
+ Test: [ 770/1239] eta: 0:01:57 loss: 6.0625 (5.9897) time: 0.2769 data: 0.0001 max mem: 6517
438
+ Test: [ 780/1239] eta: 0:01:54 loss: 5.9375 (5.9897) time: 0.3175 data: 0.0001 max mem: 6517
439
+ Test: [ 790/1239] eta: 0:01:51 loss: 5.7812 (5.9852) time: 0.2243 data: 0.0000 max mem: 6517
440
+ Test: [ 800/1239] eta: 0:01:49 loss: 5.7500 (5.9824) time: 0.2065 data: 0.0000 max mem: 6517
441
+ Test: [ 810/1239] eta: 0:01:47 loss: 5.6250 (5.9768) time: 0.2784 data: 0.0001 max mem: 6627
442
+ Test: [ 820/1239] eta: 0:01:44 loss: 5.7188 (5.9776) time: 0.2727 data: 0.0000 max mem: 6627
443
+ Test: [ 830/1239] eta: 0:01:41 loss: 6.0000 (5.9817) time: 0.1882 data: 0.0000 max mem: 6627
444
+ Test: [ 840/1239] eta: 0:01:38 loss: 6.4062 (5.9853) time: 0.1743 data: 0.0000 max mem: 6627
445
+ Test: [ 850/1239] eta: 0:01:36 loss: 6.3125 (5.9864) time: 0.2169 data: 0.0000 max mem: 6627
446
+ Test: [ 860/1239] eta: 0:01:33 loss: 6.0938 (5.9868) time: 0.2362 data: 0.0000 max mem: 6627
447
+ Test: [ 870/1239] eta: 0:01:31 loss: 6.0312 (5.9860) time: 0.2680 data: 0.0001 max mem: 6627
448
+ Test: [ 880/1239] eta: 0:01:29 loss: 5.6875 (5.9807) time: 0.3245 data: 0.0001 max mem: 6627
449
+ Test: [ 890/1239] eta: 0:01:27 loss: 5.7500 (5.9821) time: 0.3848 data: 0.0001 max mem: 6627
450
+ Test: [ 900/1239] eta: 0:01:25 loss: 5.9375 (5.9822) time: 0.3426 data: 0.0001 max mem: 6627
451
+ Test: [ 910/1239] eta: 0:01:22 loss: 5.9062 (5.9809) time: 0.2480 data: 0.0000 max mem: 6627
452
+ Test: [ 920/1239] eta: 0:01:20 loss: 6.1250 (5.9851) time: 0.2272 data: 0.0000 max mem: 6627
453
+ Test: [ 930/1239] eta: 0:01:17 loss: 6.1250 (5.9828) time: 0.2451 data: 0.0001 max mem: 6627
454
+ Test: [ 940/1239] eta: 0:01:15 loss: 5.7812 (5.9806) time: 0.2516 data: 0.0000 max mem: 6627
455
+ Test: [ 950/1239] eta: 0:01:12 loss: 5.7812 (5.9794) time: 0.2881 data: 0.0000 max mem: 6627
456
+ Test: [ 960/1239] eta: 0:01:10 loss: 5.9375 (5.9804) time: 0.2961 data: 0.0000 max mem: 6627
457
+ Test: [ 970/1239] eta: 0:01:07 loss: 5.7188 (5.9768) time: 0.2464 data: 0.0000 max mem: 6627
458
+ Test: [ 980/1239] eta: 0:01:05 loss: 5.5625 (5.9742) time: 0.2181 data: 0.0001 max mem: 6627
459
+ Test: [ 990/1239] eta: 0:01:02 loss: 5.9062 (5.9756) time: 0.2683 data: 0.0000 max mem: 6627
460
+ Test: [1000/1239] eta: 0:01:00 loss: 5.9062 (5.9713) time: 0.3222 data: 0.0001 max mem: 6627
461
+ Test: [1010/1239] eta: 0:00:57 loss: 5.4688 (5.9672) time: 0.3022 data: 0.0001 max mem: 6627
462
+ Test: [1020/1239] eta: 0:00:55 loss: 5.6250 (5.9652) time: 0.2421 data: 0.0000 max mem: 6627
463
+ Test: [1030/1239] eta: 0:00:52 loss: 6.2500 (5.9703) time: 0.1744 data: 0.0000 max mem: 6627
464
+ Test: [1040/1239] eta: 0:00:49 loss: 6.5000 (5.9745) time: 0.1817 data: 0.0000 max mem: 6627
465
+ Test: [1050/1239] eta: 0:00:47 loss: 6.5000 (5.9792) time: 0.2191 data: 0.0001 max mem: 6627
466
+ Test: [1060/1239] eta: 0:00:44 loss: 5.8125 (5.9727) time: 0.2269 data: 0.0000 max mem: 6627
467
+ Test: [1070/1239] eta: 0:00:42 loss: 5.6875 (5.9753) time: 0.2472 data: 0.0000 max mem: 6627
468
+ Test: [1080/1239] eta: 0:00:39 loss: 5.6875 (5.9707) time: 0.2742 data: 0.0000 max mem: 6627
469
+ Test: [1090/1239] eta: 0:00:37 loss: 5.5312 (5.9681) time: 0.2710 data: 0.0001 max mem: 6627
470
+ Test: [1100/1239] eta: 0:00:34 loss: 5.6562 (5.9666) time: 0.2765 data: 0.0001 max mem: 6627
471
+ Test: [1110/1239] eta: 0:00:32 loss: 5.5625 (5.9654) time: 0.2637 data: 0.0001 max mem: 6627
472
+ Test: [1120/1239] eta: 0:00:29 loss: 5.5625 (5.9625) time: 0.2394 data: 0.0001 max mem: 6627
473
+ Test: [1130/1239] eta: 0:00:27 loss: 5.6562 (5.9619) time: 0.2296 data: 0.0001 max mem: 6627
474
+ Test: [1140/1239] eta: 0:00:24 loss: 6.0000 (5.9632) time: 0.2646 data: 0.0001 max mem: 6627
475
+ Test: [1150/1239] eta: 0:00:22 loss: 6.0000 (5.9651) time: 0.3053 data: 0.0000 max mem: 6627
476
+ Test: [1160/1239] eta: 0:00:19 loss: 6.3125 (5.9696) time: 0.3009 data: 0.0001 max mem: 6627
477
+ Test: [1170/1239] eta: 0:00:17 loss: 6.1875 (5.9689) time: 0.2620 data: 0.0001 max mem: 6627
478
+ Test: [1180/1239] eta: 0:00:14 loss: 6.0000 (5.9720) time: 0.2148 data: 0.0000 max mem: 6627
479
+ Test: [1190/1239] eta: 0:00:12 loss: 6.0000 (5.9727) time: 0.2442 data: 0.0001 max mem: 6627
480
+ Test: [1200/1239] eta: 0:00:09 loss: 5.8750 (5.9735) time: 0.3186 data: 0.0001 max mem: 6627
481
+ Test: [1210/1239] eta: 0:00:07 loss: 6.1250 (5.9748) time: 0.3227 data: 0.0001 max mem: 6627
482
+ Test: [1220/1239] eta: 0:00:04 loss: 6.1250 (5.9750) time: 0.2511 data: 0.0000 max mem: 6627
483
+ Test: [1230/1239] eta: 0:00:02 loss: 5.8438 (5.9726) time: 0.2251 data: 0.0000 max mem: 6627
484
+ Test: [1238/1239] eta: 0:00:00 loss: 5.8125 (5.9726) time: 0.3087 data: 0.0000 max mem: 6627
485
+ Test: Total time: 0:05:14 (0.2540 s / it)
486
+ {'bleu1': 25.725140898508933, 'bleu2': 11.199775545814571, 'bleu3': 6.319816191210624, 'bleu4': 3.845575199557246, 'chrf': 19.639151846839816, 'avg_ref_len': 6.686074672048436, 'avg_hyp_len': 6.530373360242179, 'length_ratio': 0.9767125975339198, 'pct_empty': 0.0, 'pct_very_short': 7.911200807265389, 'pct_repetitive': 0.04036326942482341}
487
+ Rouge: 11.41
488
+ --- 5 example translations (test) ---
489
+ [008_000_R]
490
+ ref: Tak samo przez caΕ‚y miesiΔ…c.
491
+ hyp: Dobrze, zgadzam siΔ™ z tobΔ….
492
+ [008_003_R]
493
+ ref: Co chcesz robić? Pomyśl co zrobisz w domu.
494
+ hyp: W pracy moΕΌna, myΕ›lΔ™, ΕΌe w domu.
495
+ [008_004_R]
496
+ ref: Nie chcesz?
497
+ hyp: Dobra, powiedziaΕ‚aΕ› mi.
498
+ [008_005_R]
499
+ ref: Luty dwa tysiΔ…ce jedenastego roku?
500
+ hyp: Wtorek, dwudziestego trzeciego.
501
+ [008_006_R]
502
+ ref: Dwa tysiΔ…ce jedenasty rok.
503
+ hyp: Policjant biegnie za nimi.
504
+ --- end examples ---
results/polish/pjm_pl_si_how2sign/test_tmp_pres.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/pjm_pl_si_how2sign/test_tmp_refs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/polish/pjm_pl_si_how2sign/train.log.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:632bb8ff11b6c561354fbed1f3853edcfb652fd313e8bfe6a01a9d9c94056d30
3
+ size 269214
results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/bleurt_Elron_bleurt-large-512.json ADDED
@@ -0,0 +1,2942 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "Elron/bleurt-large-512",
3
+ "n": 2935,
4
+ "mean": -0.906317200420307,
5
+ "per_sample": [
6
+ -0.38956472277641296,
7
+ -1.1855705976486206,
8
+ -1.2034639120101929,
9
+ -1.1066949367523193,
10
+ 0.18039511144161224,
11
+ -1.2046540975570679,
12
+ -1.0601543188095093,
13
+ -0.04723753035068512,
14
+ -1.614257574081421,
15
+ 0.3928844630718231,
16
+ 0.14619813859462738,
17
+ 0.31998106837272644,
18
+ -1.1916860342025757,
19
+ 0.35767778754234314,
20
+ -1.0414798259735107,
21
+ -0.14591838419437408,
22
+ -0.9184208512306213,
23
+ -1.0898618698120117,
24
+ -0.5703432559967041,
25
+ -0.831530749797821,
26
+ -1.0481716394424438,
27
+ -0.993707001209259,
28
+ -1.4381718635559082,
29
+ -0.6301512122154236,
30
+ -0.6964874267578125,
31
+ -0.8270342946052551,
32
+ -0.689982533454895,
33
+ -0.8005251288414001,
34
+ -0.6519079804420471,
35
+ -0.4935205280780792,
36
+ -1.3816919326782227,
37
+ -1.196715235710144,
38
+ -0.42095956206321716,
39
+ -1.0348759889602661,
40
+ -1.5265711545944214,
41
+ -0.22406722605228424,
42
+ -1.5937294960021973,
43
+ -1.257860779762268,
44
+ -1.4338980913162231,
45
+ -1.545195460319519,
46
+ -1.2346001863479614,
47
+ -1.3307336568832397,
48
+ -1.519486904144287,
49
+ -1.0701658725738525,
50
+ -0.5062053203582764,
51
+ -1.034941554069519,
52
+ -0.8688845634460449,
53
+ -1.5403066873550415,
54
+ -0.943644642829895,
55
+ -1.440820336341858,
56
+ -0.9017980694770813,
57
+ -0.4995407164096832,
58
+ -0.8497966527938843,
59
+ -0.32160237431526184,
60
+ -1.0595911741256714,
61
+ -0.46899399161338806,
62
+ -0.7280541658401489,
63
+ -1.1140393018722534,
64
+ -1.4510337114334106,
65
+ -1.543786883354187,
66
+ -0.9893178343772888,
67
+ -1.1761667728424072,
68
+ -1.6500028371810913,
69
+ -1.3606966733932495,
70
+ -1.3040567636489868,
71
+ -1.0859757661819458,
72
+ -1.1546803712844849,
73
+ -1.3623501062393188,
74
+ -1.1624470949172974,
75
+ -0.9064605832099915,
76
+ -0.9751174449920654,
77
+ -1.0902069807052612,
78
+ 1.076653003692627,
79
+ -0.6705790758132935,
80
+ -1.0953662395477295,
81
+ -0.8819424510002136,
82
+ -1.0914852619171143,
83
+ -1.0019954442977905,
84
+ -0.747879683971405,
85
+ -1.1821684837341309,
86
+ -0.9178316593170166,
87
+ -0.6682345867156982,
88
+ 0.01283226814121008,
89
+ -1.0062127113342285,
90
+ -1.222790002822876,
91
+ -1.0756093263626099,
92
+ -1.5697563886642456,
93
+ -1.4047282934188843,
94
+ -1.6574795246124268,
95
+ -1.1501147747039795,
96
+ -0.9065214395523071,
97
+ -0.4777354896068573,
98
+ -0.9039629101753235,
99
+ -1.3534184694290161,
100
+ -0.9960258603096008,
101
+ -1.1962703466415405,
102
+ -0.9578946828842163,
103
+ -1.225958228111267,
104
+ -1.342607855796814,
105
+ -0.20903004705905914,
106
+ -1.0248363018035889,
107
+ -1.3473637104034424,
108
+ -1.8375121355056763,
109
+ -1.5418068170547485,
110
+ -0.9454156756401062,
111
+ -1.355560541152954,
112
+ -0.220283642411232,
113
+ -1.596352219581604,
114
+ -1.2112479209899902,
115
+ -0.8760716915130615,
116
+ -1.2258740663528442,
117
+ -1.3866609334945679,
118
+ -1.2710108757019043,
119
+ -0.1649933010339737,
120
+ 0.016270384192466736,
121
+ -1.0848191976547241,
122
+ -1.1757584810256958,
123
+ -0.19969607889652252,
124
+ -0.9834519624710083,
125
+ -0.27612748742103577,
126
+ -1.2549775838851929,
127
+ -1.3626757860183716,
128
+ -1.1381901502609253,
129
+ -1.5990055799484253,
130
+ -1.064317226409912,
131
+ -1.4191893339157104,
132
+ -1.2183455228805542,
133
+ -1.2127211093902588,
134
+ -1.1763626337051392,
135
+ -1.0235487222671509,
136
+ -1.3561009168624878,
137
+ -0.08895851671695709,
138
+ -0.5269188284873962,
139
+ -1.021152138710022,
140
+ 0.5912998914718628,
141
+ -0.8649907112121582,
142
+ -0.8264200687408447,
143
+ -0.16007043421268463,
144
+ -0.710636556148529,
145
+ 0.546760082244873,
146
+ -1.0242435932159424,
147
+ -1.1056512594223022,
148
+ -1.3724554777145386,
149
+ -0.17449702322483063,
150
+ -1.3971720933914185,
151
+ 1.0758159160614014,
152
+ 0.2735677659511566,
153
+ -1.2959588766098022,
154
+ -1.3958879709243774,
155
+ -1.1433916091918945,
156
+ -0.0595177561044693,
157
+ -1.6733109951019287,
158
+ 0.17016254365444183,
159
+ -1.0019078254699707,
160
+ -1.1755293607711792,
161
+ -1.5181457996368408,
162
+ -1.3135099411010742,
163
+ -1.1515165567398071,
164
+ -1.0500580072402954,
165
+ -0.7186017036437988,
166
+ -1.0780699253082275,
167
+ -0.48820409178733826,
168
+ -1.373225212097168,
169
+ -0.38617995381355286,
170
+ -1.8980886936187744,
171
+ 0.06682716310024261,
172
+ -0.8430164456367493,
173
+ -1.2432578802108765,
174
+ -1.1443727016448975,
175
+ -1.1010695695877075,
176
+ -1.5263911485671997,
177
+ -1.2033809423446655,
178
+ -0.8797067999839783,
179
+ -1.006831169128418,
180
+ -1.5403777360916138,
181
+ -1.262957215309143,
182
+ -1.366977572441101,
183
+ -1.2494772672653198,
184
+ -1.4899410009384155,
185
+ -0.9515498280525208,
186
+ -1.582962155342102,
187
+ -1.0381284952163696,
188
+ -1.3009873628616333,
189
+ -0.023494139313697815,
190
+ -1.078853726387024,
191
+ 0.2350395768880844,
192
+ -0.6810436248779297,
193
+ -1.0680594444274902,
194
+ -1.4320069551467896,
195
+ -0.9185078144073486,
196
+ -0.22253526747226715,
197
+ -0.8764710426330566,
198
+ -0.38088586926460266,
199
+ -0.8306002616882324,
200
+ -1.4178184270858765,
201
+ -1.5479382276535034,
202
+ -1.379128336906433,
203
+ -1.368441104888916,
204
+ -1.6610294580459595,
205
+ -0.2609993517398834,
206
+ -1.2183486223220825,
207
+ -0.39959266781806946,
208
+ -1.097305178642273,
209
+ -0.6151554584503174,
210
+ -1.1245595216751099,
211
+ -1.0202852487564087,
212
+ -1.1848233938217163,
213
+ -0.7953093647956848,
214
+ -1.4267706871032715,
215
+ -0.6949210166931152,
216
+ -0.6260175704956055,
217
+ -1.0507432222366333,
218
+ 0.09613381326198578,
219
+ -1.393492341041565,
220
+ -0.7648855447769165,
221
+ -0.04164375364780426,
222
+ -1.1472973823547363,
223
+ -0.012141243554651737,
224
+ -1.447911024093628,
225
+ -0.705965518951416,
226
+ -1.353085994720459,
227
+ -1.0527716875076294,
228
+ 0.3352198302745819,
229
+ 0.3007377088069916,
230
+ -1.200045108795166,
231
+ -1.3856489658355713,
232
+ -1.3609751462936401,
233
+ -0.978579044342041,
234
+ -1.422302007675171,
235
+ -0.17609848082065582,
236
+ -0.6512488126754761,
237
+ -1.3454848527908325,
238
+ -1.125982642173767,
239
+ -1.3319960832595825,
240
+ -0.9501914381980896,
241
+ -1.0286542177200317,
242
+ 0.8573932647705078,
243
+ -1.03618323802948,
244
+ -0.5918315052986145,
245
+ -0.7042418122291565,
246
+ -0.8372183442115784,
247
+ -1.0344367027282715,
248
+ -1.1246644258499146,
249
+ -0.9746480584144592,
250
+ -0.39691612124443054,
251
+ -0.4038865864276886,
252
+ -0.15724362432956696,
253
+ -1.1045867204666138,
254
+ -0.3976353108882904,
255
+ -1.0184457302093506,
256
+ -0.5144578218460083,
257
+ -1.2080374956130981,
258
+ -0.8429292440414429,
259
+ -0.9684330224990845,
260
+ -1.0287359952926636,
261
+ -0.5391995906829834,
262
+ -1.197322130203247,
263
+ -0.7998183965682983,
264
+ -1.3718265295028687,
265
+ 0.24823711812496185,
266
+ -1.5309869050979614,
267
+ -1.2936067581176758,
268
+ 1.1023930311203003,
269
+ -0.9947506189346313,
270
+ -1.3696208000183105,
271
+ -0.2304089218378067,
272
+ -1.2079521417617798,
273
+ -1.3714886903762817,
274
+ -1.2280504703521729,
275
+ -0.623773992061615,
276
+ -0.7546267509460449,
277
+ -1.3958839178085327,
278
+ -0.45324042439460754,
279
+ -1.221327304840088,
280
+ -1.3405762910842896,
281
+ -1.37446129322052,
282
+ -0.4636246860027313,
283
+ -0.4173184931278229,
284
+ -1.1010442972183228,
285
+ -0.998867928981781,
286
+ -1.4514027833938599,
287
+ -1.5863134860992432,
288
+ -1.2791930437088013,
289
+ -0.8029845356941223,
290
+ -1.6171226501464844,
291
+ -1.4019590616226196,
292
+ -0.7490535378456116,
293
+ -1.3929991722106934,
294
+ -0.6292440295219421,
295
+ -1.3540536165237427,
296
+ -1.3974806070327759,
297
+ -1.107706904411316,
298
+ -1.4272359609603882,
299
+ -1.1263355016708374,
300
+ -1.4653397798538208,
301
+ -1.2924553155899048,
302
+ -1.605281949043274,
303
+ -0.678042471408844,
304
+ -1.2917547225952148,
305
+ 0.34854111075401306,
306
+ 1.0792876482009888,
307
+ -0.9918920993804932,
308
+ -1.1672053337097168,
309
+ -0.5473090410232544,
310
+ -1.1816152334213257,
311
+ -1.4351133108139038,
312
+ -1.390865445137024,
313
+ -0.9782738089561462,
314
+ -1.523726463317871,
315
+ -0.7323179244995117,
316
+ -1.0839542150497437,
317
+ -0.8503597974777222,
318
+ -0.6542974710464478,
319
+ -1.8063925504684448,
320
+ -1.1235102415084839,
321
+ -1.0972504615783691,
322
+ -1.5942310094833374,
323
+ -0.391167014837265,
324
+ -1.3088654279708862,
325
+ -1.0088084936141968,
326
+ -1.4471620321273804,
327
+ -1.555908203125,
328
+ -1.4380232095718384,
329
+ -0.8007274866104126,
330
+ -0.98581862449646,
331
+ -1.194973349571228,
332
+ 0.37295421957969666,
333
+ -0.732162594795227,
334
+ -1.1101154088974,
335
+ 0.08618269860744476,
336
+ 0.14559005200862885,
337
+ -0.9846572875976562,
338
+ -1.2143336534500122,
339
+ -1.4047449827194214,
340
+ -1.1606196165084839,
341
+ -1.2685588598251343,
342
+ -0.8621314764022827,
343
+ -1.0718934535980225,
344
+ 0.35838302969932556,
345
+ -1.0782415866851807,
346
+ -1.3206661939620972,
347
+ -0.1933230310678482,
348
+ -1.068203330039978,
349
+ -1.5535625219345093,
350
+ -1.4120653867721558,
351
+ -0.23798216879367828,
352
+ -1.3028572797775269,
353
+ -0.6439197063446045,
354
+ -1.1649662256240845,
355
+ -1.4977679252624512,
356
+ -1.0818027257919312,
357
+ -0.7682369947433472,
358
+ 0.49373456835746765,
359
+ -0.31925132870674133,
360
+ -1.2221194505691528,
361
+ -1.6013067960739136,
362
+ -1.7399948835372925,
363
+ -1.777716040611267,
364
+ -1.377311110496521,
365
+ -1.3432127237319946,
366
+ -1.5257383584976196,
367
+ 0.6622371673583984,
368
+ 1.0853294134140015,
369
+ -0.9014617204666138,
370
+ 0.32088133692741394,
371
+ -1.4248524904251099,
372
+ -1.471419095993042,
373
+ -1.3995238542556763,
374
+ -1.147867202758789,
375
+ -1.132790207862854,
376
+ -1.2703801393508911,
377
+ -1.19794499874115,
378
+ -0.5074896812438965,
379
+ -1.584864854812622,
380
+ 0.5060570240020752,
381
+ -1.1297119855880737,
382
+ -0.20504702627658844,
383
+ -1.4272964000701904,
384
+ -0.5555222034454346,
385
+ -0.7156249284744263,
386
+ 0.09049175679683685,
387
+ -1.3860677480697632,
388
+ -0.19752778112888336,
389
+ -1.2151135206222534,
390
+ -0.8515722155570984,
391
+ -1.1100218296051025,
392
+ -0.7711730599403381,
393
+ -1.1607567071914673,
394
+ -1.2248245477676392,
395
+ -0.4200119078159332,
396
+ -1.0557197332382202,
397
+ -1.284337043762207,
398
+ -0.8077638745307922,
399
+ -0.24952079355716705,
400
+ -0.5502166152000427,
401
+ -1.1918044090270996,
402
+ -0.837188184261322,
403
+ -0.5807991623878479,
404
+ -0.8878062963485718,
405
+ -1.2714413404464722,
406
+ -1.5792204141616821,
407
+ -0.5740596055984497,
408
+ -1.2719670534133911,
409
+ -0.9569201469421387,
410
+ -0.26727166771888733,
411
+ -0.38036468625068665,
412
+ -1.1289421319961548,
413
+ -0.8058973550796509,
414
+ -0.23459918797016144,
415
+ -0.37297430634498596,
416
+ -1.5144702196121216,
417
+ -1.0248204469680786,
418
+ -1.0367714166641235,
419
+ -1.1568654775619507,
420
+ -0.9679339528083801,
421
+ -1.2444212436676025,
422
+ -1.2974079847335815,
423
+ -1.4657479524612427,
424
+ -1.020142912864685,
425
+ -1.5463627576828003,
426
+ -1.1463762521743774,
427
+ 0.19166909158229828,
428
+ -1.34723961353302,
429
+ 0.013962849043309689,
430
+ -1.316827654838562,
431
+ -1.2873262166976929,
432
+ -0.10017801821231842,
433
+ -1.0080933570861816,
434
+ -0.7352530360221863,
435
+ -0.9999722242355347,
436
+ -1.5186711549758911,
437
+ -0.9580345153808594,
438
+ -1.3389719724655151,
439
+ -0.06329025328159332,
440
+ -0.8431169390678406,
441
+ -0.48866501450538635,
442
+ -1.228153109550476,
443
+ -1.2058309316635132,
444
+ -0.8933544754981995,
445
+ -0.37581953406333923,
446
+ -0.6656634211540222,
447
+ -1.0006957054138184,
448
+ -0.5774959325790405,
449
+ -1.0158697366714478,
450
+ 0.16197608411312103,
451
+ -0.6879221200942993,
452
+ -1.2550967931747437,
453
+ -0.7536269426345825,
454
+ -1.4641591310501099,
455
+ -1.362711787223816,
456
+ -1.2644935846328735,
457
+ -1.007446050643921,
458
+ -0.821018636226654,
459
+ -1.4045993089675903,
460
+ 1.0853294134140015,
461
+ -0.8493748903274536,
462
+ -0.6245425939559937,
463
+ -1.0795317888259888,
464
+ -0.8397499918937683,
465
+ -1.3932974338531494,
466
+ -0.9537671804428101,
467
+ -0.7313017845153809,
468
+ -1.2378944158554077,
469
+ -1.3143432140350342,
470
+ -1.0327073335647583,
471
+ -0.20070113241672516,
472
+ -1.2518359422683716,
473
+ -0.8937365412712097,
474
+ -1.1342288255691528,
475
+ -1.0940252542495728,
476
+ -0.9837385416030884,
477
+ -1.203996181488037,
478
+ -0.809642493724823,
479
+ -1.1497331857681274,
480
+ -1.1864603757858276,
481
+ -1.075440764427185,
482
+ -0.7326006889343262,
483
+ -1.4437074661254883,
484
+ -0.8597245216369629,
485
+ 0.38668331503868103,
486
+ -1.5274873971939087,
487
+ -1.5643328428268433,
488
+ -0.6236359477043152,
489
+ -1.3366047143936157,
490
+ -0.3075108826160431,
491
+ -0.9216143488883972,
492
+ -1.712233066558838,
493
+ -1.2755796909332275,
494
+ -1.5240577459335327,
495
+ -0.9053295850753784,
496
+ -0.7791681885719299,
497
+ -1.1859089136123657,
498
+ -0.2295394092798233,
499
+ -0.7787845134735107,
500
+ -0.6591330170631409,
501
+ -1.6238256692886353,
502
+ -0.14863647520542145,
503
+ -1.0574315786361694,
504
+ -0.867046058177948,
505
+ -1.3081187009811401,
506
+ 0.3209395110607147,
507
+ -1.1832038164138794,
508
+ -1.0674439668655396,
509
+ -1.0070645809173584,
510
+ -1.2188527584075928,
511
+ -0.9422416687011719,
512
+ -1.2934507131576538,
513
+ -1.2925325632095337,
514
+ 0.4697413146495819,
515
+ -0.851110577583313,
516
+ -1.0773084163665771,
517
+ -1.0124799013137817,
518
+ -1.0129549503326416,
519
+ -0.7298660278320312,
520
+ -1.1107794046401978,
521
+ -0.381843239068985,
522
+ -0.3021925985813141,
523
+ -0.01701296865940094,
524
+ 0.23060761392116547,
525
+ -1.273461937904358,
526
+ -1.7891873121261597,
527
+ -1.0354863405227661,
528
+ -0.8204731941223145,
529
+ 0.11867271363735199,
530
+ 0.43134090304374695,
531
+ -1.4678852558135986,
532
+ -1.3811472654342651,
533
+ -0.8192546963691711,
534
+ -0.2699662744998932,
535
+ -0.12085868418216705,
536
+ -0.2731532156467438,
537
+ -0.4373904764652252,
538
+ -0.9359897375106812,
539
+ -1.6118437051773071,
540
+ -1.2675708532333374,
541
+ -0.6599417924880981,
542
+ -1.0235966444015503,
543
+ -0.8011727333068848,
544
+ -0.47254326939582825,
545
+ -1.2127505540847778,
546
+ -1.0220295190811157,
547
+ -1.6019145250320435,
548
+ -1.1617406606674194,
549
+ -0.08847106993198395,
550
+ -0.634203314781189,
551
+ -0.5590909719467163,
552
+ -0.30932989716529846,
553
+ -1.554407000541687,
554
+ -0.6364705562591553,
555
+ -1.2370597124099731,
556
+ -1.3125914335250854,
557
+ 0.157369002699852,
558
+ -0.5517426133155823,
559
+ -1.2410355806350708,
560
+ -0.1545950323343277,
561
+ 0.7511812448501587,
562
+ -0.824394166469574,
563
+ -1.1137416362762451,
564
+ -0.930499792098999,
565
+ -1.1110764741897583,
566
+ -1.1060878038406372,
567
+ -1.5792495012283325,
568
+ -0.8738508224487305,
569
+ -0.8430964946746826,
570
+ -0.9216406345367432,
571
+ 0.5438753366470337,
572
+ -1.2970776557922363,
573
+ -1.4437335729599,
574
+ -0.7148035168647766,
575
+ -0.9997051358222961,
576
+ -1.0739270448684692,
577
+ -1.3739980459213257,
578
+ 0.07698474824428558,
579
+ -1.0376864671707153,
580
+ -1.3592288494110107,
581
+ -1.3092775344848633,
582
+ -1.0631165504455566,
583
+ -0.1959986835718155,
584
+ -0.5180649757385254,
585
+ -0.6033154726028442,
586
+ -0.7626828551292419,
587
+ -0.5016183257102966,
588
+ -0.9555225968360901,
589
+ -1.0175710916519165,
590
+ -0.8757976293563843,
591
+ -0.831890344619751,
592
+ -1.2257341146469116,
593
+ -0.4472711384296417,
594
+ -0.614583432674408,
595
+ -0.7053588628768921,
596
+ -0.4475536048412323,
597
+ -0.8614799380302429,
598
+ 0.1768026202917099,
599
+ -0.3497110903263092,
600
+ -1.0322810411453247,
601
+ -0.3907206952571869,
602
+ -1.4336906671524048,
603
+ -0.9900776147842407,
604
+ -2.035060405731201,
605
+ -1.049407720565796,
606
+ -0.3391706049442291,
607
+ -1.3851855993270874,
608
+ -1.7084792852401733,
609
+ -1.2662426233291626,
610
+ -0.5082767009735107,
611
+ -1.2160879373550415,
612
+ -0.8037292957305908,
613
+ -0.8578698635101318,
614
+ -1.1615411043167114,
615
+ -1.0298279523849487,
616
+ -0.8538919687271118,
617
+ 0.36529991030693054,
618
+ -1.1133273839950562,
619
+ -0.5921953916549683,
620
+ -1.080213189125061,
621
+ -1.1231539249420166,
622
+ -1.2695895433425903,
623
+ -0.557445764541626,
624
+ -1.2710472345352173,
625
+ -1.4890140295028687,
626
+ -1.1764518022537231,
627
+ -1.5136736631393433,
628
+ -0.8907819986343384,
629
+ -1.3548723459243774,
630
+ -1.1820921897888184,
631
+ -0.5939743518829346,
632
+ -0.729474663734436,
633
+ -1.3610496520996094,
634
+ -1.307175636291504,
635
+ 0.19120310246944427,
636
+ -1.7107257843017578,
637
+ -1.6838716268539429,
638
+ -0.45817849040031433,
639
+ -1.6484169960021973,
640
+ -0.5636109113693237,
641
+ -1.3281999826431274,
642
+ 0.17714856564998627,
643
+ -1.2461961507797241,
644
+ -1.1488794088363647,
645
+ -1.7438286542892456,
646
+ -0.6230407953262329,
647
+ -1.2648621797561646,
648
+ -0.6997348666191101,
649
+ -0.9193903207778931,
650
+ -0.07318462431430817,
651
+ -1.0659621953964233,
652
+ -1.5717543363571167,
653
+ -0.8830347657203674,
654
+ -1.1423650979995728,
655
+ -0.46297529339790344,
656
+ -1.0400162935256958,
657
+ -1.1687105894088745,
658
+ -1.1117757558822632,
659
+ -1.165108323097229,
660
+ -0.2993042767047882,
661
+ 0.2355259507894516,
662
+ -1.1339465379714966,
663
+ 0.06738196313381195,
664
+ 0.5318847894668579,
665
+ -0.7183206677436829,
666
+ 0.592262864112854,
667
+ 0.6866284608840942,
668
+ -1.2723904848098755,
669
+ -0.3870832622051239,
670
+ -0.978722333908081,
671
+ -1.355587363243103,
672
+ -0.9423601031303406,
673
+ -1.3951871395111084,
674
+ -1.3936179876327515,
675
+ -1.6031522750854492,
676
+ -0.21148838102817535,
677
+ -1.1556333303451538,
678
+ -1.084659218788147,
679
+ -1.378499150276184,
680
+ -1.1816834211349487,
681
+ -1.2663613557815552,
682
+ -1.1401015520095825,
683
+ -1.4404000043869019,
684
+ -0.7088984251022339,
685
+ -1.2900205850601196,
686
+ -1.0559067726135254,
687
+ -0.9734294414520264,
688
+ -0.25988641381263733,
689
+ -0.9583308100700378,
690
+ -1.4751405715942383,
691
+ -1.0557854175567627,
692
+ -1.1709598302841187,
693
+ -1.264431357383728,
694
+ -1.2076573371887207,
695
+ -0.2657240927219391,
696
+ -1.2445088624954224,
697
+ -1.3774434328079224,
698
+ -1.1227515935897827,
699
+ -1.6841152906417847,
700
+ -1.610225796699524,
701
+ 0.18313728272914886,
702
+ -0.5987048149108887,
703
+ -1.3751879930496216,
704
+ -1.49614417552948,
705
+ -0.7005925178527832,
706
+ -1.285922646522522,
707
+ 0.5296672582626343,
708
+ -0.9516278505325317,
709
+ -1.2854233980178833,
710
+ -1.2334297895431519,
711
+ -1.1272222995758057,
712
+ -1.2958756685256958,
713
+ -1.1632938385009766,
714
+ -0.7426636815071106,
715
+ -1.1737483739852905,
716
+ -1.4558049440383911,
717
+ -1.3049405813217163,
718
+ -0.7942296862602234,
719
+ -1.1519759893417358,
720
+ -0.8387441635131836,
721
+ -0.8400278687477112,
722
+ -1.380387306213379,
723
+ -0.9284071326255798,
724
+ -1.2375532388687134,
725
+ -1.5869382619857788,
726
+ -1.0146138668060303,
727
+ -1.3156920671463013,
728
+ -1.275891900062561,
729
+ -1.341044306755066,
730
+ -0.6715763211250305,
731
+ -1.4603809118270874,
732
+ -1.2490489482879639,
733
+ -0.9694267511367798,
734
+ -1.150862216949463,
735
+ 0.6025717258453369,
736
+ -0.9829014539718628,
737
+ -1.1867046356201172,
738
+ -1.356502890586853,
739
+ -1.262014627456665,
740
+ -1.4280176162719727,
741
+ -1.0999171733856201,
742
+ -1.587890386581421,
743
+ -1.4086076021194458,
744
+ -0.6107734441757202,
745
+ -1.6417211294174194,
746
+ -1.2513084411621094,
747
+ -0.3434433043003082,
748
+ -1.366479754447937,
749
+ -0.9849197864532471,
750
+ -1.2823240756988525,
751
+ -0.9312375783920288,
752
+ -1.2207988500595093,
753
+ -0.6679304838180542,
754
+ -1.2756344079971313,
755
+ -1.4060202836990356,
756
+ -1.1021071672439575,
757
+ -1.3004647493362427,
758
+ -1.1793757677078247,
759
+ -1.3242864608764648,
760
+ -0.5761081576347351,
761
+ -0.5890631675720215,
762
+ -1.3982356786727905,
763
+ -1.0197962522506714,
764
+ 0.24282465875148773,
765
+ -1.7297676801681519,
766
+ -1.0292190313339233,
767
+ -1.5087980031967163,
768
+ -0.6132323741912842,
769
+ -1.061501145362854,
770
+ -1.449089765548706,
771
+ -1.0883604288101196,
772
+ -1.1049416065216064,
773
+ -0.7497729063034058,
774
+ -0.46484091877937317,
775
+ -1.5567063093185425,
776
+ 1.1017796993255615,
777
+ -0.9868260622024536,
778
+ -1.6033321619033813,
779
+ 1.1017796993255615,
780
+ 1.0791491270065308,
781
+ -1.1754016876220703,
782
+ -1.322151780128479,
783
+ -0.7629939913749695,
784
+ -1.5595693588256836,
785
+ -1.381496548652649,
786
+ -1.0510624647140503,
787
+ -0.3074672520160675,
788
+ -1.2564432621002197,
789
+ -0.9831846952438354,
790
+ 1.0933884382247925,
791
+ -1.458979845046997,
792
+ -1.244853138923645,
793
+ -1.5125473737716675,
794
+ -1.221125841140747,
795
+ -0.782135546207428,
796
+ -1.4808238744735718,
797
+ -1.0407012701034546,
798
+ -0.7312884330749512,
799
+ -1.4420077800750732,
800
+ -1.0988465547561646,
801
+ -1.521802306175232,
802
+ -1.1500179767608643,
803
+ -0.5365725159645081,
804
+ -0.838559627532959,
805
+ -1.3628904819488525,
806
+ -1.0182921886444092,
807
+ -1.3370941877365112,
808
+ -1.296017050743103,
809
+ -1.4160596132278442,
810
+ -0.48893895745277405,
811
+ -1.4099682569503784,
812
+ -1.0160109996795654,
813
+ -1.2014179229736328,
814
+ -1.1398297548294067,
815
+ -1.052444338798523,
816
+ -0.9418507218360901,
817
+ -1.3996697664260864,
818
+ -1.2515298128128052,
819
+ -1.1170382499694824,
820
+ -1.3546582460403442,
821
+ -1.5579890012741089,
822
+ -1.2622255086898804,
823
+ -1.2970558404922485,
824
+ -1.511696696281433,
825
+ -1.4800214767456055,
826
+ -0.7602063417434692,
827
+ -1.4506222009658813,
828
+ -1.12774658203125,
829
+ -0.6115281581878662,
830
+ -0.9616543650627136,
831
+ -1.5518651008605957,
832
+ -1.0970467329025269,
833
+ -1.617056965827942,
834
+ -0.23112572729587555,
835
+ -1.6439642906188965,
836
+ -1.2593516111373901,
837
+ -0.1176375299692154,
838
+ -1.0604532957077026,
839
+ -0.6514220237731934,
840
+ -1.22484290599823,
841
+ -0.8427362442016602,
842
+ -0.8651243448257446,
843
+ -1.6307228803634644,
844
+ 0.19757793843746185,
845
+ -0.012596742250025272,
846
+ -0.8357325196266174,
847
+ -0.29783621430397034,
848
+ -1.0068109035491943,
849
+ -0.4322293698787689,
850
+ -0.9463107585906982,
851
+ -0.7888737320899963,
852
+ -1.365012526512146,
853
+ 0.22061823308467865,
854
+ -0.9645900726318359,
855
+ -0.9157580137252808,
856
+ -1.1246854066848755,
857
+ -1.202597737312317,
858
+ 0.1422266811132431,
859
+ -1.3613243103027344,
860
+ -1.2344964742660522,
861
+ -0.4336417019367218,
862
+ -1.3987447023391724,
863
+ -1.3095594644546509,
864
+ -1.3980382680892944,
865
+ -1.2625396251678467,
866
+ -0.3969932496547699,
867
+ -1.1087945699691772,
868
+ -1.3827489614486694,
869
+ -1.3891667127609253,
870
+ -1.2654685974121094,
871
+ -1.7422021627426147,
872
+ -0.9443965554237366,
873
+ -0.6851860880851746,
874
+ -1.1352812051773071,
875
+ -0.9314031600952148,
876
+ -1.231898546218872,
877
+ -1.285732388496399,
878
+ -1.496761441230774,
879
+ -0.5672997236251831,
880
+ -1.0675023794174194,
881
+ 0.04678855836391449,
882
+ 0.021219000220298767,
883
+ -1.2124831676483154,
884
+ -1.1817046403884888,
885
+ -0.014296070672571659,
886
+ 0.19702599942684174,
887
+ -1.397987961769104,
888
+ -0.7238833904266357,
889
+ -1.2946404218673706,
890
+ -1.2402915954589844,
891
+ -0.7641687989234924,
892
+ -0.006078497506678104,
893
+ -0.008862392045557499,
894
+ -0.5263004302978516,
895
+ 0.8998862504959106,
896
+ -1.2549136877059937,
897
+ 0.31759878993034363,
898
+ -1.261968731880188,
899
+ -1.6415921449661255,
900
+ -1.21112060546875,
901
+ -1.5576486587524414,
902
+ -0.5912346839904785,
903
+ -0.9920956492424011,
904
+ -1.2529927492141724,
905
+ -1.103129506111145,
906
+ -0.8028104305267334,
907
+ -0.7604157328605652,
908
+ -1.4207592010498047,
909
+ -1.4796751737594604,
910
+ -1.1716543436050415,
911
+ -1.2736624479293823,
912
+ -1.070701003074646,
913
+ -1.4757834672927856,
914
+ -0.9998635053634644,
915
+ -1.7119947671890259,
916
+ -1.7135602235794067,
917
+ -0.8658174276351929,
918
+ -1.0607064962387085,
919
+ -0.8032688498497009,
920
+ -1.458056092262268,
921
+ -1.0074803829193115,
922
+ -1.2153657674789429,
923
+ -1.196395993232727,
924
+ -1.1376185417175293,
925
+ -1.0404125452041626,
926
+ -0.3276142179965973,
927
+ -1.0169545412063599,
928
+ -1.1829798221588135,
929
+ -1.0758360624313354,
930
+ -1.3305062055587769,
931
+ -0.775994598865509,
932
+ -1.3096801042556763,
933
+ -1.3174357414245605,
934
+ -1.3116189241409302,
935
+ -1.200682520866394,
936
+ -1.3932679891586304,
937
+ -1.1903184652328491,
938
+ -1.0790269374847412,
939
+ -0.9235557913780212,
940
+ -0.9099297523498535,
941
+ -1.078774333000183,
942
+ -1.3505604267120361,
943
+ -0.4734174311161041,
944
+ -1.0883843898773193,
945
+ -1.1578863859176636,
946
+ -0.4342658817768097,
947
+ -0.018165603280067444,
948
+ -0.56715989112854,
949
+ -0.7799911499023438,
950
+ -0.6395362615585327,
951
+ -0.27263787388801575,
952
+ -1.1700217723846436,
953
+ -1.5344740152359009,
954
+ -0.37325796484947205,
955
+ -0.44674816727638245,
956
+ -0.815031886100769,
957
+ -0.4594612419605255,
958
+ -1.1332365274429321,
959
+ 0.02945779263973236,
960
+ -0.8241244554519653,
961
+ -0.517986536026001,
962
+ -1.029955267906189,
963
+ -1.591813564300537,
964
+ -0.9429829120635986,
965
+ 0.21405313909053802,
966
+ -1.0263983011245728,
967
+ -1.5625673532485962,
968
+ -1.2304553985595703,
969
+ 1.0292457342147827,
970
+ -1.1864832639694214,
971
+ -1.2168819904327393,
972
+ 0.12082968652248383,
973
+ -1.3505600690841675,
974
+ -1.5248140096664429,
975
+ -1.219594120979309,
976
+ -0.9081189036369324,
977
+ -0.3410501778125763,
978
+ -1.3991016149520874,
979
+ -0.3232833445072174,
980
+ -0.6689348220825195,
981
+ -0.7408920526504517,
982
+ -1.329468846321106,
983
+ -1.3054367303848267,
984
+ -1.2549548149108887,
985
+ -0.14662326872348785,
986
+ -1.4237884283065796,
987
+ -1.0905146598815918,
988
+ -1.042354702949524,
989
+ -1.4733952283859253,
990
+ -0.9382591247558594,
991
+ -1.1531307697296143,
992
+ -1.591866374015808,
993
+ -1.3580195903778076,
994
+ -0.8414123058319092,
995
+ -0.8078007698059082,
996
+ -0.8019185662269592,
997
+ -0.6789149045944214,
998
+ -0.802226185798645,
999
+ -1.4528642892837524,
1000
+ -1.6337095499038696,
1001
+ -1.0268826484680176,
1002
+ -0.884815514087677,
1003
+ -1.5345396995544434,
1004
+ -1.320574402809143,
1005
+ -1.2072666883468628,
1006
+ -0.5710649490356445,
1007
+ -0.5735992789268494,
1008
+ -1.1882561445236206,
1009
+ -1.5517603158950806,
1010
+ -1.7292221784591675,
1011
+ -1.0478509664535522,
1012
+ -1.4445112943649292,
1013
+ -1.1097279787063599,
1014
+ -0.26933446526527405,
1015
+ -1.2619794607162476,
1016
+ -1.653128981590271,
1017
+ -1.0712743997573853,
1018
+ -1.4328266382217407,
1019
+ -1.43897545337677,
1020
+ 0.40594372153282166,
1021
+ -0.42326387763023376,
1022
+ -1.1246774196624756,
1023
+ -1.1000921726226807,
1024
+ -1.3680005073547363,
1025
+ -1.6266108751296997,
1026
+ -1.7876782417297363,
1027
+ -1.5128880739212036,
1028
+ -0.5926470160484314,
1029
+ -1.2758967876434326,
1030
+ -0.030040159821510315,
1031
+ -1.4053081274032593,
1032
+ -0.704461932182312,
1033
+ -1.110855221748352,
1034
+ -1.258851408958435,
1035
+ -0.5621176958084106,
1036
+ -0.7606829404830933,
1037
+ -1.1686712503433228,
1038
+ -0.4487611949443817,
1039
+ -0.5810934901237488,
1040
+ -1.0342611074447632,
1041
+ -1.00124192237854,
1042
+ -0.889713704586029,
1043
+ -1.1828817129135132,
1044
+ -0.2615939676761627,
1045
+ -0.39997199177742004,
1046
+ -1.2174421548843384,
1047
+ -1.2937822341918945,
1048
+ -0.8414628505706787,
1049
+ -0.6136593818664551,
1050
+ -1.0893949270248413,
1051
+ -1.1265052556991577,
1052
+ -1.4588258266448975,
1053
+ -0.5122885704040527,
1054
+ -1.3000422716140747,
1055
+ -0.36550024151802063,
1056
+ -1.182219386100769,
1057
+ -1.164965033531189,
1058
+ -0.07817710936069489,
1059
+ -1.2030394077301025,
1060
+ -0.795669436454773,
1061
+ -1.3503750562667847,
1062
+ 0.1698922961950302,
1063
+ -1.3277760744094849,
1064
+ -1.3693565130233765,
1065
+ -0.5872086882591248,
1066
+ -1.3951269388198853,
1067
+ -1.0287357568740845,
1068
+ -1.3054872751235962,
1069
+ -1.0896090269088745,
1070
+ -1.3335708379745483,
1071
+ -0.7523553967475891,
1072
+ -0.47532740235328674,
1073
+ -1.4377750158309937,
1074
+ -0.4202025830745697,
1075
+ -1.3348170518875122,
1076
+ -0.3616688549518585,
1077
+ -1.4612845182418823,
1078
+ -0.9935869574546814,
1079
+ -0.9072598218917847,
1080
+ -0.46063902974128723,
1081
+ -0.024380221962928772,
1082
+ -0.3464854061603546,
1083
+ -1.2389198541641235,
1084
+ -0.5797119140625,
1085
+ -1.1163216829299927,
1086
+ -0.7624948620796204,
1087
+ -1.1947788000106812,
1088
+ -1.0036786794662476,
1089
+ 0.1397988647222519,
1090
+ -1.2470684051513672,
1091
+ -0.7598848342895508,
1092
+ -0.4390871822834015,
1093
+ -1.1821941137313843,
1094
+ -0.9564024209976196,
1095
+ -0.3804719150066376,
1096
+ -1.2043684720993042,
1097
+ -1.1381832361221313,
1098
+ -0.09329773485660553,
1099
+ -0.7133734822273254,
1100
+ -1.8637174367904663,
1101
+ -1.42497980594635,
1102
+ -0.983292281627655,
1103
+ -1.3883062601089478,
1104
+ -1.2626310586929321,
1105
+ -1.1249772310256958,
1106
+ 1.088178038597107,
1107
+ -1.2485156059265137,
1108
+ -0.8984493017196655,
1109
+ -0.9389911890029907,
1110
+ -0.11196042597293854,
1111
+ -0.42114344239234924,
1112
+ -0.6378402709960938,
1113
+ -1.457368016242981,
1114
+ -0.927597165107727,
1115
+ -1.3251688480377197,
1116
+ -1.3440285921096802,
1117
+ -0.9007701873779297,
1118
+ -1.4625484943389893,
1119
+ 0.14792345464229584,
1120
+ -1.601976990699768,
1121
+ -0.907702624797821,
1122
+ -0.0482415109872818,
1123
+ -0.8589790463447571,
1124
+ -0.7272351980209351,
1125
+ -1.3259836435317993,
1126
+ -1.223117470741272,
1127
+ -1.29706609249115,
1128
+ -1.4605157375335693,
1129
+ -1.198635458946228,
1130
+ -0.7449266910552979,
1131
+ -1.1015628576278687,
1132
+ -0.7011773586273193,
1133
+ -1.4988540410995483,
1134
+ -1.4491026401519775,
1135
+ -0.21870781481266022,
1136
+ -1.1473585367202759,
1137
+ -1.2259621620178223,
1138
+ -1.3234750032424927,
1139
+ -1.1650336980819702,
1140
+ 0.05468498170375824,
1141
+ -1.1494877338409424,
1142
+ -1.2304192781448364,
1143
+ 0.8186055421829224,
1144
+ -1.1256592273712158,
1145
+ -1.157542109489441,
1146
+ -1.1141349077224731,
1147
+ -0.9808951616287231,
1148
+ -0.6570475101470947,
1149
+ -1.42974054813385,
1150
+ -1.1033750772476196,
1151
+ -1.3301035165786743,
1152
+ -1.387764811515808,
1153
+ -1.3025513887405396,
1154
+ -0.1950090080499649,
1155
+ -0.6969791650772095,
1156
+ -0.8486524820327759,
1157
+ -0.995331883430481,
1158
+ -0.04780389368534088,
1159
+ -1.3958605527877808,
1160
+ -0.4478473961353302,
1161
+ -0.8391091227531433,
1162
+ -0.5568499565124512,
1163
+ -1.3835636377334595,
1164
+ -1.094192624092102,
1165
+ -0.48437461256980896,
1166
+ -0.3277950584888458,
1167
+ -0.5300676822662354,
1168
+ 0.1960524171590805,
1169
+ -1.3509796857833862,
1170
+ -0.64398592710495,
1171
+ -0.5411514639854431,
1172
+ -0.7309603095054626,
1173
+ -1.359878420829773,
1174
+ -1.2194474935531616,
1175
+ -0.9490339159965515,
1176
+ -0.9910942316055298,
1177
+ -0.9402440786361694,
1178
+ -1.325398325920105,
1179
+ -1.1375430822372437,
1180
+ -1.2743886709213257,
1181
+ -1.2747620344161987,
1182
+ -0.8859657645225525,
1183
+ -0.45794937014579773,
1184
+ -1.1441409587860107,
1185
+ -1.4407777786254883,
1186
+ -0.4305863082408905,
1187
+ -1.3384078741073608,
1188
+ -0.6197498440742493,
1189
+ -1.620221495628357,
1190
+ -1.0593317747116089,
1191
+ -1.1321735382080078,
1192
+ -1.158852458000183,
1193
+ -1.7509499788284302,
1194
+ 0.7318432331085205,
1195
+ -0.3977149426937103,
1196
+ -1.0794119834899902,
1197
+ 0.35373517870903015,
1198
+ -1.2794593572616577,
1199
+ -1.129315733909607,
1200
+ -0.8752701282501221,
1201
+ -1.288329005241394,
1202
+ -1.0555731058120728,
1203
+ -1.0482975244522095,
1204
+ -0.9027763605117798,
1205
+ -1.1038005352020264,
1206
+ -0.6592767834663391,
1207
+ -1.013438105583191,
1208
+ -1.124238133430481,
1209
+ -0.9824152588844299,
1210
+ -1.237770438194275,
1211
+ -1.382999300956726,
1212
+ -0.9469156265258789,
1213
+ -1.0958654880523682,
1214
+ -1.5570541620254517,
1215
+ -1.255165934562683,
1216
+ 0.3744339644908905,
1217
+ -1.1190487146377563,
1218
+ 0.11926113069057465,
1219
+ -0.00957061443477869,
1220
+ -1.3596242666244507,
1221
+ 1.0697627067565918,
1222
+ -1.2224860191345215,
1223
+ -1.3368010520935059,
1224
+ -0.9361356496810913,
1225
+ -1.3240238428115845,
1226
+ -1.0836998224258423,
1227
+ -1.0707992315292358,
1228
+ 1.0949938297271729,
1229
+ -0.5947170257568359,
1230
+ -0.9046496748924255,
1231
+ -1.037230372428894,
1232
+ -1.299832820892334,
1233
+ -1.3366427421569824,
1234
+ -1.0630100965499878,
1235
+ -0.8591206073760986,
1236
+ -1.0543607473373413,
1237
+ -0.3437744677066803,
1238
+ -1.6016639471054077,
1239
+ -0.4898267090320587,
1240
+ 0.04844878613948822,
1241
+ -1.0064711570739746,
1242
+ -0.16115428507328033,
1243
+ -1.087156891822815,
1244
+ -1.1966527700424194,
1245
+ -0.6210004091262817,
1246
+ -1.3491991758346558,
1247
+ -1.0859898328781128,
1248
+ -1.0937169790267944,
1249
+ -1.295812726020813,
1250
+ -0.9966477155685425,
1251
+ -1.4511908292770386,
1252
+ -1.2328847646713257,
1253
+ 0.8217015266418457,
1254
+ -1.1807013750076294,
1255
+ -0.09802915155887604,
1256
+ -1.656131625175476,
1257
+ -0.9599611163139343,
1258
+ -1.3377450704574585,
1259
+ -0.5449163317680359,
1260
+ -0.6254509687423706,
1261
+ 0.8542557954788208,
1262
+ -1.1536449193954468,
1263
+ -1.411490797996521,
1264
+ -1.3709415197372437,
1265
+ -1.2141227722167969,
1266
+ -0.6078641414642334,
1267
+ -1.582141637802124,
1268
+ 0.808190107345581,
1269
+ -1.4296940565109253,
1270
+ -1.313264012336731,
1271
+ -0.9590469598770142,
1272
+ -0.9849511981010437,
1273
+ -0.043199434876441956,
1274
+ -0.29802849888801575,
1275
+ -0.9900892972946167,
1276
+ -1.2046877145767212,
1277
+ -0.44404110312461853,
1278
+ 0.04805062711238861,
1279
+ -1.3963161706924438,
1280
+ -1.3555909395217896,
1281
+ -1.3676836490631104,
1282
+ -0.025159016251564026,
1283
+ 0.2045944780111313,
1284
+ -0.5909817814826965,
1285
+ -1.0484591722488403,
1286
+ 0.9353926181793213,
1287
+ -1.498761773109436,
1288
+ -1.0103098154067993,
1289
+ -1.1558111906051636,
1290
+ -0.7410740852355957,
1291
+ -0.5309615135192871,
1292
+ 0.2525474727153778,
1293
+ -1.109714150428772,
1294
+ 0.6134356260299683,
1295
+ -1.1171311140060425,
1296
+ -0.007570759393274784,
1297
+ -0.6020486950874329,
1298
+ -0.21162094175815582,
1299
+ -0.16691090166568756,
1300
+ -0.3940688669681549,
1301
+ -1.35390305519104,
1302
+ -1.512478232383728,
1303
+ -1.3548227548599243,
1304
+ -1.07779860496521,
1305
+ -1.4001861810684204,
1306
+ -1.420784831047058,
1307
+ -0.33719030022621155,
1308
+ -1.1767377853393555,
1309
+ -1.1470576524734497,
1310
+ -0.24519850313663483,
1311
+ -1.3736035823822021,
1312
+ -0.7646462321281433,
1313
+ -0.9104671478271484,
1314
+ -0.6130776405334473,
1315
+ -1.6297224760055542,
1316
+ -0.1191573292016983,
1317
+ -1.153145432472229,
1318
+ -1.0767452716827393,
1319
+ -1.2131757736206055,
1320
+ -1.0240422487258911,
1321
+ -0.633791446685791,
1322
+ -1.2786275148391724,
1323
+ -0.7595691680908203,
1324
+ -1.470902681350708,
1325
+ -0.10981787741184235,
1326
+ -1.1838434934616089,
1327
+ -0.742793083190918,
1328
+ -0.832213282585144,
1329
+ -0.9387105107307434,
1330
+ -1.540749192237854,
1331
+ -1.1546114683151245,
1332
+ -1.0210763216018677,
1333
+ -1.3317676782608032,
1334
+ -1.2589398622512817,
1335
+ -1.2528337240219116,
1336
+ -1.3817814588546753,
1337
+ -0.46168825030326843,
1338
+ -1.5057094097137451,
1339
+ -1.0186787843704224,
1340
+ 1.039817214012146,
1341
+ -1.199367880821228,
1342
+ -1.3735874891281128,
1343
+ 0.08135245740413666,
1344
+ -1.0985547304153442,
1345
+ 0.6502184867858887,
1346
+ -1.3277205228805542,
1347
+ -1.2365434169769287,
1348
+ -1.4313112497329712,
1349
+ -0.8223181366920471,
1350
+ 0.8257064819335938,
1351
+ -1.7220712900161743,
1352
+ -0.05397321283817291,
1353
+ -0.2107948213815689,
1354
+ -0.9236570000648499,
1355
+ -0.977117657661438,
1356
+ -1.4757202863693237,
1357
+ -1.3486089706420898,
1358
+ -0.7595583200454712,
1359
+ -0.2169063240289688,
1360
+ -1.611756682395935,
1361
+ -1.365153193473816,
1362
+ -0.09937824308872223,
1363
+ -0.7877964973449707,
1364
+ -0.9770026803016663,
1365
+ -1.4126554727554321,
1366
+ -1.1502717733383179,
1367
+ 0.038456425070762634,
1368
+ -1.1301871538162231,
1369
+ -1.4989489316940308,
1370
+ -0.5904892683029175,
1371
+ -0.23645974695682526,
1372
+ -1.1787844896316528,
1373
+ -1.3574670553207397,
1374
+ -1.2551099061965942,
1375
+ -1.2491093873977661,
1376
+ -1.5659338235855103,
1377
+ -1.1586302518844604,
1378
+ -1.4165500402450562,
1379
+ -1.507734775543213,
1380
+ 0.008745296858251095,
1381
+ -1.1905335187911987,
1382
+ -1.3674709796905518,
1383
+ -1.0035978555679321,
1384
+ -1.0936249494552612,
1385
+ -1.368744969367981,
1386
+ -0.8498907089233398,
1387
+ -0.8862848877906799,
1388
+ -1.336734652519226,
1389
+ -1.1355583667755127,
1390
+ -1.1111054420471191,
1391
+ -0.5767437219619751,
1392
+ -1.3558428287506104,
1393
+ -1.2333760261535645,
1394
+ -1.239599585533142,
1395
+ -1.453816533088684,
1396
+ -1.1986618041992188,
1397
+ -0.8141321539878845,
1398
+ -1.2206470966339111,
1399
+ -0.6996345520019531,
1400
+ -0.82187819480896,
1401
+ -1.2196255922317505,
1402
+ -1.400896668434143,
1403
+ -1.0740386247634888,
1404
+ -0.5602617263793945,
1405
+ -0.7203134298324585,
1406
+ -1.2310618162155151,
1407
+ -0.904556930065155,
1408
+ -1.4219011068344116,
1409
+ -1.4490009546279907,
1410
+ 0.03566049039363861,
1411
+ -1.0233300924301147,
1412
+ -1.140012502670288,
1413
+ -0.42803189158439636,
1414
+ -1.5810916423797607,
1415
+ -0.9759523868560791,
1416
+ -0.25100699067115784,
1417
+ -1.206830620765686,
1418
+ -0.9554544687271118,
1419
+ -0.2781076729297638,
1420
+ -1.6971453428268433,
1421
+ 0.27126631140708923,
1422
+ -0.5852292776107788,
1423
+ -0.4616415798664093,
1424
+ -1.0887407064437866,
1425
+ -1.6771949529647827,
1426
+ -1.3697309494018555,
1427
+ -0.2571171820163727,
1428
+ -1.0114191770553589,
1429
+ -1.2012830972671509,
1430
+ -1.2757502794265747,
1431
+ -0.7097468972206116,
1432
+ -0.6117334961891174,
1433
+ -1.1496344804763794,
1434
+ 1.0740691423416138,
1435
+ -0.6813763976097107,
1436
+ -1.5766879320144653,
1437
+ -1.4523783922195435,
1438
+ -0.07607568800449371,
1439
+ -0.7039839029312134,
1440
+ -0.41684529185295105,
1441
+ -1.2999826669692993,
1442
+ -0.6948259472846985,
1443
+ -0.30362668633461,
1444
+ -1.1450384855270386,
1445
+ -1.1439810991287231,
1446
+ -1.1924394369125366,
1447
+ -1.6463013887405396,
1448
+ -1.2114850282669067,
1449
+ -0.7968464493751526,
1450
+ -0.8489958047866821,
1451
+ -1.3046199083328247,
1452
+ -0.7091444134712219,
1453
+ -0.6858094930648804,
1454
+ -1.2692259550094604,
1455
+ -0.7408809661865234,
1456
+ -0.31269124150276184,
1457
+ -1.0576997995376587,
1458
+ -0.8857542872428894,
1459
+ -0.8969581127166748,
1460
+ -1.6382737159729004,
1461
+ -1.091489553451538,
1462
+ -0.43095067143440247,
1463
+ 0.4070093333721161,
1464
+ -0.8457977771759033,
1465
+ -1.1812688112258911,
1466
+ -0.6730863451957703,
1467
+ -1.0751663446426392,
1468
+ 0.02920578420162201,
1469
+ -0.3357236087322235,
1470
+ -0.2033279687166214,
1471
+ -0.05259944498538971,
1472
+ -0.8641003370285034,
1473
+ -0.8466780185699463,
1474
+ -1.1398016214370728,
1475
+ -0.5035464763641357,
1476
+ -0.6861425638198853,
1477
+ -1.4933310747146606,
1478
+ -1.3483915328979492,
1479
+ -0.16305841505527496,
1480
+ -1.1166621446609497,
1481
+ -1.2720214128494263,
1482
+ -1.2271143198013306,
1483
+ -1.2534984350204468,
1484
+ -0.836636483669281,
1485
+ -0.9617132544517517,
1486
+ -0.37791380286216736,
1487
+ -0.9845967292785645,
1488
+ -0.7671533823013306,
1489
+ -1.1794599294662476,
1490
+ -1.5026556253433228,
1491
+ -1.3750373125076294,
1492
+ -1.1583880186080933,
1493
+ -1.2132045030593872,
1494
+ -0.6259672045707703,
1495
+ -1.1577740907669067,
1496
+ -1.3953579664230347,
1497
+ -0.28657200932502747,
1498
+ -0.8042364120483398,
1499
+ -0.42149367928504944,
1500
+ -1.6332694292068481,
1501
+ -1.2078889608383179,
1502
+ -1.003774642944336,
1503
+ -0.5170986652374268,
1504
+ 0.045348748564720154,
1505
+ -1.3529080152511597,
1506
+ -0.7762061357498169,
1507
+ -1.4136677980422974,
1508
+ -1.1956721544265747,
1509
+ -0.19335223734378815,
1510
+ -0.3406771719455719,
1511
+ -1.4842816591262817,
1512
+ -0.4695720374584198,
1513
+ -1.5496376752853394,
1514
+ -1.056673526763916,
1515
+ -1.5819143056869507,
1516
+ -1.0759721994400024,
1517
+ -0.5784837007522583,
1518
+ -0.17563535273075104,
1519
+ -1.5022836923599243,
1520
+ -0.4334546625614166,
1521
+ -0.7703516483306885,
1522
+ -1.3585560321807861,
1523
+ -1.0619291067123413,
1524
+ -1.5632916688919067,
1525
+ -0.9639481902122498,
1526
+ -1.3373374938964844,
1527
+ -1.0081509351730347,
1528
+ -0.7493869066238403,
1529
+ -0.2015298753976822,
1530
+ -1.091454267501831,
1531
+ -1.4012612104415894,
1532
+ -0.9966589212417603,
1533
+ -1.6466896533966064,
1534
+ -1.4261620044708252,
1535
+ 0.26393529772758484,
1536
+ 0.7578109502792358,
1537
+ -1.0414551496505737,
1538
+ -1.174957275390625,
1539
+ -1.253412127494812,
1540
+ -1.3421902656555176,
1541
+ -1.4819416999816895,
1542
+ -0.8421674370765686,
1543
+ 0.5870802402496338,
1544
+ -1.2450042963027954,
1545
+ -1.4707388877868652,
1546
+ -1.262858510017395,
1547
+ -1.1388983726501465,
1548
+ -1.316787838935852,
1549
+ -1.2382543087005615,
1550
+ -0.2671903669834137,
1551
+ -1.1619938611984253,
1552
+ -1.0373483896255493,
1553
+ -1.0654710531234741,
1554
+ -0.8861064910888672,
1555
+ -0.22266103327274323,
1556
+ -0.9976537227630615,
1557
+ -1.4619619846343994,
1558
+ -0.9167486429214478,
1559
+ -1.4723756313323975,
1560
+ -1.4671016931533813,
1561
+ -1.1111801862716675,
1562
+ -0.8368542790412903,
1563
+ -0.6724063158035278,
1564
+ -1.11033034324646,
1565
+ -1.2295151948928833,
1566
+ 0.2109536975622177,
1567
+ -1.676979899406433,
1568
+ -1.50388765335083,
1569
+ -0.5301413536071777,
1570
+ -0.8518032431602478,
1571
+ -1.145347237586975,
1572
+ -0.06441022455692291,
1573
+ -0.5860792398452759,
1574
+ -0.7554313540458679,
1575
+ -0.8357469439506531,
1576
+ -0.9311996102333069,
1577
+ 0.7079356908798218,
1578
+ -1.1791430711746216,
1579
+ -0.19434262812137604,
1580
+ -1.4135233163833618,
1581
+ -0.4549378454685211,
1582
+ -0.41435882449150085,
1583
+ -1.551039218902588,
1584
+ -0.9013851881027222,
1585
+ -0.422725111246109,
1586
+ -0.19967152178287506,
1587
+ -1.4950822591781616,
1588
+ -1.4063047170639038,
1589
+ -0.9117258787155151,
1590
+ -1.0796244144439697,
1591
+ -0.7944502234458923,
1592
+ -0.2066345363855362,
1593
+ -0.3477948009967804,
1594
+ -0.36295434832572937,
1595
+ -0.7929938435554504,
1596
+ -0.4235070049762726,
1597
+ -0.9874733090400696,
1598
+ -0.6712866425514221,
1599
+ -1.1993881464004517,
1600
+ -1.6543967723846436,
1601
+ -1.2943240404129028,
1602
+ -1.2882822751998901,
1603
+ -0.8853479623794556,
1604
+ -1.2252682447433472,
1605
+ -1.329858422279358,
1606
+ -0.7920185327529907,
1607
+ -0.2049253135919571,
1608
+ -1.0401510000228882,
1609
+ -0.4406175911426544,
1610
+ -1.445766568183899,
1611
+ -0.33789578080177307,
1612
+ -1.4965006113052368,
1613
+ -1.3928674459457397,
1614
+ -1.1035513877868652,
1615
+ -0.29076483845710754,
1616
+ -1.1143780946731567,
1617
+ -0.25144162774086,
1618
+ -0.857277512550354,
1619
+ -1.6104038953781128,
1620
+ -1.099105715751648,
1621
+ -1.1746493577957153,
1622
+ -0.6581133604049683,
1623
+ -1.487122893333435,
1624
+ -1.254127860069275,
1625
+ 0.3395906388759613,
1626
+ -1.6587170362472534,
1627
+ -0.2142324596643448,
1628
+ -0.4239589273929596,
1629
+ -1.1823211908340454,
1630
+ -0.5925295352935791,
1631
+ -0.9910861253738403,
1632
+ -0.5821024775505066,
1633
+ -1.2221885919570923,
1634
+ -0.687335729598999,
1635
+ -1.3184033632278442,
1636
+ 0.662605881690979,
1637
+ -1.2315956354141235,
1638
+ -1.5845977067947388,
1639
+ -0.9301796555519104,
1640
+ -0.4723626673221588,
1641
+ -0.38689306378364563,
1642
+ -0.5544138550758362,
1643
+ -1.1863051652908325,
1644
+ -1.3685272932052612,
1645
+ 0.9963458776473999,
1646
+ -1.2194079160690308,
1647
+ 1.0810149908065796,
1648
+ -0.5423128008842468,
1649
+ -1.2725430727005005,
1650
+ -1.077738642692566,
1651
+ -1.147384762763977,
1652
+ -1.109905481338501,
1653
+ -0.9228805303573608,
1654
+ -0.938260018825531,
1655
+ -1.1971513032913208,
1656
+ -1.6720561981201172,
1657
+ -0.7178062200546265,
1658
+ -0.3082113564014435,
1659
+ -0.9966104626655579,
1660
+ -0.8115770816802979,
1661
+ -1.2188774347305298,
1662
+ -0.2760675251483917,
1663
+ -1.1827672719955444,
1664
+ -1.4425855875015259,
1665
+ -0.890592634677887,
1666
+ -1.1213229894638062,
1667
+ -0.3984088599681854,
1668
+ -1.1046735048294067,
1669
+ -0.9107871651649475,
1670
+ -1.15842604637146,
1671
+ -0.8346918821334839,
1672
+ -0.08068789541721344,
1673
+ 0.7324082851409912,
1674
+ -1.2114454507827759,
1675
+ -1.2549104690551758,
1676
+ -0.9638127088546753,
1677
+ -0.05175592005252838,
1678
+ -1.2654131650924683,
1679
+ -0.6368167400360107,
1680
+ -1.3840992450714111,
1681
+ -1.0013132095336914,
1682
+ 0.008168562315404415,
1683
+ -1.2629660367965698,
1684
+ -1.0540248155593872,
1685
+ -0.22636248171329498,
1686
+ -1.2950154542922974,
1687
+ -0.8796390891075134,
1688
+ -0.24847950041294098,
1689
+ -1.0995837450027466,
1690
+ -0.918030858039856,
1691
+ -0.9005784392356873,
1692
+ 0.09220515191555023,
1693
+ -1.3635491132736206,
1694
+ -0.1721668392419815,
1695
+ -1.2511686086654663,
1696
+ -0.6400150656700134,
1697
+ -1.4659892320632935,
1698
+ -1.510384440422058,
1699
+ -0.31949928402900696,
1700
+ -1.282892107963562,
1701
+ -1.5500632524490356,
1702
+ -1.424326777458191,
1703
+ -0.3816077411174774,
1704
+ -0.879797101020813,
1705
+ -1.3465303182601929,
1706
+ -1.1661485433578491,
1707
+ -0.02587534487247467,
1708
+ -1.4820611476898193,
1709
+ -1.4290052652359009,
1710
+ -1.2802642583847046,
1711
+ -1.233044981956482,
1712
+ -0.060814157128334045,
1713
+ -0.9842612743377686,
1714
+ -1.06222665309906,
1715
+ -1.0887113809585571,
1716
+ -0.7502325177192688,
1717
+ 0.901229977607727,
1718
+ -0.47713950276374817,
1719
+ -1.6942702531814575,
1720
+ -1.2261825799942017,
1721
+ -1.3138507604599,
1722
+ -1.421655297279358,
1723
+ -0.3851386606693268,
1724
+ -1.0420790910720825,
1725
+ -1.5554999113082886,
1726
+ -0.019360676407814026,
1727
+ -1.1258647441864014,
1728
+ -0.8591013550758362,
1729
+ -1.1468733549118042,
1730
+ -1.3426438570022583,
1731
+ -1.4240423440933228,
1732
+ -1.2636409997940063,
1733
+ -1.2033084630966187,
1734
+ -0.18700970709323883,
1735
+ -1.01390540599823,
1736
+ -1.1944700479507446,
1737
+ -0.9085432291030884,
1738
+ -0.9596326947212219,
1739
+ -1.0353626012802124,
1740
+ -0.5111778974533081,
1741
+ -0.8793514370918274,
1742
+ -0.526038408279419,
1743
+ -1.1786471605300903,
1744
+ -1.1739212274551392,
1745
+ -1.4217267036437988,
1746
+ -1.4848302602767944,
1747
+ -0.4292338192462921,
1748
+ -0.8156242966651917,
1749
+ -1.2380801439285278,
1750
+ -1.4611135721206665,
1751
+ -0.9862412810325623,
1752
+ -0.6789534687995911,
1753
+ -1.0767756700515747,
1754
+ -1.1307986974716187,
1755
+ -1.5335513353347778,
1756
+ -0.3406365215778351,
1757
+ -0.49578186869621277,
1758
+ -1.2526017427444458,
1759
+ -1.1743959188461304,
1760
+ -1.131085753440857,
1761
+ -0.4662093222141266,
1762
+ -1.2152754068374634,
1763
+ -1.0196176767349243,
1764
+ -0.8651112914085388,
1765
+ -1.6900948286056519,
1766
+ -1.472217321395874,
1767
+ -1.541080117225647,
1768
+ 0.37463662028312683,
1769
+ -1.0728164911270142,
1770
+ -1.2273592948913574,
1771
+ -1.6886242628097534,
1772
+ -1.7696845531463623,
1773
+ -0.8377559781074524,
1774
+ -1.2636712789535522,
1775
+ -0.4100342094898224,
1776
+ 0.09597383439540863,
1777
+ -1.0117131471633911,
1778
+ -1.2073484659194946,
1779
+ -0.42953816056251526,
1780
+ -0.2476266771554947,
1781
+ -0.11808957159519196,
1782
+ -1.2789760828018188,
1783
+ -1.5442330837249756,
1784
+ -0.4818843901157379,
1785
+ -0.9818578958511353,
1786
+ -0.8469090461730957,
1787
+ -1.386877417564392,
1788
+ -0.8318650722503662,
1789
+ -0.3529956638813019,
1790
+ -0.7025378942489624,
1791
+ -0.2927512228488922,
1792
+ -1.263249158859253,
1793
+ -1.105276107788086,
1794
+ -1.571437954902649,
1795
+ -1.3031201362609863,
1796
+ -1.1868855953216553,
1797
+ -1.2232223749160767,
1798
+ -1.2840772867202759,
1799
+ -1.0081194639205933,
1800
+ -1.3702064752578735,
1801
+ -1.4369677305221558,
1802
+ -1.1594078540802002,
1803
+ -1.0019335746765137,
1804
+ -1.16085684299469,
1805
+ -0.7544543147087097,
1806
+ -1.2813117504119873,
1807
+ -1.3507057428359985,
1808
+ -0.8068267703056335,
1809
+ -0.4993835985660553,
1810
+ -0.5754998922348022,
1811
+ -1.338358759880066,
1812
+ 0.6779160499572754,
1813
+ -1.0181668996810913,
1814
+ -0.574286937713623,
1815
+ 1.104464054107666,
1816
+ -1.2346364259719849,
1817
+ -1.1639028787612915,
1818
+ 0.021120771765708923,
1819
+ -0.8591700196266174,
1820
+ -1.438298225402832,
1821
+ -0.993827223777771,
1822
+ -0.4347291886806488,
1823
+ -0.386625200510025,
1824
+ -1.5505499839782715,
1825
+ -0.2284943014383316,
1826
+ 0.36102423071861267,
1827
+ 0.2669099271297455,
1828
+ 0.5090388059616089,
1829
+ -0.42337659001350403,
1830
+ -1.3124184608459473,
1831
+ -0.7777132987976074,
1832
+ -0.9366349577903748,
1833
+ -1.3089981079101562,
1834
+ -0.4506838619709015,
1835
+ -0.9341755509376526,
1836
+ -0.3522031009197235,
1837
+ -0.7846370935440063,
1838
+ -0.8397616147994995,
1839
+ -0.6048696637153625,
1840
+ -0.3573630154132843,
1841
+ -1.2281949520111084,
1842
+ -1.0681744813919067,
1843
+ -0.7850379347801208,
1844
+ -1.1457844972610474,
1845
+ -1.23977530002594,
1846
+ -1.0905646085739136,
1847
+ -0.9086353778839111,
1848
+ -1.1749376058578491,
1849
+ -1.2049987316131592,
1850
+ -0.7826714515686035,
1851
+ -1.3852412700653076,
1852
+ -1.3157169818878174,
1853
+ -1.0076112747192383,
1854
+ -0.5434575080871582,
1855
+ -0.5465117692947388,
1856
+ -1.0038563013076782,
1857
+ -1.1938000917434692,
1858
+ -1.2059215307235718,
1859
+ -1.0471458435058594,
1860
+ -1.3356043100357056,
1861
+ -0.5535755157470703,
1862
+ -0.35858944058418274,
1863
+ -1.277060627937317,
1864
+ -0.24973107874393463,
1865
+ -1.1943060159683228,
1866
+ -0.9169723987579346,
1867
+ -0.5709104537963867,
1868
+ -0.8746580481529236,
1869
+ -1.2675553560256958,
1870
+ -1.5548278093338013,
1871
+ -0.4260845482349396,
1872
+ -1.281798243522644,
1873
+ -1.0452395677566528,
1874
+ -0.4951115548610687,
1875
+ -0.22641874849796295,
1876
+ -0.7892284989356995,
1877
+ -0.16877974569797516,
1878
+ -0.6242099404335022,
1879
+ -1.1171008348464966,
1880
+ -1.369975209236145,
1881
+ -0.9977280497550964,
1882
+ -0.5613176226615906,
1883
+ -0.11836852133274078,
1884
+ 0.8601557016372681,
1885
+ -0.8904054760932922,
1886
+ 0.11348889768123627,
1887
+ -1.4260917901992798,
1888
+ -1.2115882635116577,
1889
+ -0.8446508646011353,
1890
+ -1.085567831993103,
1891
+ -0.04135562479496002,
1892
+ -0.895077109336853,
1893
+ 0.21484385430812836,
1894
+ -1.316870093345642,
1895
+ -0.966730535030365,
1896
+ -0.899878203868866,
1897
+ -1.3466428518295288,
1898
+ -1.3752700090408325,
1899
+ -0.23016704618930817,
1900
+ -0.8041161298751831,
1901
+ -0.8449469804763794,
1902
+ -1.5381838083267212,
1903
+ -1.5370237827301025,
1904
+ -1.092705249786377,
1905
+ -0.6500850915908813,
1906
+ -1.779499888420105,
1907
+ -1.3607958555221558,
1908
+ -0.5005062818527222,
1909
+ -1.151394248008728,
1910
+ -0.7218999862670898,
1911
+ -1.7357898950576782,
1912
+ -1.3953884840011597,
1913
+ -1.0939775705337524,
1914
+ 0.052960142493247986,
1915
+ -1.3338323831558228,
1916
+ -1.0942635536193848,
1917
+ -0.3616844713687897,
1918
+ -1.5355287790298462,
1919
+ -0.4851270616054535,
1920
+ -0.3543107807636261,
1921
+ -1.2530771493911743,
1922
+ -0.5464591979980469,
1923
+ 0.6271522045135498,
1924
+ -1.0637975931167603,
1925
+ -1.1693717241287231,
1926
+ -1.6105321645736694,
1927
+ 1.1023930311203003,
1928
+ 1.1023930311203003,
1929
+ -1.1246017217636108,
1930
+ -0.9900016784667969,
1931
+ -0.9492320418357849,
1932
+ -0.9387838244438171,
1933
+ -1.5632798671722412,
1934
+ -1.3547602891921997,
1935
+ -1.3683720827102661,
1936
+ -1.4232244491577148,
1937
+ -1.5726197957992554,
1938
+ -0.9023292064666748,
1939
+ -0.499146968126297,
1940
+ -1.5287021398544312,
1941
+ -0.9338570833206177,
1942
+ -0.3591652810573578,
1943
+ -1.1344940662384033,
1944
+ -1.4924293756484985,
1945
+ -1.4410991668701172,
1946
+ -1.3249701261520386,
1947
+ -0.8555614948272705,
1948
+ -0.3811284601688385,
1949
+ -0.9276860952377319,
1950
+ -0.9749771952629089,
1951
+ -1.069978952407837,
1952
+ -0.3391028344631195,
1953
+ -1.2751723527908325,
1954
+ -0.5670561194419861,
1955
+ -0.6542660593986511,
1956
+ -1.0654014348983765,
1957
+ -0.04740060865879059,
1958
+ -0.6686111688613892,
1959
+ -1.0725935697555542,
1960
+ -0.43629953265190125,
1961
+ -0.2785727083683014,
1962
+ -1.0001715421676636,
1963
+ -1.2726408243179321,
1964
+ -1.3187607526779175,
1965
+ -0.7505061626434326,
1966
+ -1.2392464876174927,
1967
+ -0.8965634107589722,
1968
+ 0.1738898605108261,
1969
+ -0.8077092170715332,
1970
+ -0.30621597170829773,
1971
+ -1.211815357208252,
1972
+ -1.3587995767593384,
1973
+ -1.2041691541671753,
1974
+ -1.3931245803833008,
1975
+ -1.6789636611938477,
1976
+ -1.1242733001708984,
1977
+ -1.1571999788284302,
1978
+ -1.2642220258712769,
1979
+ -1.2001831531524658,
1980
+ -0.4280588924884796,
1981
+ -0.955396294593811,
1982
+ -1.3459867238998413,
1983
+ 1.1077768802642822,
1984
+ -0.7207702994346619,
1985
+ -0.7765901684761047,
1986
+ -1.1753534078598022,
1987
+ -1.0968683958053589,
1988
+ -0.9757317304611206,
1989
+ 0.8036776781082153,
1990
+ -0.18453682959079742,
1991
+ 0.47547289729118347,
1992
+ -0.8849636316299438,
1993
+ -1.013344407081604,
1994
+ -0.5940949320793152,
1995
+ -1.472022294998169,
1996
+ -1.359561562538147,
1997
+ -1.19334077835083,
1998
+ -0.6671984791755676,
1999
+ -0.25515952706336975,
2000
+ -0.7487481832504272,
2001
+ -0.7129893898963928,
2002
+ -1.3231030702590942,
2003
+ -1.395440697669983,
2004
+ 0.09073315560817719,
2005
+ -0.4325698912143707,
2006
+ 0.22267471253871918,
2007
+ -0.4342527687549591,
2008
+ -0.4736798107624054,
2009
+ -1.0870047807693481,
2010
+ -0.5077587366104126,
2011
+ -1.0976123809814453,
2012
+ -1.0236976146697998,
2013
+ -0.9233863353729248,
2014
+ -1.4029268026351929,
2015
+ -0.1125950962305069,
2016
+ 0.2557630240917206,
2017
+ -1.2361916303634644,
2018
+ -0.2085442692041397,
2019
+ -0.9358801245689392,
2020
+ -0.7680370807647705,
2021
+ -0.9477894902229309,
2022
+ -1.4790469408035278,
2023
+ -0.9128760099411011,
2024
+ -1.387756109237671,
2025
+ 1.0853294134140015,
2026
+ -1.1303514242172241,
2027
+ -0.9934965968132019,
2028
+ -0.5950890779495239,
2029
+ -1.4658738374710083,
2030
+ 1.0631552934646606,
2031
+ -0.9494661092758179,
2032
+ -0.7258887887001038,
2033
+ -1.5327664613723755,
2034
+ -1.5390249490737915,
2035
+ -1.3326081037521362,
2036
+ -1.2058671712875366,
2037
+ -1.3740153312683105,
2038
+ -0.6080660820007324,
2039
+ -1.321567416191101,
2040
+ -0.7970670461654663,
2041
+ -1.3803995847702026,
2042
+ -1.6617964506149292,
2043
+ -0.7255260944366455,
2044
+ 0.07319532334804535,
2045
+ -0.4892987906932831,
2046
+ -0.8814854025840759,
2047
+ -0.8483073711395264,
2048
+ -1.2270632982254028,
2049
+ -0.7710530757904053,
2050
+ -1.0655099153518677,
2051
+ 0.17223452031612396,
2052
+ -0.9371599555015564,
2053
+ -0.9854010343551636,
2054
+ -0.49860748648643494,
2055
+ -0.9463139176368713,
2056
+ -1.3171089887619019,
2057
+ -0.6870641708374023,
2058
+ -1.0757442712783813,
2059
+ -1.4219919443130493,
2060
+ -0.4124450981616974,
2061
+ -1.1855040788650513,
2062
+ -1.4153839349746704,
2063
+ -1.3781999349594116,
2064
+ -1.5091112852096558,
2065
+ -0.8515238165855408,
2066
+ -0.8174371123313904,
2067
+ -1.2560375928878784,
2068
+ -1.3616467714309692,
2069
+ -0.21591104567050934,
2070
+ -1.2864519357681274,
2071
+ -1.2560542821884155,
2072
+ -1.025696039199829,
2073
+ -1.0386110544204712,
2074
+ -0.8859357833862305,
2075
+ -1.419379472732544,
2076
+ -1.4112452268600464,
2077
+ 0.22057901322841644,
2078
+ -1.1396676301956177,
2079
+ -1.302233338356018,
2080
+ -1.1842783689498901,
2081
+ -1.2345761060714722,
2082
+ -0.08386005461215973,
2083
+ -0.1830899864435196,
2084
+ -1.2932924032211304,
2085
+ -1.3321794271469116,
2086
+ -0.9294910430908203,
2087
+ -1.1985188722610474,
2088
+ -1.458177924156189,
2089
+ -1.491608738899231,
2090
+ -1.3933273553848267,
2091
+ -1.2353273630142212,
2092
+ -1.0474878549575806,
2093
+ -1.3636032342910767,
2094
+ -1.0955888032913208,
2095
+ -0.31216469407081604,
2096
+ -1.5520068407058716,
2097
+ -1.4586079120635986,
2098
+ -0.2310388833284378,
2099
+ -1.3201795816421509,
2100
+ -0.9388260841369629,
2101
+ -0.25791504979133606,
2102
+ -0.42390820384025574,
2103
+ -1.1262365579605103,
2104
+ -1.5014305114746094,
2105
+ -0.7684284448623657,
2106
+ 0.2531777322292328,
2107
+ -0.6874780654907227,
2108
+ -1.134965419769287,
2109
+ -0.804380476474762,
2110
+ -0.7256826758384705,
2111
+ -1.6567864418029785,
2112
+ -0.510745108127594,
2113
+ -1.4407696723937988,
2114
+ -1.3300325870513916,
2115
+ -0.8234542012214661,
2116
+ -0.7619389295578003,
2117
+ -0.01978398859500885,
2118
+ -0.878930926322937,
2119
+ -0.9672378897666931,
2120
+ -1.2398918867111206,
2121
+ 0.25514575839042664,
2122
+ -0.8799184560775757,
2123
+ -1.2527401447296143,
2124
+ -0.7232027053833008,
2125
+ -1.3106147050857544,
2126
+ -0.9984818696975708,
2127
+ -1.3167222738265991,
2128
+ -1.3437625169754028,
2129
+ 0.6715551614761353,
2130
+ -0.9691771268844604,
2131
+ -0.5412847995758057,
2132
+ -1.2888144254684448,
2133
+ -1.6389844417572021,
2134
+ -1.4040693044662476,
2135
+ -0.49053797125816345,
2136
+ -1.372313141822815,
2137
+ -0.8869269490242004,
2138
+ -0.8200899958610535,
2139
+ -1.2268750667572021,
2140
+ -1.3872628211975098,
2141
+ -1.3775023221969604,
2142
+ -1.143048882484436,
2143
+ -0.4019416868686676,
2144
+ -0.991478681564331,
2145
+ -1.056282639503479,
2146
+ -0.8276944160461426,
2147
+ -1.2809486389160156,
2148
+ -0.9787607789039612,
2149
+ -1.08005690574646,
2150
+ -1.5643454790115356,
2151
+ -0.5396159291267395,
2152
+ -0.4323098957538605,
2153
+ -0.6372494697570801,
2154
+ -0.6397035717964172,
2155
+ -0.640761137008667,
2156
+ -0.09397377073764801,
2157
+ -1.4170507192611694,
2158
+ -0.6219046711921692,
2159
+ -0.6283496022224426,
2160
+ -1.4720964431762695,
2161
+ -0.9278752207756042,
2162
+ -1.5054298639297485,
2163
+ -0.8046634197235107,
2164
+ -1.2364671230316162,
2165
+ -1.1054725646972656,
2166
+ -1.0111764669418335,
2167
+ -1.4223483800888062,
2168
+ -0.9982906579971313,
2169
+ -0.6191055774688721,
2170
+ -0.8831880688667297,
2171
+ -0.9836006760597229,
2172
+ -0.685624361038208,
2173
+ -0.793638288974762,
2174
+ -1.3070943355560303,
2175
+ -0.15126539766788483,
2176
+ -0.7655091285705566,
2177
+ -0.4522152841091156,
2178
+ -0.7725874185562134,
2179
+ -0.44947412610054016,
2180
+ -1.0811649560928345,
2181
+ -1.0115147829055786,
2182
+ -1.3532434701919556,
2183
+ 0.05952654778957367,
2184
+ -1.1058861017227173,
2185
+ -0.6883115172386169,
2186
+ -0.7432392239570618,
2187
+ -1.1674662828445435,
2188
+ -0.8320122957229614,
2189
+ -1.3223334550857544,
2190
+ -1.0708671808242798,
2191
+ -1.2965141534805298,
2192
+ -1.2238413095474243,
2193
+ -0.8375024199485779,
2194
+ -1.4834433794021606,
2195
+ -1.4359830617904663,
2196
+ -1.1043082475662231,
2197
+ -0.4215860068798065,
2198
+ -1.165552020072937,
2199
+ -0.9108849167823792,
2200
+ -0.5494145154953003,
2201
+ -1.1019444465637207,
2202
+ -1.175946593284607,
2203
+ -1.3769150972366333,
2204
+ -0.8118351101875305,
2205
+ -0.5627930760383606,
2206
+ 0.42662879824638367,
2207
+ -0.79723060131073,
2208
+ -1.2102569341659546,
2209
+ -1.057364583015442,
2210
+ -0.6257443428039551,
2211
+ -1.2156857252120972,
2212
+ 0.07401619851589203,
2213
+ -0.19428183138370514,
2214
+ -1.3686164617538452,
2215
+ -0.7737688422203064,
2216
+ -1.3235282897949219,
2217
+ -0.8399721384048462,
2218
+ -1.405941128730774,
2219
+ -1.5592366456985474,
2220
+ -0.9101622104644775,
2221
+ -1.261431097984314,
2222
+ -1.4715503454208374,
2223
+ -0.7143574357032776,
2224
+ -1.0204397439956665,
2225
+ -0.9301544427871704,
2226
+ -0.9059253931045532,
2227
+ -1.363104224205017,
2228
+ -1.0408071279525757,
2229
+ -0.5231810808181763,
2230
+ -0.8147851228713989,
2231
+ -0.5815227031707764,
2232
+ -1.2578208446502686,
2233
+ -1.2115809917449951,
2234
+ -0.20410014688968658,
2235
+ -0.9834710955619812,
2236
+ -0.2164158970117569,
2237
+ -1.2872250080108643,
2238
+ -0.5837689638137817,
2239
+ -0.9912258386611938,
2240
+ -1.363468050956726,
2241
+ -1.5498169660568237,
2242
+ -1.676808476448059,
2243
+ -0.8511005640029907,
2244
+ -1.1692137718200684,
2245
+ -1.5668762922286987,
2246
+ -0.7676239013671875,
2247
+ -0.9124305248260498,
2248
+ 0.16939447820186615,
2249
+ -0.31101855635643005,
2250
+ -1.0691297054290771,
2251
+ -0.501971960067749,
2252
+ -1.4361848831176758,
2253
+ -0.9242026805877686,
2254
+ -1.6426604986190796,
2255
+ -1.3926655054092407,
2256
+ -1.3680651187896729,
2257
+ -1.083386778831482,
2258
+ -0.959460973739624,
2259
+ -0.6663812398910522,
2260
+ -0.010504857636988163,
2261
+ -1.4902433156967163,
2262
+ -1.5171691179275513,
2263
+ -1.0664881467819214,
2264
+ -0.5274778604507446,
2265
+ 0.1921592801809311,
2266
+ -1.098366618156433,
2267
+ -1.5588608980178833,
2268
+ -1.1489890813827515,
2269
+ -1.1369520425796509,
2270
+ 0.3563503921031952,
2271
+ -1.3361250162124634,
2272
+ -1.2933555841445923,
2273
+ -1.3619385957717896,
2274
+ -1.5391268730163574,
2275
+ -1.1701550483703613,
2276
+ -1.3788187503814697,
2277
+ -1.3458484411239624,
2278
+ -0.4887527525424957,
2279
+ -0.0013601938262581825,
2280
+ -1.0582460165023804,
2281
+ -1.1883710622787476,
2282
+ -1.0449692010879517,
2283
+ -1.2162553071975708,
2284
+ -0.9044857025146484,
2285
+ -1.3984860181808472,
2286
+ -0.9499913454055786,
2287
+ -1.6200333833694458,
2288
+ -1.1300207376480103,
2289
+ -0.9650235176086426,
2290
+ -0.5690132975578308,
2291
+ -0.4662869870662689,
2292
+ -0.16667522490024567,
2293
+ -0.752042829990387,
2294
+ -1.3309487104415894,
2295
+ -1.225335717201233,
2296
+ -1.2365578413009644,
2297
+ -0.9069069027900696,
2298
+ -0.7271102666854858,
2299
+ -0.14658190310001373,
2300
+ 0.3967756927013397,
2301
+ -1.3685957193374634,
2302
+ -1.2562447786331177,
2303
+ -1.0895122289657593,
2304
+ -0.5020142793655396,
2305
+ -0.028352752327919006,
2306
+ -1.1644818782806396,
2307
+ -0.9668689966201782,
2308
+ 1.1025002002716064,
2309
+ -1.1692272424697876,
2310
+ -0.6319659352302551,
2311
+ -1.1439204216003418,
2312
+ 0.49691805243492126,
2313
+ -0.35185858607292175,
2314
+ -0.8765090107917786,
2315
+ -1.470721960067749,
2316
+ -0.9665380120277405,
2317
+ -0.6002060770988464,
2318
+ -0.9109736084938049,
2319
+ -1.1581783294677734,
2320
+ 0.572312593460083,
2321
+ 0.2574540078639984,
2322
+ -0.5701669454574585,
2323
+ 1.090513825416565,
2324
+ -1.0458327531814575,
2325
+ -1.4234286546707153,
2326
+ 0.012985809706151485,
2327
+ -1.0741618871688843,
2328
+ -0.9203408360481262,
2329
+ -1.2890077829360962,
2330
+ -1.1437820196151733,
2331
+ -0.6267839074134827,
2332
+ -1.1842385530471802,
2333
+ -1.018751859664917,
2334
+ -1.199227213859558,
2335
+ -1.0425691604614258,
2336
+ -1.165580153465271,
2337
+ -1.641104817390442,
2338
+ -0.12194384634494781,
2339
+ -1.3169766664505005,
2340
+ -1.4135212898254395,
2341
+ -1.252974271774292,
2342
+ -0.9479157328605652,
2343
+ -1.0489166975021362,
2344
+ -0.6114026308059692,
2345
+ -0.7957653403282166,
2346
+ 1.0740691423416138,
2347
+ 0.054551586508750916,
2348
+ -1.0717458724975586,
2349
+ -1.4419230222702026,
2350
+ -1.5144823789596558,
2351
+ -1.1818755865097046,
2352
+ -1.1229751110076904,
2353
+ -0.9168567061424255,
2354
+ -0.836998701095581,
2355
+ -0.6674779653549194,
2356
+ -0.8780405521392822,
2357
+ -1.2626183032989502,
2358
+ -1.0922526121139526,
2359
+ -1.2334388494491577,
2360
+ -1.3546425104141235,
2361
+ -1.272213101387024,
2362
+ -1.2141586542129517,
2363
+ -0.5045045614242554,
2364
+ -1.4484882354736328,
2365
+ -1.3772671222686768,
2366
+ -0.786763072013855,
2367
+ -0.7398520112037659,
2368
+ -0.23209871351718903,
2369
+ -1.025002121925354,
2370
+ -1.4405869245529175,
2371
+ -0.7280598878860474,
2372
+ -1.372496485710144,
2373
+ -1.1243444681167603,
2374
+ -0.4826139509677887,
2375
+ -1.1691778898239136,
2376
+ -0.24191893637180328,
2377
+ -1.3957659006118774,
2378
+ -0.11672116816043854,
2379
+ 0.4142610728740692,
2380
+ -1.696844220161438,
2381
+ -0.7454454898834229,
2382
+ -1.3861486911773682,
2383
+ -0.23616541922092438,
2384
+ 0.19011090695858002,
2385
+ 0.007041796110570431,
2386
+ -0.6391705274581909,
2387
+ -1.3896441459655762,
2388
+ -1.1641253232955933,
2389
+ -1.2943997383117676,
2390
+ -1.0639652013778687,
2391
+ -1.0047719478607178,
2392
+ -1.073230504989624,
2393
+ -1.4314440488815308,
2394
+ -0.4413149654865265,
2395
+ -1.271539330482483,
2396
+ -1.1015499830245972,
2397
+ -0.9003686308860779,
2398
+ 0.22175787389278412,
2399
+ -1.7314022779464722,
2400
+ -1.0291393995285034,
2401
+ -0.9923107028007507,
2402
+ -1.4056998491287231,
2403
+ -1.0438529253005981,
2404
+ -1.0414537191390991,
2405
+ -0.4814246594905853,
2406
+ -1.1324678659439087,
2407
+ -1.2145153284072876,
2408
+ -0.018556013703346252,
2409
+ -1.3167885541915894,
2410
+ -1.2674485445022583,
2411
+ -1.2472387552261353,
2412
+ -1.357767939567566,
2413
+ -0.7871124148368835,
2414
+ -0.9183773398399353,
2415
+ -1.03573739528656,
2416
+ -1.2368382215499878,
2417
+ -1.1901153326034546,
2418
+ -1.1569315195083618,
2419
+ -0.3719566762447357,
2420
+ -0.9712820053100586,
2421
+ -1.1683547496795654,
2422
+ -1.3285936117172241,
2423
+ -1.0001368522644043,
2424
+ -1.1171013116836548,
2425
+ -1.0636926889419556,
2426
+ -0.7319978475570679,
2427
+ -1.3344272375106812,
2428
+ -0.5271331667900085,
2429
+ -1.108380675315857,
2430
+ -1.2069206237792969,
2431
+ -1.5007339715957642,
2432
+ -0.8225529193878174,
2433
+ -0.39571574330329895,
2434
+ -0.8545240163803101,
2435
+ -0.939009964466095,
2436
+ -0.7090561389923096,
2437
+ -1.3034240007400513,
2438
+ -1.3389779329299927,
2439
+ -1.4517487287521362,
2440
+ -1.2791043519973755,
2441
+ -1.2196251153945923,
2442
+ -0.7720922827720642,
2443
+ 0.009818061254918575,
2444
+ -1.0606576204299927,
2445
+ -1.5386348962783813,
2446
+ -0.49873319268226624,
2447
+ -1.2348953485488892,
2448
+ -1.3501261472702026,
2449
+ 0.20389269292354584,
2450
+ -0.6853388547897339,
2451
+ -1.3127449750900269,
2452
+ -1.3264213800430298,
2453
+ -1.3374541997909546,
2454
+ -1.4661260843276978,
2455
+ -1.358273983001709,
2456
+ -1.2727493047714233,
2457
+ -1.0428411960601807,
2458
+ -1.4156049489974976,
2459
+ -1.5383442640304565,
2460
+ -0.19810856878757477,
2461
+ -0.9483519196510315,
2462
+ -0.6928590536117554,
2463
+ -1.52010977268219,
2464
+ -0.699171245098114,
2465
+ -0.6971240639686584,
2466
+ -0.7011504173278809,
2467
+ -1.155248761177063,
2468
+ -0.6924137473106384,
2469
+ -1.4185646772384644,
2470
+ -0.5387814044952393,
2471
+ -1.3391962051391602,
2472
+ -1.1131404638290405,
2473
+ -0.23207320272922516,
2474
+ -0.8916599750518799,
2475
+ -0.3438597023487091,
2476
+ -1.2122001647949219,
2477
+ -1.1343821287155151,
2478
+ -1.3635507822036743,
2479
+ -0.22735263407230377,
2480
+ -1.3058441877365112,
2481
+ -0.7258656620979309,
2482
+ 0.29390057921409607,
2483
+ -1.0788987874984741,
2484
+ -1.5270284414291382,
2485
+ -0.11851920187473297,
2486
+ -0.8445732593536377,
2487
+ -1.0397111177444458,
2488
+ -1.4312148094177246,
2489
+ -0.48912665247917175,
2490
+ -0.40389564633369446,
2491
+ -0.7791967988014221,
2492
+ -1.473461627960205,
2493
+ -0.9230853319168091,
2494
+ -1.3727585077285767,
2495
+ -0.6365228891372681,
2496
+ -0.2781526744365692,
2497
+ -1.207934021949768,
2498
+ -1.6633857488632202,
2499
+ -1.472321629524231,
2500
+ -0.8375021815299988,
2501
+ 0.2233266681432724,
2502
+ -1.0967637300491333,
2503
+ -0.4719415009021759,
2504
+ -0.5953373908996582,
2505
+ -1.1706293821334839,
2506
+ -1.2641290426254272,
2507
+ -1.1315950155258179,
2508
+ -1.4614204168319702,
2509
+ 0.3091786801815033,
2510
+ -0.818038821220398,
2511
+ -0.3012649118900299,
2512
+ 0.060452088713645935,
2513
+ -1.5054800510406494,
2514
+ -0.6997225880622864,
2515
+ -0.39485272765159607,
2516
+ 0.6394056081771851,
2517
+ -1.198550820350647,
2518
+ -1.767461895942688,
2519
+ -0.9866728782653809,
2520
+ -1.2413042783737183,
2521
+ -1.1824604272842407,
2522
+ -1.2416857481002808,
2523
+ -1.3085559606552124,
2524
+ -1.08701491355896,
2525
+ -1.450231909751892,
2526
+ -0.3757852017879486,
2527
+ -0.7124491930007935,
2528
+ -0.8286599516868591,
2529
+ -0.9062120914459229,
2530
+ -0.9182184934616089,
2531
+ -1.0738707780838013,
2532
+ -1.144550085067749,
2533
+ -1.2616844177246094,
2534
+ -0.22269727289676666,
2535
+ -0.7682307362556458,
2536
+ -0.6781238317489624,
2537
+ -0.6973978281021118,
2538
+ -0.11867429316043854,
2539
+ -0.8849217891693115,
2540
+ -1.3652344942092896,
2541
+ -1.0526317358016968,
2542
+ -1.6429227590560913,
2543
+ -0.943528950214386,
2544
+ -0.9015306234359741,
2545
+ -0.2768527567386627,
2546
+ -1.2047876119613647,
2547
+ -1.262816309928894,
2548
+ -1.012769103050232,
2549
+ -1.3092306852340698,
2550
+ -1.4095810651779175,
2551
+ -1.2074328660964966,
2552
+ -1.0460366010665894,
2553
+ -1.1500095129013062,
2554
+ -1.3271747827529907,
2555
+ -0.9513668417930603,
2556
+ 0.6438976526260376,
2557
+ -1.1035774946212769,
2558
+ -0.8843411207199097,
2559
+ -0.8000177145004272,
2560
+ -1.5045992136001587,
2561
+ -1.126579999923706,
2562
+ -0.11600197851657867,
2563
+ -0.19741763174533844,
2564
+ -1.0779403448104858,
2565
+ -1.0982745885849,
2566
+ -1.384964942932129,
2567
+ -0.8195840120315552,
2568
+ -1.3244863748550415,
2569
+ -1.3768223524093628,
2570
+ -0.7962339520454407,
2571
+ -0.5237163305282593,
2572
+ 0.07084761559963226,
2573
+ -0.9398088455200195,
2574
+ -0.8678062558174133,
2575
+ -0.15564240515232086,
2576
+ -1.552290678024292,
2577
+ -0.2264268547296524,
2578
+ -1.486216425895691,
2579
+ -1.5606263875961304,
2580
+ -0.24224187433719635,
2581
+ -1.246364712715149,
2582
+ -0.559900164604187,
2583
+ 0.008201821707189083,
2584
+ -0.3500429093837738,
2585
+ -1.0735074281692505,
2586
+ -0.943900465965271,
2587
+ -1.1441141366958618,
2588
+ -0.3680678904056549,
2589
+ -0.6366925835609436,
2590
+ -0.37300965189933777,
2591
+ -0.19141246378421783,
2592
+ -0.7111642360687256,
2593
+ -1.1519018411636353,
2594
+ -0.6174110174179077,
2595
+ -1.2244807481765747,
2596
+ -1.0009732246398926,
2597
+ -0.02330435812473297,
2598
+ -0.21768976747989655,
2599
+ -1.3698362112045288,
2600
+ -1.3298921585083008,
2601
+ -1.4264507293701172,
2602
+ -0.540860652923584,
2603
+ -0.40517619252204895,
2604
+ 0.6136136054992676,
2605
+ -0.7996089458465576,
2606
+ -0.6104695796966553,
2607
+ -1.378538727760315,
2608
+ -1.3483070135116577,
2609
+ -1.256116509437561,
2610
+ -1.1850407123565674,
2611
+ -1.51103675365448,
2612
+ -1.4475914239883423,
2613
+ -1.1666336059570312,
2614
+ -1.5658149719238281,
2615
+ -1.4892488718032837,
2616
+ -1.4219106435775757,
2617
+ 0.7418984174728394,
2618
+ -1.2957139015197754,
2619
+ -1.5604408979415894,
2620
+ -1.1569644212722778,
2621
+ -1.1794366836547852,
2622
+ -0.30816689133644104,
2623
+ -1.5322526693344116,
2624
+ -0.8688992261886597,
2625
+ -1.4528192281723022,
2626
+ -1.1580830812454224,
2627
+ -0.014565245248377323,
2628
+ -0.474475234746933,
2629
+ 0.014821990393102169,
2630
+ -0.6087473034858704,
2631
+ -0.7213425040245056,
2632
+ -1.2617260217666626,
2633
+ -1.5209954977035522,
2634
+ -0.5113533735275269,
2635
+ -1.3458490371704102,
2636
+ -0.4788382947444916,
2637
+ 0.7946707010269165,
2638
+ -0.7677602171897888,
2639
+ -0.8414191603660583,
2640
+ -1.2489897012710571,
2641
+ -1.0095280408859253,
2642
+ -1.3162685632705688,
2643
+ 0.005988224409520626,
2644
+ -1.042623519897461,
2645
+ -1.0400854349136353,
2646
+ -1.3360613584518433,
2647
+ 0.330784410238266,
2648
+ -0.8324705958366394,
2649
+ -1.1600561141967773,
2650
+ -0.06505729258060455,
2651
+ -0.8765082955360413,
2652
+ -1.4467524290084839,
2653
+ -0.2287210375070572,
2654
+ -0.663372814655304,
2655
+ -0.07789601385593414,
2656
+ -0.6346545815467834,
2657
+ -0.9058581590652466,
2658
+ -0.6539178490638733,
2659
+ -1.1629935503005981,
2660
+ -0.9361223578453064,
2661
+ -1.1506065130233765,
2662
+ -0.4158417284488678,
2663
+ -0.697905421257019,
2664
+ -0.1303548961877823,
2665
+ -1.4202007055282593,
2666
+ -0.9198813438415527,
2667
+ -1.2915321588516235,
2668
+ -0.9178808331489563,
2669
+ -1.029377818107605,
2670
+ -0.5041115283966064,
2671
+ 0.16202472150325775,
2672
+ -0.9238173365592957,
2673
+ -0.6811884641647339,
2674
+ -1.2769876718521118,
2675
+ -0.9791812300682068,
2676
+ 0.47918447852134705,
2677
+ -1.1676777601242065,
2678
+ -0.9222741723060608,
2679
+ -0.9837856888771057,
2680
+ -1.0935677289962769,
2681
+ -0.01858152449131012,
2682
+ -0.8957308530807495,
2683
+ -0.43482866883277893,
2684
+ -1.1667014360427856,
2685
+ -0.9445974230766296,
2686
+ -0.9307692050933838,
2687
+ -1.6614753007888794,
2688
+ 0.5352747440338135,
2689
+ -0.9231467247009277,
2690
+ -0.9404262900352478,
2691
+ -0.8758543133735657,
2692
+ -1.5432997941970825,
2693
+ -1.1090211868286133,
2694
+ -0.966707170009613,
2695
+ -1.0872668027877808,
2696
+ -0.8224151134490967,
2697
+ -0.9858319163322449,
2698
+ -0.16963256895542145,
2699
+ -1.0992341041564941,
2700
+ -0.6463789939880371,
2701
+ -1.1305361986160278,
2702
+ 0.2096841186285019,
2703
+ -0.8299525380134583,
2704
+ -1.2720800638198853,
2705
+ -0.37857869267463684,
2706
+ -1.0754050016403198,
2707
+ -1.1038943529129028,
2708
+ -1.088903784751892,
2709
+ -0.9868150353431702,
2710
+ -1.163740873336792,
2711
+ -1.1748262643814087,
2712
+ 0.9026385545730591,
2713
+ -1.4277020692825317,
2714
+ -0.5975708961486816,
2715
+ -1.6601542234420776,
2716
+ -1.2365549802780151,
2717
+ -1.0570287704467773,
2718
+ -0.881546139717102,
2719
+ -1.5622869729995728,
2720
+ -1.1042119264602661,
2721
+ -0.9444888830184937,
2722
+ -1.0370608568191528,
2723
+ -1.1647688150405884,
2724
+ -1.4417469501495361,
2725
+ -1.465951681137085,
2726
+ -0.988541841506958,
2727
+ -0.8139640688896179,
2728
+ -0.7364895343780518,
2729
+ -0.41542449593544006,
2730
+ -1.1022886037826538,
2731
+ 0.05091296136379242,
2732
+ -0.4695890247821808,
2733
+ -1.2488163709640503,
2734
+ 1.0923802852630615,
2735
+ -0.70888352394104,
2736
+ -0.8679651021957397,
2737
+ -1.1629937887191772,
2738
+ -0.6150709390640259,
2739
+ -0.8837733864784241,
2740
+ -1.1071339845657349,
2741
+ -0.3754521906375885,
2742
+ -1.4570363759994507,
2743
+ -1.127729058265686,
2744
+ -0.9726239442825317,
2745
+ -0.612522304058075,
2746
+ 0.0952894538640976,
2747
+ -0.3659636080265045,
2748
+ -1.0023387670516968,
2749
+ -1.570412278175354,
2750
+ -1.1010292768478394,
2751
+ -1.1832431554794312,
2752
+ -1.7374292612075806,
2753
+ -0.5568716526031494,
2754
+ -0.7121038436889648,
2755
+ -1.3530811071395874,
2756
+ -1.279495120048523,
2757
+ -1.5103851556777954,
2758
+ -1.085608720779419,
2759
+ -0.8847021460533142,
2760
+ -0.9256088733673096,
2761
+ -1.1106775999069214,
2762
+ 0.4987280070781708,
2763
+ -1.084812879562378,
2764
+ -0.8635910153388977,
2765
+ -0.9441797137260437,
2766
+ -1.0820561647415161,
2767
+ -1.6706066131591797,
2768
+ -1.3973785638809204,
2769
+ -1.3889341354370117,
2770
+ -1.3167940378189087,
2771
+ -0.9053592085838318,
2772
+ -0.2705017626285553,
2773
+ -1.256576657295227,
2774
+ -1.2301541566848755,
2775
+ -0.7430564761161804,
2776
+ -0.7977895736694336,
2777
+ -1.1151841878890991,
2778
+ -1.4885450601577759,
2779
+ -0.8911278247833252,
2780
+ -0.56389319896698,
2781
+ -1.2147144079208374,
2782
+ -0.9449588060379028,
2783
+ -1.0949448347091675,
2784
+ -1.2233556509017944,
2785
+ -0.16197015345096588,
2786
+ -1.0933526754379272,
2787
+ -1.1799758672714233,
2788
+ -0.4796079695224762,
2789
+ -0.8549340963363647,
2790
+ -1.178010106086731,
2791
+ -1.2427467107772827,
2792
+ -1.0439432859420776,
2793
+ -1.5877436399459839,
2794
+ -1.0440751314163208,
2795
+ -1.2762155532836914,
2796
+ -1.5716335773468018,
2797
+ -0.27675536274909973,
2798
+ -0.5893144607543945,
2799
+ -0.9182599186897278,
2800
+ -1.4421690702438354,
2801
+ -0.7054351568222046,
2802
+ -0.7453989386558533,
2803
+ -0.3231634199619293,
2804
+ -0.4924408495426178,
2805
+ -0.9107930660247803,
2806
+ -1.2792284488677979,
2807
+ -1.4993127584457397,
2808
+ -0.6322556734085083,
2809
+ -0.8596406579017639,
2810
+ -1.0310468673706055,
2811
+ -1.1138601303100586,
2812
+ -1.2365285158157349,
2813
+ -0.8116298317909241,
2814
+ -1.358725666999817,
2815
+ -1.4040976762771606,
2816
+ -1.5007456541061401,
2817
+ -0.7143256664276123,
2818
+ -1.2492244243621826,
2819
+ 1.1023930311203003,
2820
+ -0.5321947336196899,
2821
+ -1.4590041637420654,
2822
+ -1.6718393564224243,
2823
+ -1.527998924255371,
2824
+ 0.19000230729579926,
2825
+ -0.8324226140975952,
2826
+ -0.5516420602798462,
2827
+ -0.3370189368724823,
2828
+ -1.2786742448806763,
2829
+ -0.9113629460334778,
2830
+ -0.9532013535499573,
2831
+ -0.8125823736190796,
2832
+ -0.8905069231987,
2833
+ -1.689782977104187,
2834
+ -1.1433745622634888,
2835
+ -0.9894424080848694,
2836
+ -0.23308606445789337,
2837
+ -1.0192456245422363,
2838
+ -0.5440317392349243,
2839
+ -1.3474482297897339,
2840
+ -1.0304723978042603,
2841
+ -0.522537887096405,
2842
+ 0.1262032836675644,
2843
+ -1.5569463968276978,
2844
+ -1.5526334047317505,
2845
+ -0.06504608690738678,
2846
+ -1.0864057540893555,
2847
+ -1.043601393699646,
2848
+ -1.2631226778030396,
2849
+ -1.092206358909607,
2850
+ -1.2258023023605347,
2851
+ -1.0878068208694458,
2852
+ -1.3628796339035034,
2853
+ -1.1633291244506836,
2854
+ -0.9971394538879395,
2855
+ -1.0942350625991821,
2856
+ 0.23825465142726898,
2857
+ -0.679481565952301,
2858
+ -1.5438601970672607,
2859
+ -0.7059271931648254,
2860
+ -1.140924334526062,
2861
+ 0.3353012502193451,
2862
+ -1.314504623413086,
2863
+ -0.04792548716068268,
2864
+ -0.22224701941013336,
2865
+ -1.0012998580932617,
2866
+ -1.3226211071014404,
2867
+ -0.2975049316883087,
2868
+ -0.8053306341171265,
2869
+ -0.9479836225509644,
2870
+ -1.1037245988845825,
2871
+ -0.814189076423645,
2872
+ -1.3602921962738037,
2873
+ -1.084218144416809,
2874
+ -0.9857936501502991,
2875
+ -0.9706522226333618,
2876
+ -0.9547253847122192,
2877
+ 0.4584660232067108,
2878
+ -0.23239900171756744,
2879
+ -1.063173770904541,
2880
+ -1.151955008506775,
2881
+ -1.201534628868103,
2882
+ -0.7556970715522766,
2883
+ -0.8209346532821655,
2884
+ -0.9069279432296753,
2885
+ -0.8971031904220581,
2886
+ -1.5121980905532837,
2887
+ -1.5700048208236694,
2888
+ -1.5717331171035767,
2889
+ -1.220469355583191,
2890
+ -1.2920562028884888,
2891
+ -1.44342839717865,
2892
+ -0.9711740016937256,
2893
+ -1.1984741687774658,
2894
+ -0.7261865735054016,
2895
+ -0.2131655365228653,
2896
+ -1.069841742515564,
2897
+ -0.028435245156288147,
2898
+ -0.41998037695884705,
2899
+ -1.216279149055481,
2900
+ -0.8096799254417419,
2901
+ -1.433142900466919,
2902
+ -0.8913851976394653,
2903
+ -1.2137858867645264,
2904
+ -0.5827171206474304,
2905
+ -1.2841016054153442,
2906
+ -0.4370885193347931,
2907
+ -1.4194637537002563,
2908
+ 0.3204810321331024,
2909
+ -0.9385785460472107,
2910
+ -1.2558149099349976,
2911
+ -0.994329035282135,
2912
+ -1.0529118776321411,
2913
+ -0.9317667484283447,
2914
+ -1.3329136371612549,
2915
+ -1.2004085779190063,
2916
+ -1.432111144065857,
2917
+ -1.0176655054092407,
2918
+ -0.7352328896522522,
2919
+ -1.0329703092575073,
2920
+ -0.6954311728477478,
2921
+ -0.9645253419876099,
2922
+ -1.1705378293991089,
2923
+ -1.2448421716690063,
2924
+ -0.9709760546684265,
2925
+ -1.326785683631897,
2926
+ -0.921366274356842,
2927
+ -1.267281174659729,
2928
+ -0.5977557301521301,
2929
+ -1.251054048538208,
2930
+ -0.1585092693567276,
2931
+ -0.3532696068286896,
2932
+ -0.5717041492462158,
2933
+ 0.16470013558864594,
2934
+ -1.0971158742904663,
2935
+ -0.897404670715332,
2936
+ -1.0670673847198486,
2937
+ -0.9306927919387817,
2938
+ -0.9806605577468872,
2939
+ -0.7767217755317688,
2940
+ -1.2497406005859375
2941
+ ]
2942
+ }
results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/bleurt_lucadiliello_BLEURT-20.json ADDED
@@ -0,0 +1,2942 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "lucadiliello/BLEURT-20",
3
+ "n": 2935,
4
+ "mean": 0.3432247767837328,
5
+ "per_sample": [
6
+ 0.525364100933075,
7
+ 0.2389819175004959,
8
+ 0.2427750825881958,
9
+ 0.3111777901649475,
10
+ 0.5874272584915161,
11
+ 0.12284278869628906,
12
+ 0.25483477115631104,
13
+ 0.563905656337738,
14
+ 0.2611337900161743,
15
+ 0.7014768719673157,
16
+ 0.473175048828125,
17
+ 0.5683711171150208,
18
+ 0.365689218044281,
19
+ 0.6499885320663452,
20
+ 0.11555038392543793,
21
+ 0.6148045063018799,
22
+ 0.3218795657157898,
23
+ 0.35482650995254517,
24
+ 0.2963533401489258,
25
+ 0.31750762462615967,
26
+ 0.30786794424057007,
27
+ 0.39516013860702515,
28
+ 0.18302688002586365,
29
+ 0.4340112805366516,
30
+ 0.2635068893432617,
31
+ 0.3611469864845276,
32
+ 0.46870213747024536,
33
+ 0.24146457016468048,
34
+ 0.4159505367279053,
35
+ 0.34128546714782715,
36
+ 0.19694961607456207,
37
+ 0.17608901858329773,
38
+ 0.5260912179946899,
39
+ 0.13533352315425873,
40
+ 0.18355730175971985,
41
+ 0.4983465075492859,
42
+ 0.1764565408229828,
43
+ 0.19655096530914307,
44
+ 0.2934160828590393,
45
+ 0.19817213714122772,
46
+ 0.12933146953582764,
47
+ 0.12729698419570923,
48
+ 0.16573306918144226,
49
+ 0.3167615532875061,
50
+ 0.45627695322036743,
51
+ 0.21660828590393066,
52
+ 0.24108675122261047,
53
+ 0.24422018229961395,
54
+ 0.38388723134994507,
55
+ 0.09038782864809036,
56
+ 0.34683459997177124,
57
+ 0.3368409276008606,
58
+ 0.34615451097488403,
59
+ 0.5208815336227417,
60
+ 0.3699668049812317,
61
+ 0.4863201379776001,
62
+ 0.37246304750442505,
63
+ 0.3387092053890228,
64
+ 0.14392513036727905,
65
+ 0.2620829939842224,
66
+ 0.4674431085586548,
67
+ 0.41470980644226074,
68
+ 0.2545442283153534,
69
+ 0.341621994972229,
70
+ 0.3031572103500366,
71
+ 0.44121456146240234,
72
+ 0.37179553508758545,
73
+ 0.22011908888816833,
74
+ 0.26259714365005493,
75
+ 0.4378213882446289,
76
+ 0.37747204303741455,
77
+ 0.2472834289073944,
78
+ 0.9597417712211609,
79
+ 0.534753680229187,
80
+ 0.1971968114376068,
81
+ 0.37894946336746216,
82
+ 0.2240648865699768,
83
+ 0.353301465511322,
84
+ 0.3436586856842041,
85
+ 0.2824600338935852,
86
+ 0.3632960319519043,
87
+ 0.408255934715271,
88
+ 0.5476476550102234,
89
+ 0.40815722942352295,
90
+ 0.2500091791152954,
91
+ 0.36009299755096436,
92
+ 0.25653275847435,
93
+ 0.37971818447113037,
94
+ 0.17555874586105347,
95
+ 0.20876409113407135,
96
+ 0.37729376554489136,
97
+ 0.38077449798583984,
98
+ 0.3469729423522949,
99
+ 0.340679407119751,
100
+ 0.24585644900798798,
101
+ 0.3143707513809204,
102
+ 0.29956698417663574,
103
+ 0.37313419580459595,
104
+ 0.2646854817867279,
105
+ 0.4429227113723755,
106
+ 0.10603446513414383,
107
+ 0.2707725763320923,
108
+ 0.22945784032344818,
109
+ 0.15259769558906555,
110
+ 0.27580487728118896,
111
+ 0.20924511551856995,
112
+ 0.49800431728363037,
113
+ 0.15872830152511597,
114
+ 0.32519516348838806,
115
+ 0.3998073935508728,
116
+ 0.37370020151138306,
117
+ 0.2465609759092331,
118
+ 0.3030698895454407,
119
+ 0.3414253890514374,
120
+ 0.6579551100730896,
121
+ 0.3437952399253845,
122
+ 0.36686813831329346,
123
+ 0.4612390398979187,
124
+ 0.2572329044342041,
125
+ 0.4462354779243469,
126
+ 0.28650104999542236,
127
+ 0.20468315482139587,
128
+ 0.24944642186164856,
129
+ 0.14993835985660553,
130
+ 0.19770856201648712,
131
+ 0.29399144649505615,
132
+ 0.16517290472984314,
133
+ 0.36880218982696533,
134
+ 0.2644392251968384,
135
+ 0.17868655920028687,
136
+ 0.27142348885536194,
137
+ 0.3311126232147217,
138
+ 0.41780149936676025,
139
+ 0.1312708854675293,
140
+ 0.6376001834869385,
141
+ 0.24491450190544128,
142
+ 0.31641024351119995,
143
+ 0.5305089950561523,
144
+ 0.46590548753738403,
145
+ 0.5790526270866394,
146
+ 0.21628716588020325,
147
+ 0.15677201747894287,
148
+ 0.34238260984420776,
149
+ 0.619257926940918,
150
+ 0.129119873046875,
151
+ 0.9645219445228577,
152
+ 0.5458438396453857,
153
+ 0.26534631848335266,
154
+ 0.15985539555549622,
155
+ 0.19905352592468262,
156
+ 0.33384132385253906,
157
+ 0.13256017863750458,
158
+ 0.4778634309768677,
159
+ 0.20108716189861298,
160
+ 0.22879013419151306,
161
+ 0.22621574997901917,
162
+ 0.31104445457458496,
163
+ 0.30604708194732666,
164
+ 0.4814912676811218,
165
+ 0.25736188888549805,
166
+ 0.34215837717056274,
167
+ 0.4143378734588623,
168
+ 0.32615935802459717,
169
+ 0.4512137174606323,
170
+ 0.3221127986907959,
171
+ 0.6185945868492126,
172
+ 0.3180365562438965,
173
+ 0.28903329372406006,
174
+ 0.3627886474132538,
175
+ 0.25396090745925903,
176
+ 0.30031514167785645,
177
+ 0.28520339727401733,
178
+ 0.3685763478279114,
179
+ 0.19199033081531525,
180
+ 0.2148619443178177,
181
+ 0.23355618119239807,
182
+ 0.19651466608047485,
183
+ 0.39655405282974243,
184
+ 0.17122122645378113,
185
+ 0.34509432315826416,
186
+ 0.22428977489471436,
187
+ 0.21809625625610352,
188
+ 0.25544166564941406,
189
+ 0.4182059168815613,
190
+ 0.3051631450653076,
191
+ 0.5790984034538269,
192
+ 0.3507812023162842,
193
+ 0.33598119020462036,
194
+ 0.3306102454662323,
195
+ 0.4244672656059265,
196
+ 0.4633256793022156,
197
+ 0.32380223274230957,
198
+ 0.514306366443634,
199
+ 0.2104243040084839,
200
+ 0.3391542434692383,
201
+ 0.21434420347213745,
202
+ 0.24753394722938538,
203
+ 0.2875208258628845,
204
+ 0.32421308755874634,
205
+ 0.422232449054718,
206
+ 0.23460546135902405,
207
+ 0.38138192892074585,
208
+ 0.33939728140830994,
209
+ 0.5403667688369751,
210
+ 0.2539884150028229,
211
+ 0.401323139667511,
212
+ 0.30650269985198975,
213
+ 0.4738186001777649,
214
+ 0.2933167815208435,
215
+ 0.40005308389663696,
216
+ 0.488660991191864,
217
+ 0.36431992053985596,
218
+ 0.3934972882270813,
219
+ 0.016780242323875427,
220
+ 0.3045724034309387,
221
+ 0.2659432590007782,
222
+ 0.1869831681251526,
223
+ 0.4499140977859497,
224
+ 0.1484006643295288,
225
+ 0.3840040862560272,
226
+ 0.2754207253456116,
227
+ 0.26341313123703003,
228
+ 0.41182219982147217,
229
+ 0.5347984433174133,
230
+ 0.242837592959404,
231
+ 0.2623227536678314,
232
+ 0.22046974301338196,
233
+ 0.3295130729675293,
234
+ 0.14878937602043152,
235
+ 0.4490826725959778,
236
+ 0.5174046754837036,
237
+ 0.17977187037467957,
238
+ 0.19247961044311523,
239
+ 0.15312698483467102,
240
+ 0.13458113372325897,
241
+ 0.08391276746988297,
242
+ 0.7615258097648621,
243
+ 0.39948850870132446,
244
+ 0.5106479525566101,
245
+ 0.3538122773170471,
246
+ 0.4333326816558838,
247
+ 0.23041898012161255,
248
+ 0.2624308466911316,
249
+ 0.2187388837337494,
250
+ 0.2883337140083313,
251
+ 0.2974100708961487,
252
+ 0.4208493232727051,
253
+ 0.30464088916778564,
254
+ 0.45881789922714233,
255
+ 0.3920760452747345,
256
+ 0.40776771306991577,
257
+ 0.11436506360769272,
258
+ 0.26346975564956665,
259
+ 0.4679695963859558,
260
+ 0.320171982049942,
261
+ 0.3371295928955078,
262
+ 0.1822218894958496,
263
+ 0.37486451864242554,
264
+ 0.29795247316360474,
265
+ 0.6496174335479736,
266
+ 0.23411531746387482,
267
+ 0.2652962803840637,
268
+ 0.9561281800270081,
269
+ 0.34669166803359985,
270
+ 0.2297496199607849,
271
+ 0.49682939052581787,
272
+ 0.07979754358530045,
273
+ 0.2322700470685959,
274
+ 0.25790369510650635,
275
+ 0.38432446122169495,
276
+ 0.35180777311325073,
277
+ 0.1454438716173172,
278
+ 0.3573175072669983,
279
+ 0.3593232035636902,
280
+ 0.16338655352592468,
281
+ 0.224237322807312,
282
+ 0.5452932715415955,
283
+ 0.3683905005455017,
284
+ 0.26108407974243164,
285
+ 0.40661466121673584,
286
+ 0.17963054776191711,
287
+ 0.20842617750167847,
288
+ 0.3610883355140686,
289
+ 0.41288381814956665,
290
+ 0.2541637420654297,
291
+ 0.2728284001350403,
292
+ 0.27729493379592896,
293
+ 0.1553346812725067,
294
+ 0.4342491626739502,
295
+ 0.24327430129051208,
296
+ 0.09305628389120102,
297
+ 0.20764970779418945,
298
+ 0.2689044177532196,
299
+ 0.1719481647014618,
300
+ 0.36350035667419434,
301
+ 0.18704912066459656,
302
+ 0.16892912983894348,
303
+ 0.28212231397628784,
304
+ 0.21440541744232178,
305
+ 0.4774484634399414,
306
+ 0.9810040593147278,
307
+ 0.33444666862487793,
308
+ 0.273629754781723,
309
+ 0.3576430678367615,
310
+ 0.1874522566795349,
311
+ 0.14132168889045715,
312
+ 0.2093760073184967,
313
+ 0.2972509264945984,
314
+ 0.17512035369873047,
315
+ 0.2874841094017029,
316
+ 0.15342718362808228,
317
+ 0.2966184616088867,
318
+ 0.1308262050151825,
319
+ 0.16737404465675354,
320
+ 0.17630185186862946,
321
+ 0.3700791895389557,
322
+ 0.19357594847679138,
323
+ 0.28357988595962524,
324
+ 0.28845497965812683,
325
+ 0.3834506571292877,
326
+ 0.08328797668218613,
327
+ 0.21019013226032257,
328
+ 0.11113980412483215,
329
+ 0.40206170082092285,
330
+ 0.2708956301212311,
331
+ 0.22778981924057007,
332
+ 0.6087872385978699,
333
+ 0.2798466682434082,
334
+ 0.3420652151107788,
335
+ 0.5824354290962219,
336
+ 0.5198968648910522,
337
+ 0.42442959547042847,
338
+ 0.19182619452476501,
339
+ 0.2602677047252655,
340
+ 0.17636314034461975,
341
+ -0.002156481146812439,
342
+ 0.26710963249206543,
343
+ 0.37068337202072144,
344
+ 0.4501497745513916,
345
+ 0.2041511833667755,
346
+ 0.18401944637298584,
347
+ 0.5304834246635437,
348
+ 0.33057332038879395,
349
+ 0.10677595436573029,
350
+ 0.13834431767463684,
351
+ 0.44489336013793945,
352
+ 0.22098574042320251,
353
+ 0.5343053340911865,
354
+ 0.27019450068473816,
355
+ 0.22862257063388824,
356
+ 0.36235612630844116,
357
+ 0.31833088397979736,
358
+ 0.587138295173645,
359
+ 0.40155935287475586,
360
+ 0.45886778831481934,
361
+ 0.2383149266242981,
362
+ 0.13018012046813965,
363
+ 0.11632487922906876,
364
+ 0.044390954077243805,
365
+ 0.16041788458824158,
366
+ 0.11112459748983383,
367
+ 0.6193885207176208,
368
+ 0.9586355090141296,
369
+ 0.2889123260974884,
370
+ 0.63593590259552,
371
+ 0.09418381750583649,
372
+ 0.1582936942577362,
373
+ 0.22929297387599945,
374
+ 0.33176761865615845,
375
+ 0.27704334259033203,
376
+ 0.3064049482345581,
377
+ 0.3395518660545349,
378
+ 0.39732813835144043,
379
+ 0.11971325427293777,
380
+ 0.6694098114967346,
381
+ 0.1625567525625229,
382
+ 0.6133956909179688,
383
+ 0.26060134172439575,
384
+ 0.32730168104171753,
385
+ 0.5039103627204895,
386
+ 0.7127212285995483,
387
+ 0.2549009323120117,
388
+ 0.5130575299263,
389
+ 0.2767869234085083,
390
+ 0.4583572745323181,
391
+ 0.17340564727783203,
392
+ 0.2686474621295929,
393
+ 0.2832581400871277,
394
+ 0.15509659051895142,
395
+ 0.3468908667564392,
396
+ 0.3341454863548279,
397
+ 0.23408737778663635,
398
+ 0.36961308121681213,
399
+ 0.5971750020980835,
400
+ 0.3939838409423828,
401
+ 0.26233458518981934,
402
+ 0.4649515748023987,
403
+ 0.3975684642791748,
404
+ 0.39559870958328247,
405
+ 0.2644260823726654,
406
+ 0.24659956991672516,
407
+ 0.4494074583053589,
408
+ 0.30082738399505615,
409
+ 0.35195910930633545,
410
+ 0.3986164331436157,
411
+ 0.45980125665664673,
412
+ 0.21166765689849854,
413
+ 0.22661863267421722,
414
+ 0.35672223567962646,
415
+ 0.4313599467277527,
416
+ 0.22739918529987335,
417
+ 0.33164578676223755,
418
+ 0.24748149514198303,
419
+ 0.18727004528045654,
420
+ 0.5029535293579102,
421
+ 0.3831065893173218,
422
+ 0.3278694152832031,
423
+ 0.19115327298641205,
424
+ 0.23774707317352295,
425
+ 0.16372674703598022,
426
+ 0.3195118308067322,
427
+ 0.6176484823226929,
428
+ 0.21957683563232422,
429
+ 0.4000401496887207,
430
+ 0.1517639011144638,
431
+ 0.19928967952728271,
432
+ 0.5435557961463928,
433
+ 0.40820711851119995,
434
+ 0.44522523880004883,
435
+ 0.5275707840919495,
436
+ 0.34341734647750854,
437
+ 0.17042185366153717,
438
+ 0.15492764115333557,
439
+ 0.5332468152046204,
440
+ 0.35259392857551575,
441
+ 0.32906609773635864,
442
+ 0.42412304878234863,
443
+ 0.44367527961730957,
444
+ 0.3246292471885681,
445
+ 0.530794084072113,
446
+ 0.37083691358566284,
447
+ 0.3694365620613098,
448
+ 0.44178152084350586,
449
+ 0.3810994625091553,
450
+ 0.6249363422393799,
451
+ 0.4528513550758362,
452
+ 0.30188095569610596,
453
+ 0.5092048048973083,
454
+ 0.21027866005897522,
455
+ 0.2756016254425049,
456
+ 0.1474917232990265,
457
+ 0.11722911149263382,
458
+ 0.3016532361507416,
459
+ 0.18332454562187195,
460
+ 0.9586355090141296,
461
+ 0.3603108525276184,
462
+ 0.4634937047958374,
463
+ 0.3493143320083618,
464
+ 0.4077681303024292,
465
+ 0.22176644206047058,
466
+ 0.4361599087715149,
467
+ 0.3395634889602661,
468
+ 0.30917516350746155,
469
+ 0.2799896001815796,
470
+ 0.30000782012939453,
471
+ 0.48121917247772217,
472
+ 0.24831035733222961,
473
+ 0.33010202646255493,
474
+ 0.26813748478889465,
475
+ 0.2814474105834961,
476
+ 0.2621533274650574,
477
+ 0.24578601121902466,
478
+ 0.4239445924758911,
479
+ 0.3551400899887085,
480
+ 0.06955032050609589,
481
+ 0.2315325140953064,
482
+ 0.42575615644454956,
483
+ 0.153318852186203,
484
+ 0.361627995967865,
485
+ 0.6694214344024658,
486
+ 0.17154863476753235,
487
+ 0.1290564388036728,
488
+ 0.24359926581382751,
489
+ 0.19986531138420105,
490
+ 0.4564207196235657,
491
+ 0.3717426061630249,
492
+ 0.2763844132423401,
493
+ 0.07784074544906616,
494
+ 0.18395499885082245,
495
+ 0.40210044384002686,
496
+ 0.30756354331970215,
497
+ 0.22237399220466614,
498
+ 0.6290240287780762,
499
+ 0.3410816788673401,
500
+ 0.25768089294433594,
501
+ 0.3038584589958191,
502
+ 0.5282872915267944,
503
+ 0.48306065797805786,
504
+ 0.46157991886138916,
505
+ 0.2676565945148468,
506
+ 0.6867504715919495,
507
+ 0.3066873550415039,
508
+ 0.3394232392311096,
509
+ 0.35499459505081177,
510
+ 0.3471187949180603,
511
+ 0.06563764065504074,
512
+ 0.17839206755161285,
513
+ 0.2464856058359146,
514
+ 0.6750788688659668,
515
+ 0.23147395253181458,
516
+ 0.2785643935203552,
517
+ 0.35825836658477783,
518
+ 0.21818166971206665,
519
+ 0.3905699849128723,
520
+ 0.3046796917915344,
521
+ 0.40936779975891113,
522
+ 0.4515196681022644,
523
+ 0.6284723877906799,
524
+ 0.5273686647415161,
525
+ 0.21189093589782715,
526
+ 0.13178405165672302,
527
+ 0.2876513600349426,
528
+ 0.47682517766952515,
529
+ 0.6308866143226624,
530
+ 0.6920582056045532,
531
+ 0.13027076423168182,
532
+ 0.07881353795528412,
533
+ 0.41642290353775024,
534
+ 0.5450282096862793,
535
+ 0.3735884428024292,
536
+ 0.4996463656425476,
537
+ 0.44063031673431396,
538
+ 0.3306354284286499,
539
+ 0.2112797498703003,
540
+ 0.1803414225578308,
541
+ 0.3836483955383301,
542
+ 0.30746185779571533,
543
+ 0.4744476079940796,
544
+ 0.3009011149406433,
545
+ 0.3557714819908142,
546
+ 0.3343977928161621,
547
+ 0.16200140118598938,
548
+ 0.21864384412765503,
549
+ 0.5908604264259338,
550
+ 0.297016978263855,
551
+ 0.30373233556747437,
552
+ 0.4172390103340149,
553
+ 0.22414380311965942,
554
+ 0.46120792627334595,
555
+ 0.2891314625740051,
556
+ 0.21817192435264587,
557
+ 0.5962387323379517,
558
+ 0.496299684047699,
559
+ 0.34951913356781006,
560
+ 0.4842866063117981,
561
+ 0.8740504384040833,
562
+ 0.49470531940460205,
563
+ 0.3464547395706177,
564
+ 0.5442764163017273,
565
+ 0.324954628944397,
566
+ 0.3948100209236145,
567
+ 0.24404826760292053,
568
+ 0.5073816180229187,
569
+ 0.3613983988761902,
570
+ 0.41743236780166626,
571
+ 0.5675530433654785,
572
+ 0.31103938817977905,
573
+ 0.14040632545948029,
574
+ 0.39873528480529785,
575
+ 0.2773746848106384,
576
+ 0.21682427823543549,
577
+ 0.2626921832561493,
578
+ 0.5524812936782837,
579
+ 0.42511993646621704,
580
+ 0.20483799278736115,
581
+ 0.4652875065803528,
582
+ 0.2702326774597168,
583
+ 0.6585344672203064,
584
+ 0.4736582040786743,
585
+ 0.5414422154426575,
586
+ 0.37172454595565796,
587
+ 0.3989723324775696,
588
+ 0.4404568672180176,
589
+ 0.31281131505966187,
590
+ 0.42873966693878174,
591
+ 0.33129948377609253,
592
+ 0.3343717157840729,
593
+ 0.5430934429168701,
594
+ 0.41433829069137573,
595
+ 0.35825130343437195,
596
+ 0.22384941577911377,
597
+ 0.3747538924217224,
598
+ 0.6376128792762756,
599
+ 0.3202422857284546,
600
+ 0.24964682757854462,
601
+ 0.3550822138786316,
602
+ 0.1377231478691101,
603
+ 0.2635730504989624,
604
+ 0.0868309885263443,
605
+ 0.36149436235427856,
606
+ 0.4920848608016968,
607
+ 0.27971604466438293,
608
+ 0.15199893712997437,
609
+ 0.18215014040470123,
610
+ 0.6216076016426086,
611
+ 0.21057096123695374,
612
+ 0.24505968391895294,
613
+ 0.06214497983455658,
614
+ 0.2872748374938965,
615
+ 0.34836041927337646,
616
+ 0.4739372134208679,
617
+ 0.5615917444229126,
618
+ 0.337823748588562,
619
+ 0.3923559784889221,
620
+ 0.3901940584182739,
621
+ 0.24142864346504211,
622
+ 0.35069912672042847,
623
+ 0.45487046241760254,
624
+ 0.17297355830669403,
625
+ 0.22819779813289642,
626
+ 0.35823261737823486,
627
+ 0.2591753304004669,
628
+ 0.2961925268173218,
629
+ 0.172047957777977,
630
+ 0.27759110927581787,
631
+ 0.3760242462158203,
632
+ 0.3134015202522278,
633
+ 0.13658776879310608,
634
+ 0.14888015389442444,
635
+ 0.4427153468132019,
636
+ 0.08072096109390259,
637
+ 0.17471972107887268,
638
+ 0.3103695511817932,
639
+ 0.2481164187192917,
640
+ 0.36932432651519775,
641
+ 0.09884028136730194,
642
+ 0.38054364919662476,
643
+ 0.20613566040992737,
644
+ 0.29372984170913696,
645
+ 0.22607287764549255,
646
+ 0.3479969799518585,
647
+ 0.29619261622428894,
648
+ 0.41352027654647827,
649
+ 0.3674541115760803,
650
+ 0.49502992630004883,
651
+ 0.3672946095466614,
652
+ 0.21110376715660095,
653
+ 0.45992088317871094,
654
+ 0.3399924635887146,
655
+ 0.4607340693473816,
656
+ 0.0325758159160614,
657
+ 0.2119305431842804,
658
+ 0.4238857626914978,
659
+ 0.23462113738059998,
660
+ 0.6212929487228394,
661
+ 0.6287245154380798,
662
+ 0.3964730501174927,
663
+ 0.5688876509666443,
664
+ 0.7287148833274841,
665
+ 0.2612844407558441,
666
+ 0.6731773018836975,
667
+ 0.7282639741897583,
668
+ 0.2612689137458801,
669
+ 0.3190160393714905,
670
+ 0.4487752318382263,
671
+ 0.28385359048843384,
672
+ 0.2097204327583313,
673
+ 0.2074958086013794,
674
+ 0.2655769884586334,
675
+ 0.27754417061805725,
676
+ 0.41886091232299805,
677
+ 0.3080981969833374,
678
+ 0.283580482006073,
679
+ 0.29183369874954224,
680
+ 0.3469022512435913,
681
+ 0.20572584867477417,
682
+ 0.22017709910869598,
683
+ 0.38677966594696045,
684
+ 0.2861472964286804,
685
+ 0.14323370158672333,
686
+ 0.4284970760345459,
687
+ 0.3203532099723816,
688
+ 0.4418681859970093,
689
+ 0.27475714683532715,
690
+ 0.20882925391197205,
691
+ 0.2972111105918884,
692
+ 0.16193267703056335,
693
+ 0.4578210115432739,
694
+ 0.29628241062164307,
695
+ 0.4933571219444275,
696
+ 0.3689061403274536,
697
+ 0.2026686668395996,
698
+ 0.26917946338653564,
699
+ 0.10370003432035446,
700
+ 0.2543157935142517,
701
+ 0.5854073166847229,
702
+ 0.5167906880378723,
703
+ 0.15378789603710175,
704
+ 0.10338349640369415,
705
+ 0.5481559634208679,
706
+ 0.3584100604057312,
707
+ 0.6185843348503113,
708
+ 0.3145056962966919,
709
+ 0.184434175491333,
710
+ 0.28613948822021484,
711
+ 0.4186739921569824,
712
+ 0.3046247363090515,
713
+ 0.24534617364406586,
714
+ 0.3938114643096924,
715
+ 0.2943494915962219,
716
+ 0.2528208792209625,
717
+ 0.34653401374816895,
718
+ 0.27885183691978455,
719
+ 0.269586443901062,
720
+ 0.4329947829246521,
721
+ 0.4246373772621155,
722
+ 0.3155011534690857,
723
+ 0.38416171073913574,
724
+ 0.15607646107673645,
725
+ 0.1173681989312172,
726
+ 0.4979957938194275,
727
+ 0.2288559377193451,
728
+ 0.25262853503227234,
729
+ 0.2116229385137558,
730
+ 0.3315103054046631,
731
+ 0.13440607488155365,
732
+ 0.27519968152046204,
733
+ 0.2379598617553711,
734
+ 0.40552306175231934,
735
+ 0.69831782579422,
736
+ 0.4023240804672241,
737
+ 0.2568233609199524,
738
+ 0.3059515357017517,
739
+ 0.25108757615089417,
740
+ 0.23893524706363678,
741
+ 0.24920111894607544,
742
+ 0.26930198073387146,
743
+ 0.43118995428085327,
744
+ 0.36968696117401123,
745
+ 0.2589168846607208,
746
+ 0.28909677267074585,
747
+ 0.47825926542282104,
748
+ 0.2885589003562927,
749
+ 0.21866510808467865,
750
+ 0.2894260287284851,
751
+ 0.23442992568016052,
752
+ 0.07755396515130997,
753
+ 0.4826319217681885,
754
+ 0.23597359657287598,
755
+ 0.30673736333847046,
756
+ 0.32059186697006226,
757
+ 0.18234899640083313,
758
+ 0.2481611669063568,
759
+ 0.15286076068878174,
760
+ 0.40936172008514404,
761
+ 0.3525356650352478,
762
+ 0.23314744234085083,
763
+ 0.3312484920024872,
764
+ 0.8104034066200256,
765
+ 0.3069274425506592,
766
+ 0.2959842085838318,
767
+ 0.22442930936813354,
768
+ 0.40336036682128906,
769
+ 0.3645363450050354,
770
+ 0.33512794971466064,
771
+ 0.3796868324279785,
772
+ 0.3953111171722412,
773
+ 0.3984145224094391,
774
+ 0.4931267499923706,
775
+ 0.08338846266269684,
776
+ 0.961190402507782,
777
+ 0.39545929431915283,
778
+ 0.2878936529159546,
779
+ 0.961190402507782,
780
+ 0.9571136832237244,
781
+ 0.24211493134498596,
782
+ 0.17608648538589478,
783
+ 0.11710463464260101,
784
+ 0.10909620672464371,
785
+ 0.22444424033164978,
786
+ 0.34039920568466187,
787
+ 0.5468373894691467,
788
+ 0.17276674509048462,
789
+ 0.36465054750442505,
790
+ 0.9838587045669556,
791
+ 0.2562951147556305,
792
+ 0.33675622940063477,
793
+ 0.19777944684028625,
794
+ 0.2559061050415039,
795
+ 0.3862879276275635,
796
+ 0.12807735800743103,
797
+ 0.27265897393226624,
798
+ 0.3865090012550354,
799
+ 0.17884662747383118,
800
+ 0.24745619297027588,
801
+ 0.24125437438488007,
802
+ 0.3359922170639038,
803
+ 0.4677172303199768,
804
+ 0.2735491394996643,
805
+ 0.24737927317619324,
806
+ 0.21856620907783508,
807
+ 0.2416989952325821,
808
+ 0.22695890069007874,
809
+ 0.28967463970184326,
810
+ 0.4721744656562805,
811
+ 0.1749992072582245,
812
+ 0.23898741602897644,
813
+ 0.30572134256362915,
814
+ 0.25062116980552673,
815
+ 0.3741097152233124,
816
+ 0.3281153738498688,
817
+ 0.33302003145217896,
818
+ 0.20429369807243347,
819
+ 0.32270801067352295,
820
+ 0.32943302392959595,
821
+ 0.17362067103385925,
822
+ 0.20745688676834106,
823
+ 0.30834370851516724,
824
+ 0.5425484776496887,
825
+ 0.1798122078180313,
826
+ 0.3917121887207031,
827
+ 0.13213439285755157,
828
+ 0.19206807017326355,
829
+ 0.385172575712204,
830
+ 0.34748169779777527,
831
+ 0.10761549323797226,
832
+ 0.374392032623291,
833
+ 0.16507941484451294,
834
+ 0.5692509412765503,
835
+ 0.20765438675880432,
836
+ 0.2829768657684326,
837
+ 0.5583539009094238,
838
+ 0.24821928143501282,
839
+ 0.22780461609363556,
840
+ 0.21153756976127625,
841
+ 0.34079647064208984,
842
+ 0.3940865993499756,
843
+ 0.2676650285720825,
844
+ 0.7445603013038635,
845
+ 0.6082637906074524,
846
+ 0.5048897862434387,
847
+ 0.52269446849823,
848
+ 0.38283103704452515,
849
+ 0.4757804274559021,
850
+ 0.3375071883201599,
851
+ 0.32986778020858765,
852
+ 0.2682948112487793,
853
+ 0.5949154496192932,
854
+ 0.3313979506492615,
855
+ 0.4026648998260498,
856
+ 0.40704309940338135,
857
+ 0.2949620485305786,
858
+ 0.4452691078186035,
859
+ 0.3345429301261902,
860
+ 0.2617444097995758,
861
+ 0.3295236825942993,
862
+ 0.32285624742507935,
863
+ 0.037968069314956665,
864
+ 0.17835214734077454,
865
+ 0.3225526213645935,
866
+ 0.5179916620254517,
867
+ 0.25517022609710693,
868
+ 0.04593996703624725,
869
+ 0.19653959572315216,
870
+ 0.11207816749811172,
871
+ 0.15961214900016785,
872
+ 0.43831944465637207,
873
+ 0.4452493190765381,
874
+ 0.48265016078948975,
875
+ 0.3562888503074646,
876
+ 0.37734514474868774,
877
+ 0.26842960715293884,
878
+ 0.29263532161712646,
879
+ 0.2803375720977783,
880
+ 0.3523876667022705,
881
+ 0.6537628769874573,
882
+ 0.46659499406814575,
883
+ 0.32209646701812744,
884
+ 0.25835686922073364,
885
+ 0.5458837151527405,
886
+ 0.48926842212677,
887
+ 0.2761423587799072,
888
+ 0.43925875425338745,
889
+ 0.25340256094932556,
890
+ 0.24078701436519623,
891
+ 0.16985982656478882,
892
+ 0.20337219536304474,
893
+ 0.5811801552772522,
894
+ 0.47004836797714233,
895
+ 0.872029721736908,
896
+ 0.2043086588382721,
897
+ 0.63868647813797,
898
+ 0.13021114468574524,
899
+ 0.44964486360549927,
900
+ 0.3551397919654846,
901
+ 0.26482605934143066,
902
+ 0.4224362373352051,
903
+ 0.4238244891166687,
904
+ 0.3109015226364136,
905
+ 0.2511403262615204,
906
+ 0.20256802439689636,
907
+ 0.4107487201690674,
908
+ 0.2876020073890686,
909
+ 0.2368161976337433,
910
+ 0.22294163703918457,
911
+ 0.15556205809116364,
912
+ 0.19653712213039398,
913
+ 0.3667616844177246,
914
+ 0.33971500396728516,
915
+ 0.3174143433570862,
916
+ 0.2667785882949829,
917
+ 0.7224289774894714,
918
+ 0.3718724250793457,
919
+ 0.5091577172279358,
920
+ 0.3127524256706238,
921
+ 0.2923526167869568,
922
+ 0.3187074661254883,
923
+ 0.3245159387588501,
924
+ 0.22915144264698029,
925
+ 0.24750837683677673,
926
+ 0.5000144243240356,
927
+ 0.29072582721710205,
928
+ 0.2526286244392395,
929
+ 0.31796932220458984,
930
+ 0.2396436333656311,
931
+ 0.35455673933029175,
932
+ 0.3008045554161072,
933
+ 0.2632574439048767,
934
+ 0.2833189368247986,
935
+ 0.40079277753829956,
936
+ 0.2554394602775574,
937
+ 0.378842830657959,
938
+ 0.39019322395324707,
939
+ 0.456052303314209,
940
+ 0.4007437825202942,
941
+ 0.31287604570388794,
942
+ 0.2833314538002014,
943
+ 0.4873278737068176,
944
+ 0.2787492275238037,
945
+ 0.3128068447113037,
946
+ 0.49504339694976807,
947
+ 0.5119625329971313,
948
+ 0.46881550550460815,
949
+ 0.5380476713180542,
950
+ 0.4371466040611267,
951
+ 0.4953175187110901,
952
+ 0.16848629713058472,
953
+ 0.1493939459323883,
954
+ 0.34836238622665405,
955
+ 0.5860401391983032,
956
+ 0.2831370532512665,
957
+ 0.4565631151199341,
958
+ 0.15465965867042542,
959
+ 0.4138229489326477,
960
+ 0.40881794691085815,
961
+ 0.1300542652606964,
962
+ 0.2670062780380249,
963
+ 0.1942424476146698,
964
+ 0.3395841121673584,
965
+ 0.6291651725769043,
966
+ 0.41761505603790283,
967
+ 0.3533640503883362,
968
+ 0.26583418250083923,
969
+ 0.8937619924545288,
970
+ 0.1964443027973175,
971
+ 0.15969793498516083,
972
+ 0.4524465799331665,
973
+ 0.06772024929523468,
974
+ 0.18791192770004272,
975
+ 0.2448979616165161,
976
+ 0.3163163661956787,
977
+ 0.5887288451194763,
978
+ 0.17171120643615723,
979
+ 0.4202250838279724,
980
+ 0.25461530685424805,
981
+ 0.44614237546920776,
982
+ 0.11200469732284546,
983
+ 0.24587202072143555,
984
+ 0.11804136633872986,
985
+ 0.45898979902267456,
986
+ 0.0942888930439949,
987
+ 0.3079480826854706,
988
+ 0.19402000308036804,
989
+ 0.24003249406814575,
990
+ 0.22451826930046082,
991
+ 0.33571869134902954,
992
+ 0.12330932915210724,
993
+ 0.3418540358543396,
994
+ 0.2513623535633087,
995
+ 0.3061577081680298,
996
+ 0.2824222147464752,
997
+ 0.4592679738998413,
998
+ 0.39577674865722656,
999
+ 0.317743718624115,
1000
+ 0.27259376645088196,
1001
+ 0.4307224154472351,
1002
+ 0.4234501123428345,
1003
+ 0.07469917833805084,
1004
+ 0.2394762635231018,
1005
+ 0.13678058981895447,
1006
+ 0.37805479764938354,
1007
+ 0.40256160497665405,
1008
+ 0.3565855622291565,
1009
+ 0.23207324743270874,
1010
+ 0.12814053893089294,
1011
+ 0.32329005002975464,
1012
+ 0.18587970733642578,
1013
+ 0.29795753955841064,
1014
+ 0.5195831656455994,
1015
+ 0.3142632246017456,
1016
+ 0.2795918583869934,
1017
+ 0.33431434631347656,
1018
+ 0.29554611444473267,
1019
+ 0.25724753737449646,
1020
+ 0.7868978977203369,
1021
+ 0.5410436987876892,
1022
+ 0.36797887086868286,
1023
+ 0.28725433349609375,
1024
+ 0.28576546907424927,
1025
+ 0.19555974006652832,
1026
+ 0.1150694191455841,
1027
+ 0.2123730182647705,
1028
+ 0.4359387755393982,
1029
+ 0.24671012163162231,
1030
+ 0.560584306716919,
1031
+ 0.22929230332374573,
1032
+ 0.4130229353904724,
1033
+ 0.18108925223350525,
1034
+ 0.3182481527328491,
1035
+ 0.6334096789360046,
1036
+ 0.32451069355010986,
1037
+ 0.23680439591407776,
1038
+ 0.4424546957015991,
1039
+ 0.6354242563247681,
1040
+ 0.043904103338718414,
1041
+ 0.31253260374069214,
1042
+ 0.3504680395126343,
1043
+ 0.31850388646125793,
1044
+ 0.5215155482292175,
1045
+ 0.5595844388008118,
1046
+ 0.1498154252767563,
1047
+ 0.2473267912864685,
1048
+ 0.29011091589927673,
1049
+ 0.5141929984092712,
1050
+ 0.3718055784702301,
1051
+ 0.4125480651855469,
1052
+ 0.27774930000305176,
1053
+ 0.3546338677406311,
1054
+ 0.18532848358154297,
1055
+ 0.24965056777000427,
1056
+ 0.3029462695121765,
1057
+ 0.22930029034614563,
1058
+ 0.6452258229255676,
1059
+ 0.2410314679145813,
1060
+ 0.44680994749069214,
1061
+ 0.26915809512138367,
1062
+ 0.4211028814315796,
1063
+ 0.2681577801704407,
1064
+ 0.3117517828941345,
1065
+ 0.42093050479888916,
1066
+ 0.1960272341966629,
1067
+ 0.4209379553794861,
1068
+ 0.108414426445961,
1069
+ 0.3814995586872101,
1070
+ 0.2847617268562317,
1071
+ 0.30633723735809326,
1072
+ 0.4157405495643616,
1073
+ 0.38432759046554565,
1074
+ 0.4433645009994507,
1075
+ 0.3262803256511688,
1076
+ 0.43842774629592896,
1077
+ 0.3414801359176636,
1078
+ 0.24608957767486572,
1079
+ 0.368526816368103,
1080
+ 0.41477257013320923,
1081
+ 0.5425421595573425,
1082
+ 0.4762086272239685,
1083
+ 0.30515623092651367,
1084
+ 0.47058647871017456,
1085
+ 0.3192105293273926,
1086
+ 0.5259917974472046,
1087
+ 0.29760628938674927,
1088
+ 0.3414725065231323,
1089
+ 0.48748642206192017,
1090
+ 0.3102426528930664,
1091
+ 0.2717340588569641,
1092
+ 0.4011406898498535,
1093
+ 0.2819860577583313,
1094
+ 0.4287928342819214,
1095
+ 0.5209531784057617,
1096
+ 0.3563300669193268,
1097
+ 0.47846782207489014,
1098
+ 0.5786089301109314,
1099
+ 0.3568299412727356,
1100
+ 0.10063469409942627,
1101
+ 0.2284334897994995,
1102
+ 0.2793356478214264,
1103
+ 0.13846872746944427,
1104
+ 0.16713836789131165,
1105
+ 0.33475983142852783,
1106
+ 0.9941867589950562,
1107
+ 0.45938217639923096,
1108
+ 0.3089827299118042,
1109
+ 0.4706817865371704,
1110
+ 0.3679782748222351,
1111
+ 0.5336365103721619,
1112
+ 0.22831007838249207,
1113
+ 0.1929035782814026,
1114
+ 0.5691901445388794,
1115
+ 0.24685680866241455,
1116
+ 0.1807071566581726,
1117
+ 0.3579493761062622,
1118
+ 0.18487980961799622,
1119
+ 0.6619279384613037,
1120
+ 0.24672266840934753,
1121
+ 0.3164098858833313,
1122
+ 0.4808792471885681,
1123
+ 0.3747042715549469,
1124
+ 0.46898823976516724,
1125
+ 0.2731219530105591,
1126
+ 0.26538199186325073,
1127
+ 0.1308225691318512,
1128
+ 0.09314008057117462,
1129
+ 0.08038384467363358,
1130
+ 0.37931692600250244,
1131
+ 0.23741590976715088,
1132
+ 0.28429368138313293,
1133
+ 0.19204077124595642,
1134
+ 0.10389559715986252,
1135
+ 0.5532882809638977,
1136
+ 0.28049367666244507,
1137
+ 0.4188501834869385,
1138
+ 0.3101308345794678,
1139
+ 0.16435237228870392,
1140
+ 0.5569139719009399,
1141
+ 0.3453328609466553,
1142
+ 0.31178563833236694,
1143
+ 0.7098595499992371,
1144
+ 0.37774938344955444,
1145
+ 0.3963170647621155,
1146
+ 0.498729944229126,
1147
+ 0.3607308864593506,
1148
+ 0.4280061721801758,
1149
+ 0.25091472268104553,
1150
+ 0.32697513699531555,
1151
+ 0.1501728892326355,
1152
+ 0.19154906272888184,
1153
+ 0.31461119651794434,
1154
+ 0.33435600996017456,
1155
+ 0.3996083736419678,
1156
+ 0.3782975673675537,
1157
+ 0.2869417071342468,
1158
+ 0.48178666830062866,
1159
+ 0.3221317529678345,
1160
+ 0.5317230820655823,
1161
+ 0.37506717443466187,
1162
+ 0.29032444953918457,
1163
+ 0.2313898503780365,
1164
+ 0.3726811408996582,
1165
+ 0.4642307162284851,
1166
+ 0.5964757204055786,
1167
+ 0.39242976903915405,
1168
+ 0.4760134220123291,
1169
+ 0.3099997341632843,
1170
+ 0.45427900552749634,
1171
+ 0.44083303213119507,
1172
+ 0.4110978841781616,
1173
+ 0.28680098056793213,
1174
+ 0.1905064880847931,
1175
+ 0.4154582619667053,
1176
+ 0.27525776624679565,
1177
+ 0.21629473567008972,
1178
+ 0.17937706410884857,
1179
+ 0.29549092054367065,
1180
+ 0.4124680757522583,
1181
+ 0.24538767337799072,
1182
+ 0.38354408740997314,
1183
+ 0.42579740285873413,
1184
+ 0.2884671092033386,
1185
+ 0.31011563539505005,
1186
+ 0.21677786111831665,
1187
+ 0.11918485909700394,
1188
+ 0.2715412378311157,
1189
+ 0.19713890552520752,
1190
+ 0.40017175674438477,
1191
+ 0.21673084795475006,
1192
+ 0.2877587676048279,
1193
+ 0.1905689537525177,
1194
+ 0.7841958999633789,
1195
+ 0.29786068201065063,
1196
+ 0.45111972093582153,
1197
+ 0.6392446756362915,
1198
+ 0.20259228348731995,
1199
+ 0.31983673572540283,
1200
+ 0.23179467022418976,
1201
+ 0.29634061455726624,
1202
+ 0.31396540999412537,
1203
+ 0.28419631719589233,
1204
+ 0.22531436383724213,
1205
+ 0.2763827443122864,
1206
+ 0.4290351867675781,
1207
+ 0.21094194054603577,
1208
+ 0.32735997438430786,
1209
+ 0.28447943925857544,
1210
+ 0.22480562329292297,
1211
+ 0.10745684802532196,
1212
+ 0.3633604049682617,
1213
+ 0.2082442343235016,
1214
+ 0.06862781941890717,
1215
+ 0.2890954613685608,
1216
+ 0.6720523238182068,
1217
+ 0.3345249891281128,
1218
+ 0.533907413482666,
1219
+ 0.473010778427124,
1220
+ 0.38280582427978516,
1221
+ 0.9553683400154114,
1222
+ 0.30986660718917847,
1223
+ 0.30484968423843384,
1224
+ 0.3000037968158722,
1225
+ 0.24807268381118774,
1226
+ 0.3356080651283264,
1227
+ 0.2595953941345215,
1228
+ 0.9433866143226624,
1229
+ 0.4251440763473511,
1230
+ 0.42147237062454224,
1231
+ 0.23343965411186218,
1232
+ 0.25881555676460266,
1233
+ 0.07675696909427643,
1234
+ 0.4221600294113159,
1235
+ 0.1976621150970459,
1236
+ 0.30008143186569214,
1237
+ 0.5198274254798889,
1238
+ 0.2767636179924011,
1239
+ 0.4281580448150635,
1240
+ 0.5381259918212891,
1241
+ 0.205430805683136,
1242
+ 0.4002588987350464,
1243
+ 0.24426671862602234,
1244
+ 0.17902012169361115,
1245
+ 0.34493201971054077,
1246
+ 0.24196958541870117,
1247
+ 0.22995629906654358,
1248
+ 0.17881697416305542,
1249
+ 0.15988633036613464,
1250
+ 0.3976314663887024,
1251
+ 0.12085916846990585,
1252
+ 0.19851498305797577,
1253
+ 0.7978290915489197,
1254
+ 0.28986644744873047,
1255
+ 0.5860416293144226,
1256
+ 0.15564417839050293,
1257
+ 0.3064735531806946,
1258
+ 0.27354151010513306,
1259
+ 0.4156782031059265,
1260
+ 0.4586968421936035,
1261
+ 0.7800207734107971,
1262
+ 0.3292521834373474,
1263
+ 0.1263880431652069,
1264
+ 0.12124946713447571,
1265
+ 0.27661290764808655,
1266
+ 0.5450366139411926,
1267
+ 0.13413557410240173,
1268
+ 0.7086458206176758,
1269
+ 0.17448434233665466,
1270
+ 0.32638442516326904,
1271
+ 0.280237078666687,
1272
+ 0.3552037179470062,
1273
+ 0.3894665837287903,
1274
+ 0.46642589569091797,
1275
+ 0.34797781705856323,
1276
+ 0.3409269452095032,
1277
+ 0.4478111267089844,
1278
+ 0.6269140839576721,
1279
+ 0.19762665033340454,
1280
+ 0.24825915694236755,
1281
+ 0.22276923060417175,
1282
+ 0.6773907542228699,
1283
+ 0.6051144003868103,
1284
+ 0.3379952907562256,
1285
+ 0.3649851381778717,
1286
+ 0.8450667858123779,
1287
+ 0.25683164596557617,
1288
+ 0.41157591342926025,
1289
+ 0.2326383888721466,
1290
+ 0.3076045513153076,
1291
+ 0.4566456079483032,
1292
+ 0.6847506761550903,
1293
+ 0.3066694736480713,
1294
+ 0.6323658227920532,
1295
+ 0.22454974055290222,
1296
+ 0.5249784588813782,
1297
+ 0.46720975637435913,
1298
+ 0.49919700622558594,
1299
+ 0.5677735209465027,
1300
+ 0.49969929456710815,
1301
+ 0.3319687843322754,
1302
+ 0.307437539100647,
1303
+ 0.26190096139907837,
1304
+ 0.22903048992156982,
1305
+ 0.17053815722465515,
1306
+ 0.32666003704071045,
1307
+ 0.4904094934463501,
1308
+ 0.3031275272369385,
1309
+ 0.3774259686470032,
1310
+ 0.4795023798942566,
1311
+ 0.14390788972377777,
1312
+ 0.2886793613433838,
1313
+ 0.3753439784049988,
1314
+ 0.433951199054718,
1315
+ 0.21475273370742798,
1316
+ 0.6041831374168396,
1317
+ 0.28538060188293457,
1318
+ 0.3578837513923645,
1319
+ 0.36057114601135254,
1320
+ 0.37164318561553955,
1321
+ 0.462757408618927,
1322
+ 0.3040487766265869,
1323
+ 0.442138135433197,
1324
+ 0.26558876037597656,
1325
+ 0.4776318669319153,
1326
+ 0.341511070728302,
1327
+ 0.2852533757686615,
1328
+ 0.44873887300491333,
1329
+ 0.4718325734138489,
1330
+ 0.2724120020866394,
1331
+ 0.26722636818885803,
1332
+ 0.3611307144165039,
1333
+ 0.20010784268379211,
1334
+ 0.25565457344055176,
1335
+ 0.2798815965652466,
1336
+ 0.29131972789764404,
1337
+ 0.44960707426071167,
1338
+ 0.2732260227203369,
1339
+ 0.36319559812545776,
1340
+ 0.9846243262290955,
1341
+ 0.31894785165786743,
1342
+ 0.269623339176178,
1343
+ 0.5558276772499084,
1344
+ 0.42248058319091797,
1345
+ 0.7047757506370544,
1346
+ 0.20438814163208008,
1347
+ 0.2544967532157898,
1348
+ -0.005997940897941589,
1349
+ 0.4494870901107788,
1350
+ 0.8421923518180847,
1351
+ 0.17315779626369476,
1352
+ 0.589576244354248,
1353
+ 0.5416717529296875,
1354
+ 0.2508474290370941,
1355
+ 0.25586169958114624,
1356
+ 0.2540898323059082,
1357
+ 0.12842275202274323,
1358
+ 0.3716893792152405,
1359
+ 0.4581645727157593,
1360
+ 0.18002301454544067,
1361
+ 0.37324464321136475,
1362
+ 0.4443402886390686,
1363
+ 0.3214573264122009,
1364
+ 0.26283231377601624,
1365
+ 0.1462964117527008,
1366
+ 0.04944319278001785,
1367
+ 0.5419237613677979,
1368
+ 0.24855002760887146,
1369
+ 0.2527323067188263,
1370
+ 0.37741076946258545,
1371
+ 0.45064330101013184,
1372
+ 0.23281535506248474,
1373
+ 0.350386381149292,
1374
+ 0.09952635318040848,
1375
+ 0.3129380941390991,
1376
+ 0.204466313123703,
1377
+ 0.26942822337150574,
1378
+ 0.13455282151699066,
1379
+ 0.26172417402267456,
1380
+ 0.45093172788619995,
1381
+ 0.3596200942993164,
1382
+ 0.26862668991088867,
1383
+ 0.31022655963897705,
1384
+ 0.2207953929901123,
1385
+ 0.2605980336666107,
1386
+ 0.2850004732608795,
1387
+ 0.3076099157333374,
1388
+ 0.24049696326255798,
1389
+ 0.2362402081489563,
1390
+ 0.2528468668460846,
1391
+ 0.17739656567573547,
1392
+ 0.13124382495880127,
1393
+ 0.13076293468475342,
1394
+ 0.1761859655380249,
1395
+ 0.18106791377067566,
1396
+ 0.3383125066757202,
1397
+ 0.2929118275642395,
1398
+ 0.20562179386615753,
1399
+ 0.2670735716819763,
1400
+ 0.3613044023513794,
1401
+ 0.09107579290866852,
1402
+ 0.2940024733543396,
1403
+ 0.1632966697216034,
1404
+ 0.49246567487716675,
1405
+ 0.3441435694694519,
1406
+ 0.31907016038894653,
1407
+ 0.33979296684265137,
1408
+ 0.16928568482398987,
1409
+ 0.12457452714443207,
1410
+ 0.6195047497749329,
1411
+ 0.2866538166999817,
1412
+ 0.23467038571834564,
1413
+ 0.41495198011398315,
1414
+ 0.11242829263210297,
1415
+ 0.35608595609664917,
1416
+ 0.2585465908050537,
1417
+ 0.17102043330669403,
1418
+ 0.20097757875919342,
1419
+ 0.5552868247032166,
1420
+ 0.23002959787845612,
1421
+ 0.5719740986824036,
1422
+ 0.45461875200271606,
1423
+ 0.48351460695266724,
1424
+ 0.2538180351257324,
1425
+ 0.17244327068328857,
1426
+ 0.4287220239639282,
1427
+ 0.5531697869300842,
1428
+ 0.3694767355918884,
1429
+ 0.37702423334121704,
1430
+ 0.418429970741272,
1431
+ 0.5419261455535889,
1432
+ 0.39436739683151245,
1433
+ 0.335517019033432,
1434
+ 0.971902072429657,
1435
+ 0.37589120864868164,
1436
+ 0.2620278596878052,
1437
+ 0.350081205368042,
1438
+ 0.3754132390022278,
1439
+ 0.29300457239151,
1440
+ 0.5017378926277161,
1441
+ 0.16814979910850525,
1442
+ 0.2579098343849182,
1443
+ 0.3131721615791321,
1444
+ 0.4716913104057312,
1445
+ 0.3499723970890045,
1446
+ 0.26871705055236816,
1447
+ 0.09221958369016647,
1448
+ 0.22339266538619995,
1449
+ 0.3212388753890991,
1450
+ 0.26304057240486145,
1451
+ 0.3475419878959656,
1452
+ 0.2857397198677063,
1453
+ 0.4776310324668884,
1454
+ 0.3338533639907837,
1455
+ 0.38762176036834717,
1456
+ 0.4313567876815796,
1457
+ 0.4317830801010132,
1458
+ 0.381120502948761,
1459
+ 0.4404301047325134,
1460
+ 0.23475605249404907,
1461
+ 0.3229729235172272,
1462
+ 0.4745035767555237,
1463
+ 0.7153122425079346,
1464
+ 0.40281587839126587,
1465
+ 0.23002241551876068,
1466
+ 0.4381449222564697,
1467
+ 0.3213126063346863,
1468
+ 0.5992273688316345,
1469
+ 0.3465866446495056,
1470
+ 0.466971218585968,
1471
+ 0.4371706247329712,
1472
+ 0.38282495737075806,
1473
+ 0.40910452604293823,
1474
+ 0.3341909646987915,
1475
+ 0.3870691657066345,
1476
+ 0.4272361993789673,
1477
+ 0.12429012358188629,
1478
+ 0.18265748023986816,
1479
+ 0.5489997267723083,
1480
+ 0.3422408103942871,
1481
+ 0.4010814428329468,
1482
+ 0.25894835591316223,
1483
+ 0.31461310386657715,
1484
+ 0.339418888092041,
1485
+ 0.3509875535964966,
1486
+ 0.5851086974143982,
1487
+ 0.3202314078807831,
1488
+ 0.49844980239868164,
1489
+ 0.2977038621902466,
1490
+ 0.25020819902420044,
1491
+ 0.2777642011642456,
1492
+ 0.22721272706985474,
1493
+ 0.21108588576316833,
1494
+ 0.20565655827522278,
1495
+ 0.28873616456985474,
1496
+ 0.22576898336410522,
1497
+ 0.4331520199775696,
1498
+ 0.39965134859085083,
1499
+ 0.4675353169441223,
1500
+ 0.4316161274909973,
1501
+ 0.3117329478263855,
1502
+ 0.30354416370391846,
1503
+ 0.5101445913314819,
1504
+ 0.7333673238754272,
1505
+ 0.18528832495212555,
1506
+ 0.4106476306915283,
1507
+ 0.1525752991437912,
1508
+ 0.34777459502220154,
1509
+ 0.5536898374557495,
1510
+ 0.4915667772293091,
1511
+ 0.2595832347869873,
1512
+ 0.5128856897354126,
1513
+ 0.2514110505580902,
1514
+ 0.3865542411804199,
1515
+ 0.3430016040802002,
1516
+ 0.5316863059997559,
1517
+ 0.3782748579978943,
1518
+ 0.5715367197990417,
1519
+ 0.30364447832107544,
1520
+ 0.5289368629455566,
1521
+ 0.31786930561065674,
1522
+ 0.2530013620853424,
1523
+ 0.21872656047344208,
1524
+ 0.2634185254573822,
1525
+ 0.45570218563079834,
1526
+ 0.3193287253379822,
1527
+ 0.11597399413585663,
1528
+ 0.3359960913658142,
1529
+ 0.5040755271911621,
1530
+ 0.36228519678115845,
1531
+ 0.34690916538238525,
1532
+ 0.28590983152389526,
1533
+ 0.2507146894931793,
1534
+ 0.21627730131149292,
1535
+ 0.6085251569747925,
1536
+ 0.8442512154579163,
1537
+ 0.17530158162117004,
1538
+ 0.3624420166015625,
1539
+ 0.4384458065032959,
1540
+ 0.23814453184604645,
1541
+ 0.22788533568382263,
1542
+ 0.19064143300056458,
1543
+ 0.6883893013000488,
1544
+ 0.2904495596885681,
1545
+ 0.27691584825515747,
1546
+ 0.20770469307899475,
1547
+ 0.3706393241882324,
1548
+ 0.28112292289733887,
1549
+ 0.13711631298065186,
1550
+ 0.46669715642929077,
1551
+ 0.3658739924430847,
1552
+ 0.31483596563339233,
1553
+ 0.3679824471473694,
1554
+ 0.1814226657152176,
1555
+ 0.5451287627220154,
1556
+ 0.37644368410110474,
1557
+ 0.2720697522163391,
1558
+ 0.456815242767334,
1559
+ 0.2534048557281494,
1560
+ 0.22910869121551514,
1561
+ 0.2961989641189575,
1562
+ 0.4446832537651062,
1563
+ 0.35867634415626526,
1564
+ 0.21538694202899933,
1565
+ 0.28261077404022217,
1566
+ 0.494975745677948,
1567
+ 0.17292305827140808,
1568
+ 0.3096126317977905,
1569
+ 0.343780517578125,
1570
+ 0.23625150322914124,
1571
+ 0.2643430829048157,
1572
+ 0.5970984101295471,
1573
+ 0.43883824348449707,
1574
+ 0.36375999450683594,
1575
+ 0.3176508843898773,
1576
+ 0.2938759922981262,
1577
+ 0.8193045258522034,
1578
+ 0.20806297659873962,
1579
+ 0.5235626101493835,
1580
+ 0.29741156101226807,
1581
+ 0.347145676612854,
1582
+ 0.5935245752334595,
1583
+ 0.30092912912368774,
1584
+ 0.3549072742462158,
1585
+ 0.3776143193244934,
1586
+ 0.43103837966918945,
1587
+ 0.33691221475601196,
1588
+ 0.11364571750164032,
1589
+ 0.46466565132141113,
1590
+ 0.48569607734680176,
1591
+ 0.3087628483772278,
1592
+ 0.5132293105125427,
1593
+ 0.5654565691947937,
1594
+ 0.5341516733169556,
1595
+ 0.3959752917289734,
1596
+ 0.5342163443565369,
1597
+ 0.17258569598197937,
1598
+ 0.3704720735549927,
1599
+ 0.1308012306690216,
1600
+ 0.14757418632507324,
1601
+ 0.2658499479293823,
1602
+ 0.16229195892810822,
1603
+ 0.467001736164093,
1604
+ 0.17593801021575928,
1605
+ 0.32836049795150757,
1606
+ 0.1788957566022873,
1607
+ 0.5527647137641907,
1608
+ 0.2123866230249405,
1609
+ 0.4392266273498535,
1610
+ 0.30724942684173584,
1611
+ 0.418581485748291,
1612
+ 0.16794516146183014,
1613
+ 0.2559027373790741,
1614
+ 0.3641643524169922,
1615
+ 0.39755815267562866,
1616
+ 0.44880539178848267,
1617
+ 0.4632223844528198,
1618
+ 0.5095025897026062,
1619
+ 0.3525082468986511,
1620
+ 0.3022996187210083,
1621
+ 0.19880110025405884,
1622
+ 0.3091316819190979,
1623
+ 0.263323038816452,
1624
+ 0.17845961451530457,
1625
+ 0.6483509540557861,
1626
+ 0.20565475523471832,
1627
+ 0.5344370007514954,
1628
+ 0.43359625339508057,
1629
+ 0.2034289836883545,
1630
+ 0.41690224409103394,
1631
+ 0.2620161771774292,
1632
+ 0.5064694881439209,
1633
+ 0.29657232761383057,
1634
+ 0.32318365573883057,
1635
+ 0.13946309685707092,
1636
+ 0.751039981842041,
1637
+ 0.1487756222486496,
1638
+ 0.061566270887851715,
1639
+ 0.2640841007232666,
1640
+ 0.43634408712387085,
1641
+ 0.31977909803390503,
1642
+ 0.4964219331741333,
1643
+ 0.2495475709438324,
1644
+ 0.31022244691848755,
1645
+ 0.9284729361534119,
1646
+ 0.26133161783218384,
1647
+ 0.9793201088905334,
1648
+ 0.41793322563171387,
1649
+ 0.41848093271255493,
1650
+ 0.39111602306365967,
1651
+ 0.27977991104125977,
1652
+ 0.3446913957595825,
1653
+ 0.3273438811302185,
1654
+ 0.3225451707839966,
1655
+ 0.15449512004852295,
1656
+ 0.21155938506126404,
1657
+ 0.31115323305130005,
1658
+ 0.4000909924507141,
1659
+ 0.34078389406204224,
1660
+ 0.3573261499404907,
1661
+ 0.2141125500202179,
1662
+ 0.5839141011238098,
1663
+ 0.179031640291214,
1664
+ 0.24155932664871216,
1665
+ 0.1470980942249298,
1666
+ 0.12311697006225586,
1667
+ 0.4463430643081665,
1668
+ 0.2883223295211792,
1669
+ 0.3720155954360962,
1670
+ 0.27604174613952637,
1671
+ 0.3272804021835327,
1672
+ 0.3417864441871643,
1673
+ 0.7284210324287415,
1674
+ 0.2282177209854126,
1675
+ 0.23752710223197937,
1676
+ 0.22179722785949707,
1677
+ 0.5717346668243408,
1678
+ 0.3015969395637512,
1679
+ 0.37254956364631653,
1680
+ 0.1354735791683197,
1681
+ 0.2265818566083908,
1682
+ 0.5100022554397583,
1683
+ 0.2072124183177948,
1684
+ 0.3387289345264435,
1685
+ 0.39584124088287354,
1686
+ 0.3462802469730377,
1687
+ 0.3386557996273041,
1688
+ 0.501550555229187,
1689
+ 0.3861711025238037,
1690
+ 0.37062501907348633,
1691
+ 0.39032042026519775,
1692
+ 0.6218177080154419,
1693
+ 0.35594645142555237,
1694
+ 0.5326514840126038,
1695
+ 0.32794398069381714,
1696
+ 0.2664380669593811,
1697
+ 0.20840829610824585,
1698
+ 0.18534141778945923,
1699
+ 0.38069862127304077,
1700
+ 0.20427393913269043,
1701
+ 0.13505414128303528,
1702
+ 0.12088962644338608,
1703
+ 0.3515492081642151,
1704
+ 0.38260966539382935,
1705
+ 0.3132553696632385,
1706
+ 0.026812486350536346,
1707
+ 0.6413396000862122,
1708
+ 0.3071363568305969,
1709
+ 0.3166496753692627,
1710
+ 0.15920419991016388,
1711
+ 0.4208674430847168,
1712
+ 0.5536258816719055,
1713
+ 0.31533628702163696,
1714
+ 0.20038773119449615,
1715
+ 0.2209150791168213,
1716
+ 0.43876510858535767,
1717
+ 0.8024213910102844,
1718
+ 0.40462034940719604,
1719
+ 0.16512292623519897,
1720
+ 0.15494275093078613,
1721
+ 0.10029444098472595,
1722
+ 0.163703054189682,
1723
+ 0.4818999171257019,
1724
+ 0.24822288751602173,
1725
+ 0.2552396059036255,
1726
+ 0.6045325994491577,
1727
+ 0.27235379815101624,
1728
+ 0.2792242765426636,
1729
+ 0.3569122552871704,
1730
+ 0.1584474891424179,
1731
+ 0.14483362436294556,
1732
+ 0.27828776836395264,
1733
+ 0.1528555154800415,
1734
+ 0.4269724488258362,
1735
+ 0.28875207901000977,
1736
+ 0.24801132082939148,
1737
+ 0.36021873354911804,
1738
+ 0.4793316721916199,
1739
+ 0.3009687662124634,
1740
+ 0.5587811470031738,
1741
+ 0.43544095754623413,
1742
+ 0.46438515186309814,
1743
+ 0.1440868377685547,
1744
+ 0.42357337474823,
1745
+ 0.2686329185962677,
1746
+ 0.1987174153327942,
1747
+ 0.42917758226394653,
1748
+ 0.434037446975708,
1749
+ 0.21991324424743652,
1750
+ 0.17134617269039154,
1751
+ 0.13323715329170227,
1752
+ 0.41677695512771606,
1753
+ 0.3392595052719116,
1754
+ 0.4235093593597412,
1755
+ 0.2486376315355301,
1756
+ 0.3543441891670227,
1757
+ 0.4949961304664612,
1758
+ 0.38185566663742065,
1759
+ 0.3158113956451416,
1760
+ 0.23009862005710602,
1761
+ 0.41412031650543213,
1762
+ 0.28724396228790283,
1763
+ 0.17134849727153778,
1764
+ 0.42997974157333374,
1765
+ 0.13430756330490112,
1766
+ 0.36990129947662354,
1767
+ 0.33371639251708984,
1768
+ 0.643584132194519,
1769
+ 0.3273468017578125,
1770
+ 0.31595802307128906,
1771
+ 0.16766396164894104,
1772
+ 0.04775764048099518,
1773
+ 0.28098660707473755,
1774
+ 0.27432048320770264,
1775
+ 0.4796823263168335,
1776
+ 0.6336914300918579,
1777
+ 0.301901638507843,
1778
+ 0.37659454345703125,
1779
+ 0.5237200260162354,
1780
+ 0.6176414489746094,
1781
+ 0.5643953680992126,
1782
+ 0.16768378019332886,
1783
+ 0.2993028163909912,
1784
+ 0.4654466509819031,
1785
+ 0.2881702780723572,
1786
+ 0.3830717206001282,
1787
+ 0.25480151176452637,
1788
+ 0.3826320171356201,
1789
+ 0.5464175939559937,
1790
+ 0.3758890628814697,
1791
+ 0.4322022795677185,
1792
+ 0.24884964525699615,
1793
+ 0.39493927359580994,
1794
+ 0.19967010617256165,
1795
+ 0.3105267286300659,
1796
+ 0.38723132014274597,
1797
+ 0.2801528573036194,
1798
+ 0.16250118613243103,
1799
+ 0.1873183697462082,
1800
+ 0.22216960787773132,
1801
+ 0.16145847737789154,
1802
+ 0.1630011796951294,
1803
+ 0.1944826990365982,
1804
+ 0.19181402027606964,
1805
+ 0.30207931995391846,
1806
+ 0.2804562449455261,
1807
+ 0.2870512008666992,
1808
+ 0.4683293104171753,
1809
+ 0.14533913135528564,
1810
+ 0.38324809074401855,
1811
+ 0.2574687600135803,
1812
+ 0.8186553716659546,
1813
+ 0.20270448923110962,
1814
+ 0.4897364377975464,
1815
+ 0.9975264668464661,
1816
+ 0.24304533004760742,
1817
+ 0.20117413997650146,
1818
+ 0.418329119682312,
1819
+ 0.4002993702888489,
1820
+ 0.2648599147796631,
1821
+ 0.32378095388412476,
1822
+ 0.442685067653656,
1823
+ 0.4793627858161926,
1824
+ 0.2722182869911194,
1825
+ 0.49554330110549927,
1826
+ 0.6756988167762756,
1827
+ 0.6040368676185608,
1828
+ 0.6697176098823547,
1829
+ 0.5115793347358704,
1830
+ 0.08786167204380035,
1831
+ 0.30904698371887207,
1832
+ 0.24416571855545044,
1833
+ 0.10892205685377121,
1834
+ 0.5413119196891785,
1835
+ 0.3963325619697571,
1836
+ 0.5469846725463867,
1837
+ 0.47715115547180176,
1838
+ 0.32498568296432495,
1839
+ 0.47872328758239746,
1840
+ 0.3791181445121765,
1841
+ 0.2923842668533325,
1842
+ 0.44765472412109375,
1843
+ 0.42669230699539185,
1844
+ 0.3011046350002289,
1845
+ 0.2991647720336914,
1846
+ 0.24045826494693756,
1847
+ 0.27256447076797485,
1848
+ 0.37084367871284485,
1849
+ 0.3915866017341614,
1850
+ 0.6110426187515259,
1851
+ 0.29892486333847046,
1852
+ 0.10691642016172409,
1853
+ 0.3483925461769104,
1854
+ 0.35023799538612366,
1855
+ 0.33639052510261536,
1856
+ 0.22369384765625,
1857
+ 0.41992634534835815,
1858
+ 0.2706969380378723,
1859
+ 0.25868740677833557,
1860
+ 0.32401734590530396,
1861
+ 0.4351562261581421,
1862
+ 0.48425567150115967,
1863
+ 0.3703954219818115,
1864
+ 0.5660136938095093,
1865
+ 0.41490602493286133,
1866
+ 0.41560059785842896,
1867
+ 0.36883673071861267,
1868
+ 0.1863842010498047,
1869
+ 0.3027855157852173,
1870
+ 0.1583172231912613,
1871
+ 0.2997119426727295,
1872
+ 0.32507842779159546,
1873
+ 0.267229288816452,
1874
+ 0.46738189458847046,
1875
+ 0.32795077562332153,
1876
+ 0.3708541989326477,
1877
+ 0.5199525952339172,
1878
+ 0.47665536403656006,
1879
+ 0.13031435012817383,
1880
+ 0.24424311518669128,
1881
+ 0.2390216886997223,
1882
+ 0.5103727579116821,
1883
+ 0.5077297687530518,
1884
+ 0.9165260195732117,
1885
+ 0.3336856961250305,
1886
+ 0.6279894709587097,
1887
+ 0.14471884071826935,
1888
+ 0.4263496398925781,
1889
+ 0.4146016240119934,
1890
+ 0.2631964385509491,
1891
+ 0.5414209961891174,
1892
+ 0.3559309244155884,
1893
+ 0.7141578793525696,
1894
+ 0.29874733090400696,
1895
+ 0.29945623874664307,
1896
+ 0.5699864029884338,
1897
+ 0.2289663553237915,
1898
+ 0.1808827519416809,
1899
+ 0.45755481719970703,
1900
+ 0.3757168650627136,
1901
+ 0.441692054271698,
1902
+ 0.2605747878551483,
1903
+ 0.08060600608587265,
1904
+ 0.2258436381816864,
1905
+ 0.382564902305603,
1906
+ 0.29252833127975464,
1907
+ 0.2841961979866028,
1908
+ 0.35276103019714355,
1909
+ 0.35424184799194336,
1910
+ 0.3243803381919861,
1911
+ 0.18680956959724426,
1912
+ 0.2978026270866394,
1913
+ 0.4442984461784363,
1914
+ 0.5909906029701233,
1915
+ 0.21592989563941956,
1916
+ 0.24077299237251282,
1917
+ 0.4011818766593933,
1918
+ 0.2436375916004181,
1919
+ 0.49852824211120605,
1920
+ 0.32131147384643555,
1921
+ 0.275021493434906,
1922
+ 0.4052860736846924,
1923
+ 0.6339588165283203,
1924
+ 0.22872041165828705,
1925
+ 0.19846314191818237,
1926
+ 0.1487300544977188,
1927
+ 0.9561281800270081,
1928
+ 0.9561281800270081,
1929
+ 0.2754093408584595,
1930
+ 0.33077675104141235,
1931
+ 0.39274296164512634,
1932
+ 0.3063544034957886,
1933
+ 0.15269678831100464,
1934
+ 0.26155057549476624,
1935
+ 0.1569209098815918,
1936
+ 0.23915410041809082,
1937
+ 0.2789385914802551,
1938
+ 0.345787912607193,
1939
+ 0.35746413469314575,
1940
+ 0.18558713793754578,
1941
+ 0.20908096432685852,
1942
+ 0.3722984194755554,
1943
+ 0.25084996223449707,
1944
+ 0.14523902535438538,
1945
+ 0.17596189677715302,
1946
+ 0.2063702791929245,
1947
+ 0.2809433341026306,
1948
+ 0.3693138659000397,
1949
+ 0.4885403513908386,
1950
+ 0.3700857162475586,
1951
+ 0.27503204345703125,
1952
+ 0.5800849199295044,
1953
+ 0.40381497144699097,
1954
+ 0.4608452320098877,
1955
+ 0.2866172790527344,
1956
+ 0.18894220888614655,
1957
+ 0.6760349273681641,
1958
+ 0.5772922039031982,
1959
+ 0.33307981491088867,
1960
+ 0.4574565887451172,
1961
+ 0.4497157335281372,
1962
+ 0.4459855556488037,
1963
+ 0.3302180767059326,
1964
+ 0.17841392755508423,
1965
+ 0.4883791208267212,
1966
+ 0.4510107636451721,
1967
+ 0.45722758769989014,
1968
+ 0.6068794131278992,
1969
+ 0.2992163896560669,
1970
+ 0.42349523305892944,
1971
+ 0.12246181070804596,
1972
+ 0.3173815608024597,
1973
+ 0.38224977254867554,
1974
+ 0.22890208661556244,
1975
+ 0.09349389374256134,
1976
+ 0.29671114683151245,
1977
+ 0.22745195031166077,
1978
+ 0.40383315086364746,
1979
+ 0.2793329954147339,
1980
+ 0.4944598078727722,
1981
+ 0.24750328063964844,
1982
+ 0.2859041094779968,
1983
+ 0.9959097504615784,
1984
+ 0.5098541975021362,
1985
+ 0.4126847982406616,
1986
+ 0.3782691955566406,
1987
+ 0.3147711753845215,
1988
+ 0.3002665042877197,
1989
+ 0.8325471878051758,
1990
+ 0.41716545820236206,
1991
+ 0.7038976550102234,
1992
+ 0.4224214553833008,
1993
+ 0.16579669713974,
1994
+ 0.31152981519699097,
1995
+ 0.3226949870586395,
1996
+ 0.2693096995353699,
1997
+ 0.3760971426963806,
1998
+ 0.4089033007621765,
1999
+ 0.5643961429595947,
2000
+ 0.37888824939727783,
2001
+ 0.5011652112007141,
2002
+ 0.3059420585632324,
2003
+ 0.15367472171783447,
2004
+ 0.5861241817474365,
2005
+ 0.5262241959571838,
2006
+ 0.5836964845657349,
2007
+ 0.49529922008514404,
2008
+ 0.4222950339317322,
2009
+ 0.22828927636146545,
2010
+ 0.47503411769866943,
2011
+ 0.17774233222007751,
2012
+ 0.27386611700057983,
2013
+ 0.324648380279541,
2014
+ 0.2535662055015564,
2015
+ 0.4929965138435364,
2016
+ 0.5326570272445679,
2017
+ 0.24939700961112976,
2018
+ 0.2425505667924881,
2019
+ 0.31571656465530396,
2020
+ 0.3362167477607727,
2021
+ 0.36941611766815186,
2022
+ 0.1844199001789093,
2023
+ 0.3289281129837036,
2024
+ 0.189142107963562,
2025
+ 0.9586355090141296,
2026
+ 0.22324320673942566,
2027
+ 0.3042210340499878,
2028
+ 0.367744505405426,
2029
+ 0.1981024146080017,
2030
+ 0.9576056599617004,
2031
+ 0.4298545718193054,
2032
+ 0.2710292339324951,
2033
+ 0.293000727891922,
2034
+ 0.22504544258117676,
2035
+ 0.33821600675582886,
2036
+ 0.32563889026641846,
2037
+ 0.15452851355075836,
2038
+ 0.40865975618362427,
2039
+ 0.3044937252998352,
2040
+ 0.4548206329345703,
2041
+ 0.20198938250541687,
2042
+ 0.4248458743095398,
2043
+ 0.3748558759689331,
2044
+ 0.46811848878860474,
2045
+ 0.41357362270355225,
2046
+ 0.2166193425655365,
2047
+ 0.5522064566612244,
2048
+ 0.3151811361312866,
2049
+ 0.3602834939956665,
2050
+ 0.1637401282787323,
2051
+ 0.6177550554275513,
2052
+ 0.25915294885635376,
2053
+ 0.3395835757255554,
2054
+ 0.2267143279314041,
2055
+ 0.35085147619247437,
2056
+ 0.32732290029525757,
2057
+ 0.4016134738922119,
2058
+ 0.21079644560813904,
2059
+ 0.26774030923843384,
2060
+ 0.6028376221656799,
2061
+ 0.30858537554740906,
2062
+ 0.1326010525226593,
2063
+ 0.12597426772117615,
2064
+ 0.13915884494781494,
2065
+ 0.4535362124443054,
2066
+ 0.4807435870170593,
2067
+ 0.2532738447189331,
2068
+ 0.23038321733474731,
2069
+ 0.6805618405342102,
2070
+ 0.30040353536605835,
2071
+ 0.24269059300422668,
2072
+ 0.27728015184402466,
2073
+ 0.37186962366104126,
2074
+ 0.29836541414260864,
2075
+ 0.2322462648153305,
2076
+ 0.28989434242248535,
2077
+ 0.5795897841453552,
2078
+ 0.2844027876853943,
2079
+ 0.3675328493118286,
2080
+ 0.16897597908973694,
2081
+ 0.2695307433605194,
2082
+ 0.47841358184814453,
2083
+ 0.5163059830665588,
2084
+ 0.3067386746406555,
2085
+ 0.3266086280345917,
2086
+ 0.35149115324020386,
2087
+ 0.2205183207988739,
2088
+ 0.28156810998916626,
2089
+ 0.2027767151594162,
2090
+ 0.41196364164352417,
2091
+ 0.2678453326225281,
2092
+ 0.4018690586090088,
2093
+ 0.3230070471763611,
2094
+ 0.22726398706436157,
2095
+ 0.42327433824539185,
2096
+ 0.37247610092163086,
2097
+ 0.25173085927963257,
2098
+ 0.5431699156761169,
2099
+ 0.23920229077339172,
2100
+ 0.2779812812805176,
2101
+ 0.37460893392562866,
2102
+ 0.1344088315963745,
2103
+ 0.34734174609184265,
2104
+ 0.35019344091415405,
2105
+ 0.3588030934333801,
2106
+ 0.5564910173416138,
2107
+ 0.2492772936820984,
2108
+ 0.2985246777534485,
2109
+ 0.284429669380188,
2110
+ 0.3493920564651489,
2111
+ 0.29090696573257446,
2112
+ 0.42251724004745483,
2113
+ 0.2794559597969055,
2114
+ 0.170749694108963,
2115
+ 0.40398359298706055,
2116
+ 0.20525740087032318,
2117
+ 0.4757511615753174,
2118
+ 0.04686611890792847,
2119
+ 0.2387615144252777,
2120
+ 0.3329697251319885,
2121
+ 0.6226479411125183,
2122
+ 0.4261521100997925,
2123
+ 0.36508989334106445,
2124
+ 0.4880523085594177,
2125
+ 0.37859785556793213,
2126
+ 0.34055590629577637,
2127
+ 0.3696131110191345,
2128
+ 0.3642317056655884,
2129
+ 0.7361894249916077,
2130
+ 0.38977158069610596,
2131
+ 0.3862968683242798,
2132
+ 0.15090098977088928,
2133
+ 0.10802815854549408,
2134
+ 0.17443853616714478,
2135
+ 0.26646268367767334,
2136
+ 0.2740206718444824,
2137
+ 0.048578254878520966,
2138
+ 0.18615013360977173,
2139
+ 0.3475911617279053,
2140
+ 0.2967173457145691,
2141
+ 0.3721640110015869,
2142
+ 0.2132396399974823,
2143
+ 0.5767388939857483,
2144
+ 0.2773744463920593,
2145
+ 0.38559871912002563,
2146
+ 0.38663339614868164,
2147
+ 0.2604362964630127,
2148
+ 0.2353227585554123,
2149
+ 0.4142613410949707,
2150
+ 0.17307351529598236,
2151
+ 0.3657285273075104,
2152
+ 0.4270501732826233,
2153
+ 0.34396082162857056,
2154
+ 0.3858642876148224,
2155
+ 0.32674330472946167,
2156
+ 0.5709230899810791,
2157
+ 0.2120693325996399,
2158
+ 0.25715941190719604,
2159
+ 0.3737916946411133,
2160
+ 0.33014363050460815,
2161
+ 0.305095911026001,
2162
+ 0.21683478355407715,
2163
+ 0.1043572798371315,
2164
+ 0.20355463027954102,
2165
+ 0.3104320764541626,
2166
+ 0.3401314616203308,
2167
+ 0.22295476496219635,
2168
+ 0.5458728075027466,
2169
+ 0.27365121245384216,
2170
+ 0.41523849964141846,
2171
+ 0.45092475414276123,
2172
+ 0.4386019706726074,
2173
+ 0.4031687378883362,
2174
+ 0.3556019067764282,
2175
+ 0.5094522833824158,
2176
+ 0.1989077925682068,
2177
+ 0.5155375599861145,
2178
+ 0.4024355411529541,
2179
+ 0.4096806049346924,
2180
+ 0.2633684575557709,
2181
+ 0.3900706171989441,
2182
+ 0.24407479166984558,
2183
+ 0.6328014731407166,
2184
+ 0.25679364800453186,
2185
+ 0.5741458535194397,
2186
+ 0.4572334289550781,
2187
+ 0.4205678701400757,
2188
+ 0.3684993088245392,
2189
+ 0.2118007093667984,
2190
+ 0.14811113476753235,
2191
+ 0.27541056275367737,
2192
+ 0.12442032992839813,
2193
+ 0.30652308464050293,
2194
+ 0.12759020924568176,
2195
+ 0.25970423221588135,
2196
+ 0.3592929244041443,
2197
+ 0.6589033007621765,
2198
+ 0.33458054065704346,
2199
+ 0.27742916345596313,
2200
+ 0.4817577600479126,
2201
+ 0.250373899936676,
2202
+ 0.27479708194732666,
2203
+ 0.3355017304420471,
2204
+ 0.405734121799469,
2205
+ 0.31063902378082275,
2206
+ 0.6792960166931152,
2207
+ 0.29124563932418823,
2208
+ 0.385661244392395,
2209
+ 0.28983861207962036,
2210
+ 0.5009194016456604,
2211
+ 0.3743610382080078,
2212
+ 0.46336519718170166,
2213
+ 0.5352038145065308,
2214
+ 0.39070558547973633,
2215
+ 0.3296164274215698,
2216
+ 0.27088063955307007,
2217
+ 0.42516547441482544,
2218
+ 0.3455773591995239,
2219
+ 0.19947439432144165,
2220
+ 0.3062378466129303,
2221
+ 0.24062883853912354,
2222
+ 0.2589550316333771,
2223
+ 0.3063831627368927,
2224
+ 0.3434374928474426,
2225
+ 0.2834553122520447,
2226
+ 0.2506602704524994,
2227
+ 0.2601316571235657,
2228
+ 0.2560321092605591,
2229
+ 0.4851294159889221,
2230
+ 0.21075128018856049,
2231
+ 0.47131556272506714,
2232
+ 0.31203901767730713,
2233
+ 0.3571832776069641,
2234
+ 0.6401399374008179,
2235
+ 0.4049288034439087,
2236
+ 0.4304351806640625,
2237
+ 0.1647861897945404,
2238
+ 0.501714289188385,
2239
+ 0.4064439535140991,
2240
+ 0.207471564412117,
2241
+ 0.27068910002708435,
2242
+ 0.23117592930793762,
2243
+ 0.4627343416213989,
2244
+ 0.2971228361129761,
2245
+ 0.12056674808263779,
2246
+ 0.25139907002449036,
2247
+ 0.24077117443084717,
2248
+ 0.5678431391716003,
2249
+ 0.4644537568092346,
2250
+ 0.35522356629371643,
2251
+ 0.6408394575119019,
2252
+ 0.15940746665000916,
2253
+ 0.32192927598953247,
2254
+ 0.192094087600708,
2255
+ 0.0729513093829155,
2256
+ 0.26903653144836426,
2257
+ 0.32623451948165894,
2258
+ 0.36211055517196655,
2259
+ 0.5715131759643555,
2260
+ 0.60673987865448,
2261
+ 0.28619658946990967,
2262
+ 0.2499246448278427,
2263
+ 0.31604886054992676,
2264
+ 0.5832399129867554,
2265
+ 0.7021030187606812,
2266
+ 0.10591185092926025,
2267
+ 0.12707458436489105,
2268
+ 0.19236493110656738,
2269
+ 0.38305479288101196,
2270
+ 0.751314103603363,
2271
+ 0.23269504308700562,
2272
+ 0.38739222288131714,
2273
+ 0.19287465512752533,
2274
+ 0.11854402720928192,
2275
+ 0.3522067368030548,
2276
+ 0.2386971116065979,
2277
+ 0.19612407684326172,
2278
+ 0.33102527260780334,
2279
+ 0.4649626612663269,
2280
+ 0.305294930934906,
2281
+ 0.27118971943855286,
2282
+ 0.29177576303482056,
2283
+ 0.20573697984218597,
2284
+ 0.2982982397079468,
2285
+ 0.14779211580753326,
2286
+ 0.36586490273475647,
2287
+ 0.20747140049934387,
2288
+ 0.23704814910888672,
2289
+ 0.2144353687763214,
2290
+ 0.4016779065132141,
2291
+ 0.43159180879592896,
2292
+ 0.5283148884773254,
2293
+ 0.47217857837677,
2294
+ 0.12578144669532776,
2295
+ 0.33137047290802,
2296
+ 0.260610431432724,
2297
+ 0.33487600088119507,
2298
+ 0.5057029724121094,
2299
+ 0.49050092697143555,
2300
+ 0.615914523601532,
2301
+ 0.12537932395935059,
2302
+ 0.2543557584285736,
2303
+ 0.4360615611076355,
2304
+ 0.47854387760162354,
2305
+ 0.5539455413818359,
2306
+ 0.17739591002464294,
2307
+ 0.31046032905578613,
2308
+ 0.97746342420578,
2309
+ 0.35539621114730835,
2310
+ 0.19885827600955963,
2311
+ 0.4113251566886902,
2312
+ 0.7084124088287354,
2313
+ 0.4289645552635193,
2314
+ 0.46192002296447754,
2315
+ 0.3380053639411926,
2316
+ 0.3313348889350891,
2317
+ 0.4319590926170349,
2318
+ 0.3443852961063385,
2319
+ 0.31291377544403076,
2320
+ 0.524448573589325,
2321
+ 0.5357584953308105,
2322
+ 0.518883466720581,
2323
+ 0.9629720449447632,
2324
+ 0.19095084071159363,
2325
+ 0.4200805425643921,
2326
+ 0.4954833984375,
2327
+ 0.30780357122421265,
2328
+ 0.3626630902290344,
2329
+ 0.15729019045829773,
2330
+ 0.302656888961792,
2331
+ 0.21127434074878693,
2332
+ 0.3294352889060974,
2333
+ 0.13292700052261353,
2334
+ 0.3030763864517212,
2335
+ 0.38459110260009766,
2336
+ 0.16559623181819916,
2337
+ 0.3038738965988159,
2338
+ 0.36487939953804016,
2339
+ 0.1467410922050476,
2340
+ 0.13461703062057495,
2341
+ 0.15213726460933685,
2342
+ 0.42037487030029297,
2343
+ 0.31136149168014526,
2344
+ 0.5108473896980286,
2345
+ 0.46140778064727783,
2346
+ 0.971902072429657,
2347
+ 0.5181849598884583,
2348
+ 0.34421324729919434,
2349
+ 0.18335452675819397,
2350
+ 0.14560621976852417,
2351
+ 0.23997122049331665,
2352
+ 0.4141652584075928,
2353
+ 0.2723880708217621,
2354
+ 0.2827272415161133,
2355
+ 0.19484180212020874,
2356
+ 0.4289565086364746,
2357
+ 0.31569814682006836,
2358
+ 0.17378178238868713,
2359
+ 0.3774661719799042,
2360
+ 0.4314199686050415,
2361
+ 0.2172507345676422,
2362
+ 0.21941620111465454,
2363
+ 0.4634551405906677,
2364
+ 0.1697937697172165,
2365
+ 0.24997559189796448,
2366
+ 0.45846253633499146,
2367
+ 0.367794930934906,
2368
+ 0.5159041881561279,
2369
+ 0.2742500901222229,
2370
+ 0.4237251877784729,
2371
+ 0.48669201135635376,
2372
+ 0.3033245801925659,
2373
+ 0.20117855072021484,
2374
+ 0.3613760471343994,
2375
+ 0.06764610856771469,
2376
+ 0.4064862132072449,
2377
+ 0.17111322283744812,
2378
+ 0.44077831506729126,
2379
+ 0.7805458307266235,
2380
+ 0.1771109253168106,
2381
+ 0.39541149139404297,
2382
+ 0.014588728547096252,
2383
+ 0.5649234652519226,
2384
+ 0.6826850771903992,
2385
+ 0.5549535751342773,
2386
+ 0.4870874285697937,
2387
+ 0.2321130633354187,
2388
+ 0.4668780565261841,
2389
+ 0.30050843954086304,
2390
+ 0.3837704658508301,
2391
+ 0.317946195602417,
2392
+ 0.2583268880844116,
2393
+ 0.2854509949684143,
2394
+ 0.25754594802856445,
2395
+ 0.3387256860733032,
2396
+ 0.3762566149234772,
2397
+ 0.38481417298316956,
2398
+ 0.5109022855758667,
2399
+ 0.19468477368354797,
2400
+ 0.2886573374271393,
2401
+ 0.35347980260849,
2402
+ 0.13641436398029327,
2403
+ 0.44518524408340454,
2404
+ 0.4543163776397705,
2405
+ 0.43655216693878174,
2406
+ 0.34987884759902954,
2407
+ 0.27687275409698486,
2408
+ 0.5738657116889954,
2409
+ 0.14506950974464417,
2410
+ 0.22592079639434814,
2411
+ 0.3409305214881897,
2412
+ 0.15319865942001343,
2413
+ 0.04841620475053787,
2414
+ 0.14899033308029175,
2415
+ 0.3965821862220764,
2416
+ 0.23228719830513,
2417
+ 0.22543293237686157,
2418
+ 0.19695666432380676,
2419
+ 0.2407928705215454,
2420
+ 0.3222924768924713,
2421
+ 0.33024173974990845,
2422
+ 0.23976489901542664,
2423
+ 0.44134068489074707,
2424
+ 0.36229681968688965,
2425
+ 0.2880108952522278,
2426
+ 0.38563841581344604,
2427
+ 0.23482999205589294,
2428
+ 0.43462514877319336,
2429
+ 0.2926025986671448,
2430
+ 0.22516149282455444,
2431
+ 0.04641364514827728,
2432
+ 0.37330442667007446,
2433
+ 0.4089277982711792,
2434
+ 0.41232985258102417,
2435
+ 0.32403743267059326,
2436
+ 0.2883874177932739,
2437
+ 0.16435852646827698,
2438
+ 0.45361006259918213,
2439
+ 0.197145015001297,
2440
+ 0.254222571849823,
2441
+ 0.27587294578552246,
2442
+ 0.3588945269584656,
2443
+ 0.5698840618133545,
2444
+ 0.3829926550388336,
2445
+ 0.14814242720603943,
2446
+ 0.5488428473472595,
2447
+ 0.35156506299972534,
2448
+ 0.29566285014152527,
2449
+ 0.530342161655426,
2450
+ 0.2836790084838867,
2451
+ 0.3422397971153259,
2452
+ 0.11774460226297379,
2453
+ 0.12989185750484467,
2454
+ 0.2666969299316406,
2455
+ 0.23422309756278992,
2456
+ 0.2666969299316406,
2457
+ 0.17270565032958984,
2458
+ 0.3139147162437439,
2459
+ 0.2566800117492676,
2460
+ 0.39590299129486084,
2461
+ 0.14916343986988068,
2462
+ 0.3937944173812866,
2463
+ 0.10971194505691528,
2464
+ 0.5105543732643127,
2465
+ 0.28745996952056885,
2466
+ 0.32399171590805054,
2467
+ 0.23372618854045868,
2468
+ 0.35758429765701294,
2469
+ 0.2870113253593445,
2470
+ 0.44646674394607544,
2471
+ 0.26088058948516846,
2472
+ 0.4123035669326782,
2473
+ 0.3737780451774597,
2474
+ 0.3568844795227051,
2475
+ 0.520277202129364,
2476
+ 0.17301467061042786,
2477
+ 0.18142279982566833,
2478
+ 0.40305185317993164,
2479
+ 0.477230429649353,
2480
+ 0.36509793996810913,
2481
+ 0.48417389392852783,
2482
+ 0.4707394242286682,
2483
+ 0.22322486340999603,
2484
+ 0.24357682466506958,
2485
+ 0.3688027262687683,
2486
+ 0.37018245458602905,
2487
+ 0.27727842330932617,
2488
+ 0.18555717170238495,
2489
+ 0.5377994775772095,
2490
+ 0.34165820479393005,
2491
+ 0.4493049383163452,
2492
+ 0.2550983130931854,
2493
+ 0.38018831610679626,
2494
+ 0.29202431440353394,
2495
+ 0.37253421545028687,
2496
+ 0.5435947775840759,
2497
+ 0.2786654829978943,
2498
+ 0.2502869665622711,
2499
+ 0.276606023311615,
2500
+ 0.44220221042633057,
2501
+ 0.5823413729667664,
2502
+ 0.27265146374702454,
2503
+ 0.551282525062561,
2504
+ 0.3318744897842407,
2505
+ 0.3727349042892456,
2506
+ 0.2100786417722702,
2507
+ 0.35811758041381836,
2508
+ 0.2236061543226242,
2509
+ 0.5863979458808899,
2510
+ 0.307353138923645,
2511
+ 0.5150916576385498,
2512
+ 0.4421749711036682,
2513
+ 0.13345685601234436,
2514
+ 0.39667269587516785,
2515
+ 0.37742769718170166,
2516
+ 0.8035475611686707,
2517
+ 0.2541375160217285,
2518
+ 0.22689232230186462,
2519
+ 0.18917688727378845,
2520
+ 0.2792342007160187,
2521
+ 0.3994174003601074,
2522
+ 0.3684424161911011,
2523
+ 0.3708357810974121,
2524
+ 0.23767410218715668,
2525
+ 0.12784285843372345,
2526
+ 0.5090121626853943,
2527
+ 0.30463409423828125,
2528
+ 0.3733599781990051,
2529
+ 0.45212846994400024,
2530
+ 0.3975270986557007,
2531
+ 0.15874546766281128,
2532
+ 0.34852659702301025,
2533
+ 0.17419520020484924,
2534
+ 0.6986595988273621,
2535
+ 0.3611244559288025,
2536
+ 0.2385944128036499,
2537
+ 0.4098992347717285,
2538
+ 0.5903702974319458,
2539
+ 0.26244789361953735,
2540
+ 0.21221637725830078,
2541
+ 0.30705171823501587,
2542
+ 0.08493448793888092,
2543
+ 0.24200057983398438,
2544
+ 0.4083824157714844,
2545
+ 0.554352343082428,
2546
+ 0.3776324391365051,
2547
+ 0.1271170675754547,
2548
+ 0.19215120375156403,
2549
+ 0.24667614698410034,
2550
+ 0.1152552142739296,
2551
+ 0.16981595754623413,
2552
+ 0.3830368220806122,
2553
+ 0.2543109357357025,
2554
+ 0.28042811155319214,
2555
+ 0.326987624168396,
2556
+ 0.6979550123214722,
2557
+ 0.18643519282341003,
2558
+ 0.36510616540908813,
2559
+ 0.38668566942214966,
2560
+ 0.24334648251533508,
2561
+ 0.35118377208709717,
2562
+ 0.3261365294456482,
2563
+ 0.5619329214096069,
2564
+ 0.3271966576576233,
2565
+ 0.2991182208061218,
2566
+ 0.1849820613861084,
2567
+ 0.3865392804145813,
2568
+ 0.3941906690597534,
2569
+ 0.17513778805732727,
2570
+ 0.34175270795822144,
2571
+ 0.3629032373428345,
2572
+ 0.5449613928794861,
2573
+ 0.331728994846344,
2574
+ 0.5300742387771606,
2575
+ 0.3690757155418396,
2576
+ 0.18437716364860535,
2577
+ 0.5720081329345703,
2578
+ 0.18949365615844727,
2579
+ 0.1433321237564087,
2580
+ 0.47951740026474,
2581
+ 0.25285500288009644,
2582
+ 0.655626118183136,
2583
+ 0.5863909125328064,
2584
+ 0.4398583769798279,
2585
+ 0.28601956367492676,
2586
+ 0.44232630729675293,
2587
+ 0.3561326265335083,
2588
+ 0.4251353144645691,
2589
+ 0.3545980453491211,
2590
+ 0.5955346822738647,
2591
+ 0.5188190340995789,
2592
+ 0.4389238953590393,
2593
+ 0.22455868124961853,
2594
+ 0.39196616411209106,
2595
+ 0.3490622043609619,
2596
+ 0.4277608394622803,
2597
+ 0.6358280777931213,
2598
+ 0.3663893938064575,
2599
+ 0.21076755225658417,
2600
+ 0.15052959322929382,
2601
+ 0.2130066454410553,
2602
+ 0.4550594687461853,
2603
+ 0.3630082607269287,
2604
+ 0.5110231637954712,
2605
+ 0.42363983392715454,
2606
+ 0.3493176996707916,
2607
+ 0.0892714112997055,
2608
+ 0.08968793600797653,
2609
+ 0.15340128540992737,
2610
+ 0.24283640086650848,
2611
+ 0.21477186679840088,
2612
+ 0.24030256271362305,
2613
+ 0.3130578398704529,
2614
+ 0.1592794954776764,
2615
+ 0.3244561553001404,
2616
+ 0.3114030063152313,
2617
+ 0.7677403092384338,
2618
+ 0.39254188537597656,
2619
+ 0.09742093086242676,
2620
+ 0.24739781022071838,
2621
+ 0.38956934213638306,
2622
+ 0.49340349435806274,
2623
+ 0.14393818378448486,
2624
+ 0.45790743827819824,
2625
+ 0.21982014179229736,
2626
+ 0.4039149284362793,
2627
+ 0.5789116024971008,
2628
+ 0.3404541015625,
2629
+ 0.7609390616416931,
2630
+ 0.3745032548904419,
2631
+ 0.5035704970359802,
2632
+ 0.3622891902923584,
2633
+ 0.14684335887432098,
2634
+ 0.45389896631240845,
2635
+ 0.30350130796432495,
2636
+ 0.47287505865097046,
2637
+ 0.6622453331947327,
2638
+ 0.29906147718429565,
2639
+ 0.36947333812713623,
2640
+ 0.2506316006183624,
2641
+ 0.40420758724212646,
2642
+ 0.17706188559532166,
2643
+ 0.522517204284668,
2644
+ 0.2065688669681549,
2645
+ 0.3693322539329529,
2646
+ 0.14210498332977295,
2647
+ 0.6945989727973938,
2648
+ 0.45111358165740967,
2649
+ 0.16414397954940796,
2650
+ 0.35528039932250977,
2651
+ 0.29418081045150757,
2652
+ 0.197247713804245,
2653
+ 0.12441516667604446,
2654
+ 0.22290515899658203,
2655
+ 0.6688545942306519,
2656
+ 0.3225594758987427,
2657
+ 0.38196441531181335,
2658
+ 0.41393953561782837,
2659
+ 0.42412304878234863,
2660
+ 0.4293750524520874,
2661
+ 0.30617982149124146,
2662
+ 0.5662055015563965,
2663
+ 0.38961541652679443,
2664
+ 0.5680786371231079,
2665
+ 0.15010231733322144,
2666
+ 0.03280085325241089,
2667
+ 0.306742399930954,
2668
+ 0.33447352051734924,
2669
+ 0.18444602191448212,
2670
+ 0.5146055221557617,
2671
+ 0.5020912885665894,
2672
+ 0.3240029215812683,
2673
+ 0.2498515546321869,
2674
+ 0.38517361879348755,
2675
+ 0.27829068899154663,
2676
+ 0.6279187202453613,
2677
+ 0.2579572796821594,
2678
+ 0.4684789180755615,
2679
+ 0.3449459671974182,
2680
+ 0.41781938076019287,
2681
+ 0.538440465927124,
2682
+ 0.3073229193687439,
2683
+ 0.5067185163497925,
2684
+ 0.3614045977592468,
2685
+ 0.3328169584274292,
2686
+ 0.2574375867843628,
2687
+ 0.18266001343727112,
2688
+ 0.6715477705001831,
2689
+ 0.37077492475509644,
2690
+ 0.230765700340271,
2691
+ 0.3440355658531189,
2692
+ 0.16382892429828644,
2693
+ 0.44801610708236694,
2694
+ 0.40337133407592773,
2695
+ 0.2757117748260498,
2696
+ 0.3025977611541748,
2697
+ 0.42203813791275024,
2698
+ 0.5983603000640869,
2699
+ 0.21000009775161743,
2700
+ 0.20606555044651031,
2701
+ 0.29362621903419495,
2702
+ 0.7234587669372559,
2703
+ 0.27960193157196045,
2704
+ 0.24641220271587372,
2705
+ 0.5057991743087769,
2706
+ 0.41846293210983276,
2707
+ 0.3423578143119812,
2708
+ 0.3791889548301697,
2709
+ 0.25708478689193726,
2710
+ 0.0408148318529129,
2711
+ 0.2686532735824585,
2712
+ 0.7660819292068481,
2713
+ 0.21834337711334229,
2714
+ 0.5182897448539734,
2715
+ 0.2574118673801422,
2716
+ 0.1562379151582718,
2717
+ 0.38937628269195557,
2718
+ 0.318825900554657,
2719
+ 0.18021602928638458,
2720
+ 0.3546442985534668,
2721
+ 0.36730802059173584,
2722
+ 0.1658117175102234,
2723
+ 0.32144391536712646,
2724
+ 0.19901952147483826,
2725
+ 0.1387893557548523,
2726
+ 0.6214148998260498,
2727
+ 0.19815385341644287,
2728
+ 0.21709761023521423,
2729
+ 0.5401152968406677,
2730
+ 0.2582310140132904,
2731
+ 0.6353235840797424,
2732
+ 0.2656528353691101,
2733
+ 0.3319984972476959,
2734
+ 0.7241964936256409,
2735
+ 0.342227578163147,
2736
+ 0.33133387565612793,
2737
+ 0.271890789270401,
2738
+ 0.27819496393203735,
2739
+ 0.29510074853897095,
2740
+ 0.28682613372802734,
2741
+ 0.37466496229171753,
2742
+ 0.08894047141075134,
2743
+ 0.19925786554813385,
2744
+ 0.6077919006347656,
2745
+ 0.5046728253364563,
2746
+ 0.5489648580551147,
2747
+ 0.43484997749328613,
2748
+ 0.47633278369903564,
2749
+ 0.10738552361726761,
2750
+ 0.2922872304916382,
2751
+ 0.2897639274597168,
2752
+ 0.19133947789669037,
2753
+ 0.4675660729408264,
2754
+ 0.35845667123794556,
2755
+ 0.22517287731170654,
2756
+ 0.22663486003875732,
2757
+ 0.22951358556747437,
2758
+ 0.40997737646102905,
2759
+ 0.5003045201301575,
2760
+ 0.3858630359172821,
2761
+ 0.30632367730140686,
2762
+ 0.7688657641410828,
2763
+ 0.26010534167289734,
2764
+ 0.35531580448150635,
2765
+ 0.3300017714500427,
2766
+ 0.38525283336639404,
2767
+ 0.20386886596679688,
2768
+ 0.21177753806114197,
2769
+ 0.4115625023841858,
2770
+ 0.22694456577301025,
2771
+ 0.3572969436645508,
2772
+ 0.5478978753089905,
2773
+ 0.25336509943008423,
2774
+ 0.34568488597869873,
2775
+ 0.36338353157043457,
2776
+ 0.3618413805961609,
2777
+ 0.27573275566101074,
2778
+ 0.2242256999015808,
2779
+ 0.38627809286117554,
2780
+ 0.4156342148780823,
2781
+ 0.3269674777984619,
2782
+ 0.4237920045852661,
2783
+ 0.2582945227622986,
2784
+ 0.3399794101715088,
2785
+ 0.4859057068824768,
2786
+ 0.20924782752990723,
2787
+ 0.3204495906829834,
2788
+ 0.3574531078338623,
2789
+ 0.3835052251815796,
2790
+ 0.24971964955329895,
2791
+ 0.38693922758102417,
2792
+ 0.14237822592258453,
2793
+ 0.23384109139442444,
2794
+ 0.33949846029281616,
2795
+ 0.2332436442375183,
2796
+ 0.0920386016368866,
2797
+ 0.36011630296707153,
2798
+ 0.383469820022583,
2799
+ 0.3736904263496399,
2800
+ 0.3348730206489563,
2801
+ 0.4603803753852844,
2802
+ 0.3887738585472107,
2803
+ 0.42340731620788574,
2804
+ 0.4079480767250061,
2805
+ 0.32097476720809937,
2806
+ 0.25959527492523193,
2807
+ 0.31198638677597046,
2808
+ 0.6400268077850342,
2809
+ 0.44859981536865234,
2810
+ 0.3246859312057495,
2811
+ 0.3492182493209839,
2812
+ 0.35618436336517334,
2813
+ 0.3447960615158081,
2814
+ 0.373451828956604,
2815
+ 0.3137490153312683,
2816
+ 0.3120570182800293,
2817
+ 0.36079174280166626,
2818
+ 0.2334616482257843,
2819
+ 0.9561281800270081,
2820
+ 0.43031787872314453,
2821
+ 0.21171413362026215,
2822
+ 0.2817038893699646,
2823
+ 0.1000223159790039,
2824
+ 0.4476829767227173,
2825
+ 0.27649468183517456,
2826
+ 0.4553719162940979,
2827
+ 0.5275933146476746,
2828
+ 0.3337421417236328,
2829
+ 0.09942733496427536,
2830
+ 0.17176316678524017,
2831
+ 0.4167451858520508,
2832
+ 0.3295375406742096,
2833
+ 0.18258731067180634,
2834
+ 0.1664636731147766,
2835
+ 0.44925063848495483,
2836
+ 0.5367451906204224,
2837
+ 0.2948116660118103,
2838
+ 0.3974763751029968,
2839
+ 0.2081802934408188,
2840
+ 0.24067896604537964,
2841
+ 0.40923064947128296,
2842
+ 0.5639544129371643,
2843
+ 0.21123231947422028,
2844
+ 0.36110544204711914,
2845
+ 0.438418447971344,
2846
+ 0.37735825777053833,
2847
+ 0.2829609513282776,
2848
+ 0.1388142704963684,
2849
+ 0.3124813437461853,
2850
+ 0.1524437516927719,
2851
+ 0.3676690459251404,
2852
+ 0.20591828227043152,
2853
+ 0.25753769278526306,
2854
+ 0.2608324885368347,
2855
+ 0.1932099163532257,
2856
+ 0.5985423922538757,
2857
+ 0.39269959926605225,
2858
+ 0.2374192774295807,
2859
+ 0.527224600315094,
2860
+ 0.19704905152320862,
2861
+ 0.7094739675521851,
2862
+ 0.30077064037323,
2863
+ 0.5367882251739502,
2864
+ 0.4287795424461365,
2865
+ 0.45954829454421997,
2866
+ 0.30185645818710327,
2867
+ 0.5872730612754822,
2868
+ 0.4042329788208008,
2869
+ 0.3891414403915405,
2870
+ 0.4487959146499634,
2871
+ 0.49770039319992065,
2872
+ 0.35592585802078247,
2873
+ 0.3432280719280243,
2874
+ 0.4339113235473633,
2875
+ 0.3996248245239258,
2876
+ 0.27974003553390503,
2877
+ 0.6100208759307861,
2878
+ 0.5544992089271545,
2879
+ 0.3034989833831787,
2880
+ 0.2924639582633972,
2881
+ 0.43617016077041626,
2882
+ 0.5280865430831909,
2883
+ 0.5013738870620728,
2884
+ 0.4299888014793396,
2885
+ 0.3779052495956421,
2886
+ 0.2782678008079529,
2887
+ 0.2453375607728958,
2888
+ 0.15585798025131226,
2889
+ 0.281230628490448,
2890
+ 0.0518447682261467,
2891
+ 0.3783407211303711,
2892
+ 0.34170788526535034,
2893
+ 0.33264076709747314,
2894
+ 0.2679407000541687,
2895
+ 0.4386368989944458,
2896
+ 0.4386518597602844,
2897
+ 0.5195254683494568,
2898
+ 0.5574783086776733,
2899
+ 0.3140960931777954,
2900
+ 0.4721033573150635,
2901
+ 0.3371027112007141,
2902
+ 0.3916857838630676,
2903
+ 0.227425217628479,
2904
+ 0.2910259962081909,
2905
+ 0.24559386074543,
2906
+ 0.4980508089065552,
2907
+ 0.2952671945095062,
2908
+ 0.5104830265045166,
2909
+ 0.4417964816093445,
2910
+ 0.14287912845611572,
2911
+ 0.13163688778877258,
2912
+ 0.18939992785453796,
2913
+ 0.3102421164512634,
2914
+ 0.3039275109767914,
2915
+ 0.2850475311279297,
2916
+ 0.28993821144104004,
2917
+ 0.32182127237319946,
2918
+ 0.304445743560791,
2919
+ 0.4041261076927185,
2920
+ 0.3166202902793884,
2921
+ 0.23464617133140564,
2922
+ 0.3999065160751343,
2923
+ 0.2352105975151062,
2924
+ 0.3041864037513733,
2925
+ 0.3343590199947357,
2926
+ 0.4087947607040405,
2927
+ 0.2106611430644989,
2928
+ 0.4511833190917969,
2929
+ 0.36896926164627075,
2930
+ 0.5085629224777222,
2931
+ 0.6301020979881287,
2932
+ 0.5063191652297974,
2933
+ 0.6415024995803833,
2934
+ 0.30827030539512634,
2935
+ 0.31740206480026245,
2936
+ 0.2983371615409851,
2937
+ 0.25350821018218994,
2938
+ 0.2934458553791046,
2939
+ 0.29057371616363525,
2940
+ 0.17765364050865173
2941
+ ]
2942
+ }
results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/config.yaml ADDED
@@ -0,0 +1,187 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ _wandb:
2
+ value:
3
+ cli_version: 0.23.1
4
+ e:
5
+ v9bz95rceb2ik2jjh7p1x585c0emnxfi:
6
+ args:
7
+ - -c
8
+ - configs/finetune_v27_quad_xattn_from_upstream.yaml
9
+ - --ckpt
10
+ - logs/2026-05-03T23-47-30_finetune_v27_quad_xattn/checkpoints/epoch=00010-step=0032461-bleu4=5.40.ckpt
11
+ - -t
12
+ - "False"
13
+ - --test
14
+ - "True"
15
+ - -n
16
+ - test_v27_quad_xattn
17
+ - --tags
18
+ - test
19
+ - pjm-ms
20
+ - quad
21
+ - upstream-init
22
+ codePath: main.py
23
+ codePathLocal: main.py
24
+ cpu_count: 12
25
+ cpu_count_logical: 24
26
+ cudaVersion: "12.8"
27
+ disk:
28
+ /:
29
+ total: "1967317549056"
30
+ used: "1598675161088"
31
+ email: s28855@pjwstk.edu.pl
32
+ executable: /home/croco/SpaMo-PJM/.venv/bin/python
33
+ git:
34
+ commit: 4f11b72511d6fd9692336b6b89e43f98e516e01c
35
+ remote: https://github.com/croco-corp/SpaMo-PJM.git
36
+ gpu: NVIDIA GeForce RTX 3090
37
+ gpu_count: 1
38
+ gpu_nvidia:
39
+ - architecture: Ampere
40
+ cudaCores: 10496
41
+ memoryTotal: "25769803776"
42
+ name: NVIDIA GeForce RTX 3090
43
+ uuid: GPU-5c32b58e-e363-6bec-ff14-3d6044d0ae84
44
+ host: lowca-desktop
45
+ memory:
46
+ total: "64894398464"
47
+ os: Linux-6.8.0-110-generic-x86_64-with-glibc2.39
48
+ program: /home/croco/SpaMo-PJM/main.py
49
+ python: CPython 3.10.19
50
+ root: logs/2026-05-04T09-09-26_test_v27_quad_xattn
51
+ startedAt: "2026-05-04T07:09:31.256917Z"
52
+ writerId: v9bz95rceb2ik2jjh7p1x585c0emnxfi
53
+ m:
54
+ - "1": trainer/global_step
55
+ "6":
56
+ - 3
57
+ "7": []
58
+ - "2": '*'
59
+ "5": 1
60
+ "6":
61
+ - 1
62
+ "7": []
63
+ python_version: 3.10.19
64
+ t:
65
+ "1":
66
+ - 1
67
+ - 9
68
+ - 11
69
+ - 49
70
+ - 71
71
+ - 98
72
+ - 103
73
+ "2":
74
+ - 1
75
+ - 9
76
+ - 11
77
+ - 49
78
+ - 71
79
+ - 98
80
+ - 103
81
+ "3":
82
+ - 7
83
+ - 13
84
+ - 14
85
+ - 15
86
+ - 16
87
+ - 66
88
+ "4": 3.10.19
89
+ "5": 0.23.1
90
+ "6": 4.57.1
91
+ "12": 0.23.1
92
+ "13": linux-x86_64
93
+ alpha:
94
+ value: 1
95
+ aux_input_size:
96
+ value: 2048
97
+ beam_size:
98
+ value: 5
99
+ cache_dir:
100
+ value: /home/croco/.cache/huggingface/hub
101
+ combined_loss:
102
+ value: true
103
+ config_files:
104
+ value:
105
+ - configs/finetune_v27_quad_xattn_from_upstream.yaml
106
+ cross_modal_align:
107
+ value: true
108
+ data:
109
+ value:
110
+ aux_features_path: features/hand_vit_feat_pjm.h5
111
+ batch_size: 2
112
+ device: cuda
113
+ keypoint_features_path: features/mediapipe_feat_pjm.h5
114
+ max_frame_length: 512
115
+ motion_features_path: features/mae_feat_pjm.h5
116
+ multilang_path: features/texts_multilang_pjm.h5
117
+ num_workers: 4
118
+ set_to_test: test
119
+ target_lang: English
120
+ test_split_path: /home/croco/CrocoSign/data/split_test_ms.csv
121
+ texts_path: features/texts_eng.h5
122
+ train_split_path: /home/croco/CrocoSign/data/split_train_ms.csv
123
+ val_split_path: /home/croco/CrocoSign/data/split_val_ms.csv
124
+ visual_features_path: features/vit_feat_pjm.h5
125
+ evaluation:
126
+ value: mse
127
+ frame_sample_rate:
128
+ value: 1
129
+ fusion_dropout:
130
+ value: 0.3
131
+ fusion_lr:
132
+ value: 1e-05
133
+ fusion_mode:
134
+ value: joint
135
+ input_size:
136
+ value: 2048
137
+ inter_hidden:
138
+ value: 768
139
+ keypoint_dim:
140
+ value: 258
141
+ lora_alpha:
142
+ value: 32
143
+ lora_dropout:
144
+ value: 0.1
145
+ lora_r:
146
+ value: 16
147
+ lr:
148
+ value: 0.0001
149
+ lr_patience:
150
+ value: 5
151
+ lr_scheduler_mode:
152
+ value: max
153
+ max_frame_len:
154
+ value: 512
155
+ max_txt_len:
156
+ value: 64
157
+ model_name:
158
+ value: google/flan-t5-xl
159
+ monitor:
160
+ value: val/bleu4
161
+ motion_input_size:
162
+ value: 1024
163
+ new_stream_lr:
164
+ value: 0.0001
165
+ num_in_context:
166
+ value: 3
167
+ prompt:
168
+ value: Translate the given sentence into {}.
169
+ queue_size:
170
+ value: 0
171
+ scheduler_config:
172
+ value:
173
+ params:
174
+ lr_max: 1
175
+ lr_min: 0.1
176
+ lr_start: 0
177
+ max_decay_steps: 30000
178
+ warm_up_steps: 1000
179
+ target: spamo.lr_scheduler.LambdaWarmUpCosineScheduler
180
+ seed:
181
+ value: 0
182
+ tuning_type:
183
+ value: lora
184
+ use_in_context:
185
+ value: true
186
+ warm_up_steps:
187
+ value: 0
results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/output.log ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Restoring states from the checkpoint path at logs/2026-05-03T23-47-30_finetune_v27_quad_xattn/checkpoints/epoch=00010-step=0032461-bleu4=5.40.ckpt
2
+ /home/croco/SpaMo-PJM/.venv/lib/python3.10/site-packages/pytorch_lightning/trainer/call.py:283: Be aware that when using `ckpt_path`, callbacks used to create the checkpoint need to be provided during `Trainer` instantiation. Please add the following callbacks: ["ModelCheckpoint{'monitor': 'val/bleu4', 'mode': 'max', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}", "EarlyStopping{'monitor': 'val/bleu4', 'mode': 'max'}"].
3
+ LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
4
+ Loaded model weights from the checkpoint at logs/2026-05-03T23-47-30_finetune_v27_quad_xattn/checkpoints/epoch=00010-step=0032461-bleu4=5.40.ckpt
5
+ /home/croco/.local/share/uv/python/cpython-3.10.19-linux-x86_64-gnu/lib/python3.10/contextlib.py:103: FutureWarning: `torch.backends.cuda.sdp_kernel()` is deprecated. In the future, this context manager will be removed. Please see `torch.nn.attention.sdpa_kernel()` for the new context manager, with updated signature.
6
+ self.gen = func(*args, **kwds)
7
+ /home/croco/SpaMo-PJM/spamo/t5_slt.py:585: UserWarning: std(): degrees of freedom is <= 0. Correction should be strictly less than the reduction factor (input numel divided by output numel). (Triggered internally at /pytorch/aten/src/ATen/native/ReduceOps.cpp:1857.)
8
+ log_dict[f"{split}/visual_feat_std"] = visual_outputs.mean(1).std(0).mean().item()
9
+
10
+ ===== Validation Examples =====
11
+ Reference: i said, the dog looks down at the frog sitting in the jar.
12
+ Generated: the dog looks into the jar.
13
+ --------------------------------------------------
14
+ Reference: he cried out and fell back.
15
+ Generated: the cat is in the middle of the gutter.
16
+ --------------------------------------------------
17
+ Reference: the child hugs the dog close.
18
+ Generated: he fell asleep, covered himself with a quilt.
19
+ --------------------------------------------------
20
+ Reference: the frog has disappeared and is not coming back.
21
+ Generated: there is no such thing at all.
22
+ --------------------------------------------------
23
+ Reference: the boy searched and put his hand in a burrow underground.
24
+ Generated: the boy looked into the burrow.
25
+ --------------------------------------------------
26
+ Dumped 2935 pairs β†’ logs/2026-05-04T09-09-26_test_v27_quad_xattn/test_outputs.txt
27
+ Logged 2935 translations to W&B test/translations
28
+ Some weights of RobertaModel were not initialized from the model checkpoint at roberta-large and are newly initialized: ['pooler.dense.bias', 'pooler.dense.weight']
29
+ You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
30
+ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
31
+ ┃ Test metric ┃ DataLoader 0 ┃
32
+ ┑━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
33
+ β”‚ test/bertscore_f1 β”‚ 0.8767930865287781 β”‚
34
+ β”‚ test/bleu1 β”‚ 27.903766632080078 β”‚
35
+ β”‚ test/bleu2 β”‚ 13.140559196472168 β”‚
36
+ β”‚ test/bleu3 β”‚ 7.757347106933594 β”‚
37
+ β”‚ test/bleu4 β”‚ 5.059134006500244 β”‚
38
+ β”‚ test/chrf β”‚ 20.937597274780273 β”‚
39
+ β”‚ test/contra_loss β”‚ 0.4464213252067566 β”‚
40
+ β”‚ test/logit_scale β”‚ 116.04837799072266 β”‚
41
+ β”‚ test/rougeL_f1 β”‚ 0.18864305317401886 β”‚
42
+ β”‚ test/rougeL_precision β”‚ 0.2017328441143036 β”‚
43
+ β”‚ test/rougeL_recall β”‚ 0.19402141869068146 β”‚
44
+ β”‚ test/speaker_bleu4_std β”‚ 2.8405442237854004 β”‚
45
+ β”‚ test/visual_feat_std β”‚ nan β”‚
46
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
47
+ Testing ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1468/1468 0:08:18 β€’ 0:00:00 2.64it/s
results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/test_outputs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/2026-05-04T09-09-26_test_v27_quad_xattn/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"test/bleu2":13.140559196472168,"_wandb":{"runtime":512},"_step":2,"test/bertscore_f1":0.8767930865287781,"_runtime":512,"test/translations":{"path":"media/table/test/translations_0_39801b3ce4db33e702c1.table.json","log_mode":"IMMUTABLE","artifact_path":"wandb-client-artifact://1anr600w60w71a5g0oofp930xhc76a60dfgj6ptpqjljkva7ssp0108od2zar38mqq0zrgvamlcd2qe7lpzf24rz091msot6d6sf7haqubwuucmeqnl5wdx9n1xrohpj/test/translations.table.json","size":312304,"ncols":3,"nrows":2935,"_type":"table-file","sha256":"39801b3ce4db33e702c17ae47cdec2540e16611ccefd1840e0db896d605d500f","_latest_artifact_path":"wandb-client-artifact://ry5f31wgcelk3mf9z2rdvqldljmzen1l45gxxguriz66dndqxzcew4vdcuh0k36tz1wxo6gf0hs6m05xds29qcmr7c6pd1eeitx4vwrsxjkwwght3lgbttwtx5l2ilrs:latest/test/translations.table.json"},"test/bleu4":5.059134006500244,"test/rougeL_recall":0.19402141869068146,"epoch":0,"test/chrf":20.937597274780273,"test/bleu3":7.757347106933594,"test/bleu1":27.903766632080078,"test/rougeL_f1":0.18864305317401886,"trainer/global_step":0,"test/per_speaker_metrics":{"path":"media/table/test/per_speaker_metrics_1_b5c8267dd6d964f16493.table.json","nrows":151,"_type":"table-file","log_mode":"IMMUTABLE","_latest_artifact_path":"wandb-client-artifact://7a3w409m04y23jkoa63e3lvrqv6oa483fp1557xep8e7mv3der68xg2njvps8b5p450rsvoz4m8ukf0k38mnkj935a8337ocuth09z213fvv5pjtrabgrxsu9dnt25wx:latest/test/per_speaker_metrics.table.json","artifact_path":"wandb-client-artifact://a03auae5b6y1y106mnxtynpob0u50o1cw76lkk5molj5ptomo6kzh6qkp043e8r8g7g5j4f4xe7pg4bb0d0d7euxndrm6hivpkf4d67e7j2lqzt1ocm527vlrri5cl9u/test/per_speaker_metrics.table.json","sha256":"b5c8267dd6d964f16493cffc0cdc21539541616a90c1b546b841b1fc45cb536f","ncols":4,"size":5411},"test/speaker_bleu4_std":2.8405442237854004,"test/rougeL_precision":0.2017328441143036,"test/contra_loss":0.4464213252067566,"test/visual_feat_std":NaN,"test/logit_scale":116.04837799072266,"_timestamp":1.7778790833759375e+09}
results/spamo/2026-05-05T21-58-47_test_v30_dual_ms_scratch/config.yaml ADDED
@@ -0,0 +1,183 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ _wandb:
2
+ value:
3
+ cli_version: 0.23.1
4
+ e:
5
+ 9tedcvvfjtp60jcqh861xwbs9exycbcy:
6
+ args:
7
+ - -c
8
+ - configs/finetune_v30_dual_ms_scratch.yaml
9
+ - --ckpt
10
+ - logs/2026-05-04T10-59-07_finetune_v30_dual_ms_scratch/checkpoints/epoch=00028-step=0085579-bleu4=1.97.ckpt
11
+ - -t
12
+ - "False"
13
+ - --test
14
+ - "True"
15
+ - -n
16
+ - test_v30_dual_ms_scratch
17
+ - --tags
18
+ - test
19
+ - pjm-ms
20
+ - dual
21
+ - scratch
22
+ codePath: main.py
23
+ codePathLocal: main.py
24
+ cpu_count: 12
25
+ cpu_count_logical: 24
26
+ cudaVersion: "12.8"
27
+ disk:
28
+ /:
29
+ total: "1967317549056"
30
+ used: "1649338347520"
31
+ email: s28855@pjwstk.edu.pl
32
+ executable: /home/croco/SpaMo-PJM/.venv/bin/python
33
+ git:
34
+ commit: 4f11b72511d6fd9692336b6b89e43f98e516e01c
35
+ remote: https://github.com/croco-corp/SpaMo-PJM.git
36
+ gpu: NVIDIA GeForce RTX 3090
37
+ gpu_count: 1
38
+ gpu_nvidia:
39
+ - architecture: Ampere
40
+ cudaCores: 10496
41
+ memoryTotal: "25769803776"
42
+ name: NVIDIA GeForce RTX 3090
43
+ uuid: GPU-5c32b58e-e363-6bec-ff14-3d6044d0ae84
44
+ host: lowca-desktop
45
+ memory:
46
+ total: "64894398464"
47
+ os: Linux-6.8.0-110-generic-x86_64-with-glibc2.39
48
+ program: /home/croco/SpaMo-PJM/main.py
49
+ python: CPython 3.10.19
50
+ root: logs/2026-05-05T21-58-47_test_v30_dual_ms_scratch
51
+ startedAt: "2026-05-05T19:58:52.724376Z"
52
+ writerId: 9tedcvvfjtp60jcqh861xwbs9exycbcy
53
+ m:
54
+ - "1": trainer/global_step
55
+ "6":
56
+ - 3
57
+ "7": []
58
+ - "2": '*'
59
+ "5": 1
60
+ "6":
61
+ - 1
62
+ "7": []
63
+ python_version: 3.10.19
64
+ t:
65
+ "1":
66
+ - 1
67
+ - 9
68
+ - 11
69
+ - 49
70
+ - 71
71
+ - 98
72
+ - 103
73
+ "2":
74
+ - 1
75
+ - 9
76
+ - 11
77
+ - 49
78
+ - 71
79
+ - 98
80
+ - 103
81
+ "3":
82
+ - 7
83
+ - 13
84
+ - 14
85
+ - 15
86
+ - 16
87
+ - 66
88
+ "4": 3.10.19
89
+ "5": 0.23.1
90
+ "6": 4.57.1
91
+ "12": 0.23.1
92
+ "13": linux-x86_64
93
+ alpha:
94
+ value: 1
95
+ aux_input_size:
96
+ value: 0
97
+ beam_size:
98
+ value: 5
99
+ cache_dir:
100
+ value: /home/croco/.cache/huggingface/hub
101
+ combined_loss:
102
+ value: true
103
+ config_files:
104
+ value:
105
+ - configs/finetune_v30_dual_ms_scratch.yaml
106
+ cross_modal_align:
107
+ value: true
108
+ data:
109
+ value:
110
+ batch_size: 2
111
+ device: cuda
112
+ max_frame_length: 512
113
+ motion_features_path: features/mae_feat_pjm.h5
114
+ multilang_path: features/texts_multilang_pjm.h5
115
+ num_workers: 4
116
+ set_to_test: test
117
+ target_lang: English
118
+ test_split_path: /home/croco/CrocoSign/data/split_test_ms.csv
119
+ texts_path: features/texts_eng.h5
120
+ train_split_path: /home/croco/CrocoSign/data/split_train_ms.csv
121
+ val_split_path: /home/croco/CrocoSign/data/split_val_ms.csv
122
+ visual_features_path: features/vit_feat_pjm.h5
123
+ evaluation:
124
+ value: mse
125
+ frame_sample_rate:
126
+ value: 1
127
+ fusion_dropout:
128
+ value: 0.3
129
+ fusion_lr:
130
+ value: 1e-05
131
+ fusion_mode:
132
+ value: joint
133
+ input_size:
134
+ value: 2048
135
+ inter_hidden:
136
+ value: 768
137
+ keypoint_dim:
138
+ value: 0
139
+ lora_alpha:
140
+ value: 32
141
+ lora_dropout:
142
+ value: 0.1
143
+ lora_r:
144
+ value: 16
145
+ lr:
146
+ value: 0.0001
147
+ lr_patience:
148
+ value: 5
149
+ lr_scheduler_mode:
150
+ value: max
151
+ max_frame_len:
152
+ value: 512
153
+ max_txt_len:
154
+ value: 64
155
+ model_name:
156
+ value: google/flan-t5-xl
157
+ monitor:
158
+ value: val/bleu4
159
+ motion_input_size:
160
+ value: 1024
161
+ num_in_context:
162
+ value: 3
163
+ prompt:
164
+ value: Translate the given sentence into {}.
165
+ queue_size:
166
+ value: 0
167
+ scheduler_config:
168
+ value:
169
+ params:
170
+ lr_max: 1
171
+ lr_min: 0.1
172
+ lr_start: 0
173
+ max_decay_steps: 50000
174
+ warm_up_steps: 1000
175
+ target: spamo.lr_scheduler.LambdaWarmUpCosineScheduler
176
+ seed:
177
+ value: 0
178
+ tuning_type:
179
+ value: lora
180
+ use_in_context:
181
+ value: true
182
+ warm_up_steps:
183
+ value: 0
results/spamo/2026-05-05T21-58-47_test_v30_dual_ms_scratch/output.log ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Restoring states from the checkpoint path at logs/2026-05-04T10-59-07_finetune_v30_dual_ms_scratch/checkpoints/epoch=00028-step=0085579-bleu4=1.97.ckpt
2
+ /home/croco/SpaMo-PJM/.venv/lib/python3.10/site-packages/pytorch_lightning/trainer/call.py:283: Be aware that when using `ckpt_path`, callbacks used to create the checkpoint need to be provided during `Trainer` instantiation. Please add the following callbacks: ["EarlyStopping{'monitor': 'val/bleu4', 'mode': 'max'}", "ModelCheckpoint{'monitor': 'val/bleu4', 'mode': 'max', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}"].
3
+ LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
4
+ Loaded model weights from the checkpoint at logs/2026-05-04T10-59-07_finetune_v30_dual_ms_scratch/checkpoints/epoch=00028-step=0085579-bleu4=1.97.ckpt
5
+ /home/croco/SpaMo-PJM/spamo/t5_slt.py:585: UserWarning: std(): degrees of freedom is <= 0. Correction should be strictly less than the reduction factor (input numel divided by output numel). (Triggered internally at /pytorch/aten/src/ATen/native/ReduceOps.cpp:1857.)
6
+ log_dict[f"{split}/visual_feat_std"] = visual_outputs.mean(1).std(0).mean().item()
7
+
8
+ ===== Validation Examples =====
9
+ Reference: i said, the dog looks down at the frog sitting in the jar.
10
+ Generated: the dog looks through binoculars.
11
+ --------------------------------------------------
12
+ Reference: he cried out and fell back.
13
+ Generated: i think it's a duck.
14
+ --------------------------------------------------
15
+ Reference: the child hugs the dog close.
16
+ Generated: he sleeps soundly and does not want to get up.
17
+ --------------------------------------------------
18
+ Reference: the frog has disappeared and is not coming back.
19
+ Generated: aha, aha, aha.
20
+ --------------------------------------------------
21
+ Reference: the boy searched and put his hand in a burrow underground.
22
+ Generated: he climbs the tree.
23
+ --------------------------------------------------
24
+ Dumped 2935 pairs β†’ logs/2026-05-05T21-58-47_test_v30_dual_ms_scratch/test_outputs.txt
25
+ Logged 2935 translations to W&B test/translations
26
+ Some weights of RobertaModel were not initialized from the model checkpoint at roberta-large and are newly initialized: ['pooler.dense.bias', 'pooler.dense.weight']
27
+ You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
28
+ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
29
+ ┃ Test metric ┃ DataLoader 0 ┃
30
+ ┑━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
31
+ β”‚ test/bertscore_f1 β”‚ 0.8612825274467468 β”‚
32
+ β”‚ test/bleu1 β”‚ 18.552621841430664 β”‚
33
+ β”‚ test/bleu2 β”‚ 6.5959014892578125 β”‚
34
+ β”‚ test/bleu3 β”‚ 3.398465394973755 β”‚
35
+ β”‚ test/bleu4 β”‚ 2.0304346084594727 β”‚
36
+ β”‚ test/bleurt20 β”‚ 0.30252590775489807 β”‚
37
+ β”‚ test/chrf β”‚ 15.321980476379395 β”‚
38
+ β”‚ test/contra_loss β”‚ 0.6871479153633118 β”‚
39
+ β”‚ test/logit_scale β”‚ 62.30245590209961 β”‚
40
+ β”‚ test/rougeL_f1 β”‚ 0.12370917201042175 β”‚
41
+ β”‚ test/rougeL_precision β”‚ 0.13015751540660858 β”‚
42
+ β”‚ test/rougeL_recall β”‚ 0.1327442079782486 β”‚
43
+ β”‚ test/speaker_bleu4_std β”‚ 1.5873953104019165 β”‚
44
+ β”‚ test/visual_feat_std β”‚ nan β”‚
45
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
46
+ Testing ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1468/1468 0:11:01 β€’ 0:00:00 2.18it/s
results/spamo/2026-05-05T21-58-47_test_v30_dual_ms_scratch/test_outputs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/2026-05-05T21-58-47_test_v30_dual_ms_scratch/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"_timestamp":1.7780118178223538e+09,"test/contra_loss":0.6871479153633118,"test/visual_feat_std":NaN,"trainer/global_step":0,"test/bleu2":6.5959014892578125,"_wandb":{"runtime":685},"test/chrf":15.321980476379395,"test/logit_scale":62.30245590209961,"test/bertscore_f1":0.8612825274467468,"test/translations":{"log_mode":"IMMUTABLE","size":336140,"sha256":"a71f5d724fada50c99bb7077501db71fdfdd728c4f6d4118ff57b91cedd412cf","_type":"table-file","artifact_path":"wandb-client-artifact://1anr600w60w71a5g0oofp930xhc76a60dfgj6ptpqjljkva7ssp0108od2zar38mqq0zrgvamlcd2qe7lpzf24rz091msot6d6sf7haqubwuucmeqnl5wdx9n1xrohpj/test/translations.table.json","ncols":3,"path":"media/table/test/translations_0_a71f5d724fada50c99bb.table.json","nrows":2935,"_latest_artifact_path":"wandb-client-artifact://ry5f31wgcelk3mf9z2rdvqldljmzen1l45gxxguriz66dndqxzcew4vdcuh0k36tz1wxo6gf0hs6m05xds29qcmr7c6pd1eeitx4vwrsxjkwwght3lgbttwtx5l2ilrs:latest/test/translations.table.json"},"test/speaker_bleu4_std":1.5873953104019165,"_runtime":685,"test/bleurt20":0.30252590775489807,"test/rougeL_recall":0.1327442079782486,"epoch":0,"test/per_speaker_metrics":{"nrows":151,"ncols":4,"_type":"table-file","size":5400,"path":"media/table/test/per_speaker_metrics_1_6e04f24d7537b9929b36.table.json","_latest_artifact_path":"wandb-client-artifact://7a3w409m04y23jkoa63e3lvrqv6oa483fp1557xep8e7mv3der68xg2njvps8b5p450rsvoz4m8ukf0k38mnkj935a8337ocuth09z213fvv5pjtrabgrxsu9dnt25wx:latest/test/per_speaker_metrics.table.json","sha256":"6e04f24d7537b9929b361374d686ea4f705fc9ccbfa950a9ddf32d685aea1136","log_mode":"IMMUTABLE","artifact_path":"wandb-client-artifact://a03auae5b6y1y106mnxtynpob0u50o1cw76lkk5molj5ptomo6kzh6qkp043e8r8g7g5j4f4xe7pg4bb0d0d7euxndrm6hivpkf4d67e7j2lqzt1ocm527vlrri5cl9u/test/per_speaker_metrics.table.json"},"test/bleu1":18.552621841430664,"test/bleu3":3.398465394973755,"_step":2,"test/rougeL_precision":0.13015751540660858,"test/bleu4":2.0304346084594727,"test/rougeL_f1":0.12370917201042175}
results/spamo/2026-05-05T22-10-23_test_v31_quad_ms_scratch/config.yaml ADDED
@@ -0,0 +1,187 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ _wandb:
2
+ value:
3
+ cli_version: 0.23.1
4
+ e:
5
+ r8q1fvf03dx2dazx2tb1cxamexs5pfxx:
6
+ args:
7
+ - -c
8
+ - configs/finetune_v31_quad_xattn_ms_scratch.yaml
9
+ - --ckpt
10
+ - logs/2026-05-05T09-06-44_finetune_v31_quad_xattn_ms_scratch/checkpoints/epoch=00009-step=0029510-bleu4=1.84.ckpt
11
+ - -t
12
+ - "False"
13
+ - --test
14
+ - "True"
15
+ - -n
16
+ - test_v31_quad_ms_scratch
17
+ - --tags
18
+ - test
19
+ - pjm-ms
20
+ - quad
21
+ - scratch
22
+ codePath: main.py
23
+ codePathLocal: main.py
24
+ cpu_count: 12
25
+ cpu_count_logical: 24
26
+ cudaVersion: "12.8"
27
+ disk:
28
+ /:
29
+ total: "1967317549056"
30
+ used: "1649339273216"
31
+ email: s28855@pjwstk.edu.pl
32
+ executable: /home/croco/SpaMo-PJM/.venv/bin/python
33
+ git:
34
+ commit: 4f11b72511d6fd9692336b6b89e43f98e516e01c
35
+ remote: https://github.com/croco-corp/SpaMo-PJM.git
36
+ gpu: NVIDIA GeForce RTX 3090
37
+ gpu_count: 1
38
+ gpu_nvidia:
39
+ - architecture: Ampere
40
+ cudaCores: 10496
41
+ memoryTotal: "25769803776"
42
+ name: NVIDIA GeForce RTX 3090
43
+ uuid: GPU-5c32b58e-e363-6bec-ff14-3d6044d0ae84
44
+ host: lowca-desktop
45
+ memory:
46
+ total: "64894398464"
47
+ os: Linux-6.8.0-110-generic-x86_64-with-glibc2.39
48
+ program: /home/croco/SpaMo-PJM/main.py
49
+ python: CPython 3.10.19
50
+ root: logs/2026-05-05T22-10-23_test_v31_quad_ms_scratch
51
+ startedAt: "2026-05-05T20:10:27.832202Z"
52
+ writerId: r8q1fvf03dx2dazx2tb1cxamexs5pfxx
53
+ m:
54
+ - "1": trainer/global_step
55
+ "6":
56
+ - 3
57
+ "7": []
58
+ - "2": '*'
59
+ "5": 1
60
+ "6":
61
+ - 1
62
+ "7": []
63
+ python_version: 3.10.19
64
+ t:
65
+ "1":
66
+ - 1
67
+ - 9
68
+ - 11
69
+ - 49
70
+ - 71
71
+ - 98
72
+ - 103
73
+ "2":
74
+ - 1
75
+ - 9
76
+ - 11
77
+ - 49
78
+ - 71
79
+ - 98
80
+ - 103
81
+ "3":
82
+ - 7
83
+ - 13
84
+ - 14
85
+ - 15
86
+ - 16
87
+ - 66
88
+ "4": 3.10.19
89
+ "5": 0.23.1
90
+ "6": 4.57.1
91
+ "12": 0.23.1
92
+ "13": linux-x86_64
93
+ alpha:
94
+ value: 1
95
+ aux_input_size:
96
+ value: 2048
97
+ beam_size:
98
+ value: 5
99
+ cache_dir:
100
+ value: /home/croco/.cache/huggingface/hub
101
+ combined_loss:
102
+ value: true
103
+ config_files:
104
+ value:
105
+ - configs/finetune_v31_quad_xattn_ms_scratch.yaml
106
+ cross_modal_align:
107
+ value: true
108
+ data:
109
+ value:
110
+ aux_features_path: features/hand_vit_feat_pjm.h5
111
+ batch_size: 2
112
+ device: cuda
113
+ keypoint_features_path: features/mediapipe_feat_pjm.h5
114
+ max_frame_length: 512
115
+ motion_features_path: features/mae_feat_pjm.h5
116
+ multilang_path: features/texts_multilang_pjm.h5
117
+ num_workers: 4
118
+ set_to_test: test
119
+ target_lang: English
120
+ test_split_path: /home/croco/CrocoSign/data/split_test_ms.csv
121
+ texts_path: features/texts_eng.h5
122
+ train_split_path: /home/croco/CrocoSign/data/split_train_ms.csv
123
+ val_split_path: /home/croco/CrocoSign/data/split_val_ms.csv
124
+ visual_features_path: features/vit_feat_pjm.h5
125
+ evaluation:
126
+ value: mse
127
+ frame_sample_rate:
128
+ value: 1
129
+ fusion_dropout:
130
+ value: 0.3
131
+ fusion_lr:
132
+ value: 1e-05
133
+ fusion_mode:
134
+ value: joint
135
+ input_size:
136
+ value: 2048
137
+ inter_hidden:
138
+ value: 768
139
+ keypoint_dim:
140
+ value: 258
141
+ lora_alpha:
142
+ value: 32
143
+ lora_dropout:
144
+ value: 0.1
145
+ lora_r:
146
+ value: 16
147
+ lr:
148
+ value: 0.0001
149
+ lr_patience:
150
+ value: 5
151
+ lr_scheduler_mode:
152
+ value: max
153
+ max_frame_len:
154
+ value: 512
155
+ max_txt_len:
156
+ value: 64
157
+ model_name:
158
+ value: google/flan-t5-xl
159
+ monitor:
160
+ value: val/bleu4
161
+ motion_input_size:
162
+ value: 1024
163
+ new_stream_lr:
164
+ value: 0.0001
165
+ num_in_context:
166
+ value: 3
167
+ prompt:
168
+ value: Translate the given sentence into {}.
169
+ queue_size:
170
+ value: 0
171
+ scheduler_config:
172
+ value:
173
+ params:
174
+ lr_max: 1
175
+ lr_min: 0.1
176
+ lr_start: 0
177
+ max_decay_steps: 50000
178
+ warm_up_steps: 1000
179
+ target: spamo.lr_scheduler.LambdaWarmUpCosineScheduler
180
+ seed:
181
+ value: 0
182
+ tuning_type:
183
+ value: lora
184
+ use_in_context:
185
+ value: true
186
+ warm_up_steps:
187
+ value: 0
results/spamo/2026-05-05T22-10-23_test_v31_quad_ms_scratch/output.log ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Restoring states from the checkpoint path at logs/2026-05-05T09-06-44_finetune_v31_quad_xattn_ms_scratch/checkpoints/epoch=00009-step=0029510-bleu4=1.84.ckpt
2
+ /home/croco/SpaMo-PJM/.venv/lib/python3.10/site-packages/pytorch_lightning/trainer/call.py:283: Be aware that when using `ckpt_path`, callbacks used to create the checkpoint need to be provided during `Trainer` instantiation. Please add the following callbacks: ["ModelCheckpoint{'monitor': 'val/bleu4', 'mode': 'max', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}", "EarlyStopping{'monitor': 'val/bleu4', 'mode': 'max'}"].
3
+ LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
4
+ Loaded model weights from the checkpoint at logs/2026-05-05T09-06-44_finetune_v31_quad_xattn_ms_scratch/checkpoints/epoch=00009-step=0029510-bleu4=1.84.ckpt
5
+ /home/croco/.local/share/uv/python/cpython-3.10.19-linux-x86_64-gnu/lib/python3.10/contextlib.py:103: FutureWarning: `torch.backends.cuda.sdp_kernel()` is deprecated. In the future, this context manager will be removed. Please see `torch.nn.attention.sdpa_kernel()` for the new context manager, with updated signature.
6
+ self.gen = func(*args, **kwds)
7
+ /home/croco/SpaMo-PJM/spamo/t5_slt.py:585: UserWarning: std(): degrees of freedom is <= 0. Correction should be strictly less than the reduction factor (input numel divided by output numel). (Triggered internally at /pytorch/aten/src/ATen/native/ReduceOps.cpp:1857.)
8
+ log_dict[f"{split}/visual_feat_std"] = visual_outputs.mean(1).std(0).mean().item()
9
+
10
+ ===== Validation Examples =====
11
+ Reference: i said, the dog looks down at the frog sitting in the jar.
12
+ Generated: he looks through binoculars and sees that there is a frog.
13
+ --------------------------------------------------
14
+ Reference: he cried out and fell back.
15
+ Generated: he puts a watermelon on his head.
16
+ --------------------------------------------------
17
+ Reference: the child hugs the dog close.
18
+ Generated: i can't, i can't, i can't, i can't, i can't, i can't, i can't, i can't, i can't, i can't, i can
19
+ --------------------------------------------------
20
+ Reference: the frog has disappeared and is not coming back.
21
+ Generated: i don't know.
22
+ --------------------------------------------------
23
+ Reference: the boy searched and put his hand in a burrow underground.
24
+ Generated: he looks through binoculars and sees that there is a lot of frogs.
25
+ --------------------------------------------------
26
+ Dumped 2935 pairs β†’ logs/2026-05-05T22-10-23_test_v31_quad_ms_scratch/test_outputs.txt
27
+ Logged 2935 translations to W&B test/translations
28
+ Some weights of RobertaModel were not initialized from the model checkpoint at roberta-large and are newly initialized: ['pooler.dense.bias', 'pooler.dense.weight']
29
+ You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
30
+ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
31
+ ┃ Test metric ┃ DataLoader 0 ┃
32
+ ┑━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
33
+ β”‚ test/bertscore_f1 β”‚ 0.8602100014686584 β”‚
34
+ β”‚ test/bleu1 β”‚ 18.453319549560547 β”‚
35
+ β”‚ test/bleu2 β”‚ 6.044188976287842 β”‚
36
+ β”‚ test/bleu3 β”‚ 2.8546669483184814 β”‚
37
+ β”‚ test/bleu4 β”‚ 1.5552290678024292 β”‚
38
+ β”‚ test/bleurt20 β”‚ 0.30417200922966003 β”‚
39
+ β”‚ test/chrf β”‚ 14.50250244140625 β”‚
40
+ β”‚ test/contra_loss β”‚ 0.4879496097564697 β”‚
41
+ β”‚ test/logit_scale β”‚ 37.6885986328125 β”‚
42
+ β”‚ test/rougeL_f1 β”‚ 0.1191704198718071 β”‚
43
+ β”‚ test/rougeL_precision β”‚ 0.1266443431377411 β”‚
44
+ β”‚ test/rougeL_recall β”‚ 0.1267620176076889 β”‚
45
+ β”‚ test/speaker_bleu4_std β”‚ 1.3776135444641113 β”‚
46
+ β”‚ test/visual_feat_std β”‚ nan β”‚
47
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
48
+ Testing ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1468/1468 0:10:51 β€’ 0:00:00 2.04it/s
results/spamo/2026-05-05T22-10-23_test_v31_quad_ms_scratch/test_outputs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/2026-05-05T22-10-23_test_v31_quad_ms_scratch/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"test/rougeL_f1":0.1191704198718071,"trainer/global_step":0,"test/contra_loss":0.4879496097564697,"_step":2,"test/logit_scale":37.6885986328125,"_runtime":675,"_wandb":{"runtime":675},"epoch":0,"test/bleurt20":0.30417200922966003,"test/rougeL_precision":0.1266443431377411,"test/visual_feat_std":NaN,"test/translations":{"ncols":3,"sha256":"a4f89027a807d65a92d7ae72f6618b0a13837b9fc9a8fb500450a7937525bc44","_latest_artifact_path":"wandb-client-artifact://ry5f31wgcelk3mf9z2rdvqldljmzen1l45gxxguriz66dndqxzcew4vdcuh0k36tz1wxo6gf0hs6m05xds29qcmr7c6pd1eeitx4vwrsxjkwwght3lgbttwtx5l2ilrs:latest/test/translations.table.json","artifact_path":"wandb-client-artifact://1anr600w60w71a5g0oofp930xhc76a60dfgj6ptpqjljkva7ssp0108od2zar38mqq0zrgvamlcd2qe7lpzf24rz091msot6d6sf7haqubwuucmeqnl5wdx9n1xrohpj/test/translations.table.json","size":332802,"path":"media/table/test/translations_0_a4f89027a807d65a92d7.table.json","log_mode":"IMMUTABLE","_type":"table-file","nrows":2935},"test/chrf":14.50250244140625,"_timestamp":1.7780125027608464e+09,"test/bleu1":18.453319549560547,"test/speaker_bleu4_std":1.3776135444641113,"test/bleu2":6.044188976287842,"test/per_speaker_metrics":{"nrows":151,"artifact_path":"wandb-client-artifact://a03auae5b6y1y106mnxtynpob0u50o1cw76lkk5molj5ptomo6kzh6qkp043e8r8g7g5j4f4xe7pg4bb0d0d7euxndrm6hivpkf4d67e7j2lqzt1ocm527vlrri5cl9u/test/per_speaker_metrics.table.json","log_mode":"IMMUTABLE","_latest_artifact_path":"wandb-client-artifact://7a3w409m04y23jkoa63e3lvrqv6oa483fp1557xep8e7mv3der68xg2njvps8b5p450rsvoz4m8ukf0k38mnkj935a8337ocuth09z213fvv5pjtrabgrxsu9dnt25wx:latest/test/per_speaker_metrics.table.json","path":"media/table/test/per_speaker_metrics_1_e3aba32d33a1f9480a46.table.json","ncols":4,"sha256":"e3aba32d33a1f9480a460fad3cd9e0ce49d65962cb79c061a362505503c02938","_type":"table-file","size":5398},"test/bertscore_f1":0.8602100014686584,"test/bleu4":1.5552290678024292,"test/rougeL_recall":0.1267620176076889,"test/bleu3":2.8546669483184814}
results/spamo/2026-05-05T23-00-55_test_upstream_pjm_ms_dual/config.yaml ADDED
@@ -0,0 +1,183 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ _wandb:
2
+ value:
3
+ cli_version: 0.23.1
4
+ e:
5
+ izsgqz5lr1uu2yjooktvnvbtuffi3fbf:
6
+ args:
7
+ - -c
8
+ - configs/finetune_v26_dual_paper_faithful_from_upstream.yaml
9
+ - --ckpt
10
+ - /home/croco/SpaMo/logs/2026-05-02T08-39-04_finetune_pjm_ms_upstream_v2/checkpoints/epoch=00043-step=0129844-bleu4=5.36.ckpt
11
+ - -t
12
+ - "False"
13
+ - --test
14
+ - "True"
15
+ - -n
16
+ - test_upstream_pjm_ms_dual
17
+ - --tags
18
+ - test
19
+ - pjm-ms
20
+ - dual
21
+ - phoenix-upstream-pjm
22
+ codePath: main.py
23
+ codePathLocal: main.py
24
+ cpu_count: 12
25
+ cpu_count_logical: 24
26
+ cudaVersion: "12.8"
27
+ disk:
28
+ /:
29
+ total: "1967317549056"
30
+ used: "1649346523136"
31
+ email: s28855@pjwstk.edu.pl
32
+ executable: /home/croco/SpaMo-PJM/.venv/bin/python
33
+ git:
34
+ commit: 4f11b72511d6fd9692336b6b89e43f98e516e01c
35
+ remote: https://github.com/croco-corp/SpaMo-PJM.git
36
+ gpu: NVIDIA GeForce RTX 3090
37
+ gpu_count: 1
38
+ gpu_nvidia:
39
+ - architecture: Ampere
40
+ cudaCores: 10496
41
+ memoryTotal: "25769803776"
42
+ name: NVIDIA GeForce RTX 3090
43
+ uuid: GPU-5c32b58e-e363-6bec-ff14-3d6044d0ae84
44
+ host: lowca-desktop
45
+ memory:
46
+ total: "64894398464"
47
+ os: Linux-6.8.0-110-generic-x86_64-with-glibc2.39
48
+ program: /home/croco/SpaMo-PJM/main.py
49
+ python: CPython 3.10.19
50
+ root: logs/2026-05-05T23-00-55_test_upstream_pjm_ms_dual
51
+ startedAt: "2026-05-05T21:00:59.918207Z"
52
+ writerId: izsgqz5lr1uu2yjooktvnvbtuffi3fbf
53
+ m:
54
+ - "1": trainer/global_step
55
+ "6":
56
+ - 3
57
+ "7": []
58
+ - "2": '*'
59
+ "5": 1
60
+ "6":
61
+ - 1
62
+ "7": []
63
+ python_version: 3.10.19
64
+ t:
65
+ "1":
66
+ - 1
67
+ - 9
68
+ - 11
69
+ - 49
70
+ - 71
71
+ - 98
72
+ - 103
73
+ "2":
74
+ - 1
75
+ - 9
76
+ - 11
77
+ - 49
78
+ - 71
79
+ - 98
80
+ - 103
81
+ "3":
82
+ - 7
83
+ - 13
84
+ - 14
85
+ - 15
86
+ - 16
87
+ - 66
88
+ "4": 3.10.19
89
+ "5": 0.23.1
90
+ "6": 4.57.1
91
+ "12": 0.23.1
92
+ "13": linux-x86_64
93
+ alpha:
94
+ value: 1
95
+ aux_input_size:
96
+ value: 0
97
+ beam_size:
98
+ value: 5
99
+ cache_dir:
100
+ value: /home/croco/.cache/huggingface/hub
101
+ combined_loss:
102
+ value: true
103
+ config_files:
104
+ value:
105
+ - configs/finetune_v26_dual_paper_faithful_from_upstream.yaml
106
+ cross_modal_align:
107
+ value: true
108
+ data:
109
+ value:
110
+ batch_size: 2
111
+ device: cuda
112
+ max_frame_length: 512
113
+ motion_features_path: features/mae_feat_pjm.h5
114
+ multilang_path: features/texts_multilang_pjm.h5
115
+ num_workers: 4
116
+ set_to_test: test
117
+ target_lang: English
118
+ test_split_path: /home/croco/CrocoSign/data/split_test_ms.csv
119
+ texts_path: features/texts_eng.h5
120
+ train_split_path: /home/croco/CrocoSign/data/split_train_ms.csv
121
+ val_split_path: /home/croco/CrocoSign/data/split_val_ms.csv
122
+ visual_features_path: features/vit_feat_pjm.h5
123
+ evaluation:
124
+ value: mse
125
+ frame_sample_rate:
126
+ value: 1
127
+ fusion_dropout:
128
+ value: 0.3
129
+ fusion_lr:
130
+ value: 1e-05
131
+ fusion_mode:
132
+ value: joint
133
+ input_size:
134
+ value: 2048
135
+ inter_hidden:
136
+ value: 768
137
+ keypoint_dim:
138
+ value: 0
139
+ lora_alpha:
140
+ value: 32
141
+ lora_dropout:
142
+ value: 0.1
143
+ lora_r:
144
+ value: 16
145
+ lr:
146
+ value: 0.0001
147
+ lr_patience:
148
+ value: 5
149
+ lr_scheduler_mode:
150
+ value: max
151
+ max_frame_len:
152
+ value: 512
153
+ max_txt_len:
154
+ value: 64
155
+ model_name:
156
+ value: google/flan-t5-xl
157
+ monitor:
158
+ value: val/bleu4
159
+ motion_input_size:
160
+ value: 1024
161
+ num_in_context:
162
+ value: 3
163
+ prompt:
164
+ value: Translate the given sentence into {}.
165
+ queue_size:
166
+ value: 0
167
+ scheduler_config:
168
+ value:
169
+ params:
170
+ lr_max: 1
171
+ lr_min: 0.1
172
+ lr_start: 0
173
+ max_decay_steps: 30000
174
+ warm_up_steps: 1000
175
+ target: spamo.lr_scheduler.LambdaWarmUpCosineScheduler
176
+ seed:
177
+ value: 0
178
+ tuning_type:
179
+ value: lora
180
+ use_in_context:
181
+ value: true
182
+ warm_up_steps:
183
+ value: 0
results/spamo/2026-05-05T23-00-55_test_upstream_pjm_ms_dual/output.log ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Restoring states from the checkpoint path at /home/croco/SpaMo/logs/2026-05-02T08-39-04_finetune_pjm_ms_upstream_v2/checkpoints/epoch=00043-step=0129844-bleu4=5.36.ckpt
2
+ Lightning automatically upgraded your loaded checkpoint from v1.9.5 to v2.6.1. To apply the upgrade to your files permanently, run `python -m pytorch_lightning.utilities.upgrade_checkpoint ../SpaMo/logs/2026-05-02T08-39-04_finetune_pjm_ms_upstream_v2/checkpoints/epoch=00043-step=0129844-bleu4=5.36.ckpt`
3
+ /home/croco/SpaMo-PJM/.venv/lib/python3.10/site-packages/pytorch_lightning/trainer/call.py:283: Be aware that when using `ckpt_path`, callbacks used to create the checkpoint need to be provided during `Trainer` instantiation. Please add the following callbacks: ["EarlyStopping{'monitor': 'val/bleu4', 'mode': 'max'}", "ModelCheckpoint{'monitor': 'val/bleu4', 'mode': 'max', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}"].
4
+ LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
5
+ Loaded model weights from the checkpoint at /home/croco/SpaMo/logs/2026-05-02T08-39-04_finetune_pjm_ms_upstream_v2/checkpoints/epoch=00043-step=0129844-bleu4=5.36.ckpt
6
+ /home/croco/SpaMo-PJM/spamo/t5_slt.py:585: UserWarning: std(): degrees of freedom is <= 0. Correction should be strictly less than the reduction factor (input numel divided by output numel). (Triggered internally at /pytorch/aten/src/ATen/native/ReduceOps.cpp:1857.)
7
+ log_dict[f"{split}/visual_feat_std"] = visual_outputs.mean(1).std(0).mean().item()
8
+
9
+ ===== Validation Examples =====
10
+ Reference: i said, the dog looks down at the frog sitting in the jar.
11
+ Generated: the dog looks into the jar.
12
+ --------------------------------------------------
13
+ Reference: he cried out and fell back.
14
+ Generated: the cat jumped out of the window.
15
+ --------------------------------------------------
16
+ Reference: the child hugs the dog close.
17
+ Generated: the baby fell asleep, the dog also fell asleep.
18
+ --------------------------------------------------
19
+ Reference: the frog has disappeared and is not coming back.
20
+ Generated: there is no such sign.
21
+ --------------------------------------------------
22
+ Reference: the boy searched and put his hand in a burrow underground.
23
+ Generated: the boy looks inside.
24
+ --------------------------------------------------
25
+ Dumped 2935 pairs β†’ logs/2026-05-05T23-00-55_test_upstream_pjm_ms_dual/test_outputs.txt
26
+ Logged 2935 translations to W&B test/translations
27
+ Some weights of RobertaModel were not initialized from the model checkpoint at roberta-large and are newly initialized: ['pooler.dense.bias', 'pooler.dense.weight']
28
+ You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
29
+ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
30
+ ┃ Test metric ┃ DataLoader 0 ┃
31
+ ┑━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
32
+ β”‚ test/bertscore_f1 β”‚ 0.8778611421585083 β”‚
33
+ β”‚ test/bleu1 β”‚ 28.86847686767578 β”‚
34
+ β”‚ test/bleu2 β”‚ 13.760455131530762 β”‚
35
+ β”‚ test/bleu3 β”‚ 8.273240089416504 β”‚
36
+ β”‚ test/bleu4 β”‚ 5.543374061584473 β”‚
37
+ β”‚ test/bleurt20 β”‚ 0.35117584466934204 β”‚
38
+ β”‚ test/chrf β”‚ 21.055646896362305 β”‚
39
+ β”‚ test/contra_loss β”‚ 0.47302475571632385 β”‚
40
+ β”‚ test/logit_scale β”‚ 125.73445129394531 β”‚
41
+ β”‚ test/rougeL_f1 β”‚ 0.1966341733932495 β”‚
42
+ β”‚ test/rougeL_precision β”‚ 0.21004807949066162 β”‚
43
+ β”‚ test/rougeL_recall β”‚ 0.2010912448167801 β”‚
44
+ β”‚ test/speaker_bleu4_std β”‚ 3.436262845993042 β”‚
45
+ β”‚ test/visual_feat_std β”‚ nan β”‚
46
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
47
+ Testing ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1468/1468 0:08:14 β€’ 0:00:00 2.79it/s
results/spamo/2026-05-05T23-00-55_test_upstream_pjm_ms_dual/test_outputs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/2026-05-05T23-00-55_test_upstream_pjm_ms_dual/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"test/bleu3":8.273240089416504,"test/bleurt20":0.35117584466934204,"test/rougeL_precision":0.21004807949066162,"test/visual_feat_std":NaN,"test/chrf":21.055646896362305,"test/translations":{"size":310677,"_type":"table-file","log_mode":"IMMUTABLE","_latest_artifact_path":"wandb-client-artifact://ry5f31wgcelk3mf9z2rdvqldljmzen1l45gxxguriz66dndqxzcew4vdcuh0k36tz1wxo6gf0hs6m05xds29qcmr7c6pd1eeitx4vwrsxjkwwght3lgbttwtx5l2ilrs:latest/test/translations.table.json","nrows":2935,"artifact_path":"wandb-client-artifact://1anr600w60w71a5g0oofp930xhc76a60dfgj6ptpqjljkva7ssp0108od2zar38mqq0zrgvamlcd2qe7lpzf24rz091msot6d6sf7haqubwuucmeqnl5wdx9n1xrohpj/test/translations.table.json","path":"media/table/test/translations_0_58b8b82c36d3ad5022b6.table.json","ncols":3,"sha256":"58b8b82c36d3ad5022b68454a4743e387562833f6b35fa394c9ee81767cc4476"},"test/bleu4":5.543374061584473,"test/bleu1":28.86847686767578,"test/bleu2":13.760455131530762,"test/rougeL_recall":0.2010912448167801,"test/logit_scale":125.73445129394531,"_timestamp":1.7780153766640835e+09,"test/rougeL_f1":0.1966341733932495,"test/contra_loss":0.47302475571632385,"epoch":0,"test/speaker_bleu4_std":3.436262845993042,"test/bertscore_f1":0.8778611421585083,"_runtime":517,"_step":2,"trainer/global_step":0,"test/per_speaker_metrics":{"size":5410,"path":"media/table/test/per_speaker_metrics_1_f6d1cbac8a1e0e6ef0cd.table.json","ncols":4,"_type":"table-file","log_mode":"IMMUTABLE","sha256":"f6d1cbac8a1e0e6ef0cda011bfbfe34d4f142879631b3f2a46b9e641c170dcf0","nrows":151,"_latest_artifact_path":"wandb-client-artifact://7a3w409m04y23jkoa63e3lvrqv6oa483fp1557xep8e7mv3der68xg2njvps8b5p450rsvoz4m8ukf0k38mnkj935a8337ocuth09z213fvv5pjtrabgrxsu9dnt25wx:latest/test/per_speaker_metrics.table.json","artifact_path":"wandb-client-artifact://a03auae5b6y1y106mnxtynpob0u50o1cw76lkk5molj5ptomo6kzh6qkp043e8r8g7g5j4f4xe7pg4bb0d0d7euxndrm6hivpkf4d67e7j2lqzt1ocm527vlrri5cl9u/test/per_speaker_metrics.table.json"},"_wandb":{"runtime":517}}
results/spamo/2026-05-06T15-27-35_test_v32_dual_si_scratch/config.yaml ADDED
@@ -0,0 +1,183 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ _wandb:
2
+ value:
3
+ cli_version: 0.23.1
4
+ e:
5
+ 9u9cyar8iugo2xf3zoukwcgyqehainwo:
6
+ args:
7
+ - -c
8
+ - configs/finetune_v32_dual_si_scratch.yaml
9
+ - --ckpt
10
+ - logs/2026-05-06T03-29-53_finetune_v32_dual_si_scratch/checkpoints/epoch=00008-step=0012510-bleu4=0.99.ckpt
11
+ - -t
12
+ - "False"
13
+ - --test
14
+ - "True"
15
+ - -n
16
+ - test_v32_dual_si_scratch
17
+ - --tags
18
+ - test
19
+ - pjm-si
20
+ - dual
21
+ - scratch
22
+ codePath: main.py
23
+ codePathLocal: main.py
24
+ cpu_count: 12
25
+ cpu_count_logical: 24
26
+ cudaVersion: "12.8"
27
+ disk:
28
+ /:
29
+ total: "1967317549056"
30
+ used: "1674701602816"
31
+ email: s28855@pjwstk.edu.pl
32
+ executable: /home/croco/SpaMo-PJM/.venv/bin/python
33
+ git:
34
+ commit: 4f11b72511d6fd9692336b6b89e43f98e516e01c
35
+ remote: https://github.com/croco-corp/SpaMo-PJM.git
36
+ gpu: NVIDIA GeForce RTX 3090
37
+ gpu_count: 1
38
+ gpu_nvidia:
39
+ - architecture: Ampere
40
+ cudaCores: 10496
41
+ memoryTotal: "25769803776"
42
+ name: NVIDIA GeForce RTX 3090
43
+ uuid: GPU-5c32b58e-e363-6bec-ff14-3d6044d0ae84
44
+ host: lowca-desktop
45
+ memory:
46
+ total: "64894398464"
47
+ os: Linux-6.8.0-110-generic-x86_64-with-glibc2.39
48
+ program: /home/croco/SpaMo-PJM/main.py
49
+ python: CPython 3.10.19
50
+ root: logs/2026-05-06T15-27-35_test_v32_dual_si_scratch
51
+ startedAt: "2026-05-06T13:27:41.258680Z"
52
+ writerId: 9u9cyar8iugo2xf3zoukwcgyqehainwo
53
+ m:
54
+ - "1": trainer/global_step
55
+ "6":
56
+ - 3
57
+ "7": []
58
+ - "2": '*'
59
+ "5": 1
60
+ "6":
61
+ - 1
62
+ "7": []
63
+ python_version: 3.10.19
64
+ t:
65
+ "1":
66
+ - 1
67
+ - 9
68
+ - 11
69
+ - 49
70
+ - 71
71
+ - 98
72
+ - 103
73
+ "2":
74
+ - 1
75
+ - 9
76
+ - 11
77
+ - 49
78
+ - 71
79
+ - 98
80
+ - 103
81
+ "3":
82
+ - 7
83
+ - 13
84
+ - 14
85
+ - 15
86
+ - 16
87
+ - 66
88
+ "4": 3.10.19
89
+ "5": 0.23.1
90
+ "6": 4.57.1
91
+ "12": 0.23.1
92
+ "13": linux-x86_64
93
+ alpha:
94
+ value: 1
95
+ aux_input_size:
96
+ value: 0
97
+ beam_size:
98
+ value: 5
99
+ cache_dir:
100
+ value: /home/croco/.cache/huggingface/hub
101
+ combined_loss:
102
+ value: true
103
+ config_files:
104
+ value:
105
+ - configs/finetune_v32_dual_si_scratch.yaml
106
+ cross_modal_align:
107
+ value: true
108
+ data:
109
+ value:
110
+ batch_size: 2
111
+ device: cuda
112
+ max_frame_length: 512
113
+ motion_features_path: features/mae_feat_pjm.h5
114
+ multilang_path: features/texts_multilang_pjm.h5
115
+ num_workers: 4
116
+ set_to_test: test
117
+ target_lang: English
118
+ test_split_path: /home/croco/CrocoSign/data/split_test.csv
119
+ texts_path: features/texts_eng.h5
120
+ train_split_path: /home/croco/CrocoSign/data/split_train.csv
121
+ val_split_path: /home/croco/CrocoSign/data/split_val.csv
122
+ visual_features_path: features/vit_feat_pjm.h5
123
+ evaluation:
124
+ value: mse
125
+ frame_sample_rate:
126
+ value: 1
127
+ fusion_dropout:
128
+ value: 0.3
129
+ fusion_lr:
130
+ value: 1e-05
131
+ fusion_mode:
132
+ value: joint
133
+ input_size:
134
+ value: 2048
135
+ inter_hidden:
136
+ value: 768
137
+ keypoint_dim:
138
+ value: 0
139
+ lora_alpha:
140
+ value: 32
141
+ lora_dropout:
142
+ value: 0.1
143
+ lora_r:
144
+ value: 16
145
+ lr:
146
+ value: 0.0001
147
+ lr_patience:
148
+ value: 5
149
+ lr_scheduler_mode:
150
+ value: max
151
+ max_frame_len:
152
+ value: 512
153
+ max_txt_len:
154
+ value: 64
155
+ model_name:
156
+ value: google/flan-t5-xl
157
+ monitor:
158
+ value: val/bleu4
159
+ motion_input_size:
160
+ value: 1024
161
+ num_in_context:
162
+ value: 3
163
+ prompt:
164
+ value: Translate the given sentence into {}.
165
+ queue_size:
166
+ value: 0
167
+ scheduler_config:
168
+ value:
169
+ params:
170
+ lr_max: 1
171
+ lr_min: 0.1
172
+ lr_start: 0
173
+ max_decay_steps: 40000
174
+ warm_up_steps: 1000
175
+ target: spamo.lr_scheduler.LambdaWarmUpCosineScheduler
176
+ seed:
177
+ value: 0
178
+ tuning_type:
179
+ value: lora
180
+ use_in_context:
181
+ value: true
182
+ warm_up_steps:
183
+ value: 0
results/spamo/2026-05-06T15-27-35_test_v32_dual_si_scratch/output.log ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Restoring states from the checkpoint path at logs/2026-05-06T03-29-53_finetune_v32_dual_si_scratch/checkpoints/epoch=00008-step=0012510-bleu4=0.99.ckpt
2
+ /home/croco/SpaMo-PJM/.venv/lib/python3.10/site-packages/pytorch_lightning/trainer/call.py:283: Be aware that when using `ckpt_path`, callbacks used to create the checkpoint need to be provided during `Trainer` instantiation. Please add the following callbacks: ["EarlyStopping{'monitor': 'val/bleu4', 'mode': 'max'}", "ModelCheckpoint{'monitor': 'val/bleu4', 'mode': 'max', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}"].
3
+ LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
4
+ Loaded model weights from the checkpoint at logs/2026-05-06T03-29-53_finetune_v32_dual_si_scratch/checkpoints/epoch=00008-step=0012510-bleu4=0.99.ckpt
5
+
6
+ ===== Validation Examples =====
7
+ Reference: the same for the entire month.
8
+ Generated: charlie chaplin fixes a broken window.
9
+ --------------------------------------------------
10
+ Reference: either way.
11
+ Generated: i don't know, i don't know.
12
+ --------------------------------------------------
13
+ Reference: what do you want to do? think about what you will do at home.
14
+ Generated: mickey mouse with an apple on his head.
15
+ --------------------------------------------------
16
+ Reference: don't you want to?
17
+ Generated: i don't know, i don't know.
18
+ --------------------------------------------------
19
+ Reference: february two thousand and eleven?
20
+ Generated: i can't, i'm busy.
21
+ --------------------------------------------------
22
+ Dumped 10850 pairs β†’ logs/2026-05-06T15-27-35_test_v32_dual_si_scratch/test_outputs.txt
23
+ Logged 10850 translations to W&B test/translations
24
+ Some weights of RobertaModel were not initialized from the model checkpoint at roberta-large and are newly initialized: ['pooler.dense.bias', 'pooler.dense.weight']
25
+ You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
26
+ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
27
+ ┃ Test metric ┃ DataLoader 0 ┃
28
+ ┑━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
29
+ β”‚ test/bertscore_f1 β”‚ 0.8575076460838318 β”‚
30
+ β”‚ test/bleu1 β”‚ 17.649003982543945 β”‚
31
+ β”‚ test/bleu2 β”‚ 4.52895975112915 β”‚
32
+ β”‚ test/bleu3 β”‚ 1.8570435047149658 β”‚
33
+ β”‚ test/bleu4 β”‚ 0.931571900844574 β”‚
34
+ β”‚ test/bleurt20 β”‚ 0.27966323494911194 β”‚
35
+ β”‚ test/chrf β”‚ 13.139008522033691 β”‚
36
+ β”‚ test/contra_loss β”‚ 0.6187865138053894 β”‚
37
+ β”‚ test/logit_scale β”‚ 27.26032829284668 β”‚
38
+ β”‚ test/rougeL_f1 β”‚ 0.09283461421728134 β”‚
39
+ β”‚ test/rougeL_precision β”‚ 0.0970124751329422 β”‚
40
+ β”‚ test/rougeL_recall β”‚ 0.10088594257831573 β”‚
41
+ β”‚ test/speaker_bleu4_std β”‚ 0.5458764433860779 β”‚
42
+ β”‚ test/visual_feat_std β”‚ 0.07659861445426941 β”‚
43
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
44
+ Testing ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5425/5425 0:35:07 β€’ 0:00:00 2.14it/s
results/spamo/2026-05-06T15-27-35_test_v32_dual_si_scratch/test_outputs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/2026-05-06T15-27-35_test_v32_dual_si_scratch/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"test/translations":{"path":"media/table/test/translations_0_387811b41725bc8e1d5f.table.json","log_mode":"IMMUTABLE","_type":"table-file","size":1025827,"artifact_path":"wandb-client-artifact://58xg70zfxnbeuv86gksioh7q6gn8yun5vdx24k9ekedsugy5yhw8o7zqhqd5su3fs1l712yz0xfxbg91bsogo7e8xjy86746r5zghk5629acno4dnh8nircnnpsfdynl/test/translations.table.json","nrows":10850,"sha256":"387811b41725bc8e1d5f23f4e03bb30caa5580702c30c55e95a2db8f54ae2c29","_latest_artifact_path":"wandb-client-artifact://msij8n3mech9p94vgf1irouh080i4flntmlfoy09wvb1qi9ar7iiezxxzzb7zts3q5zoz20wig3ddgtsp1zfk0wjp83v5ytsl1qt183qvdw38whhiywuqn1vo9ng6od4:latest/test/translations.table.json","ncols":3},"test/contra_loss":0.6187865138053894,"test/bleu2":4.52895975112915,"test/per_speaker_metrics":{"_type":"table-file","size":1880,"log_mode":"IMMUTABLE","_latest_artifact_path":"wandb-client-artifact://83knle219posx65ilznuzp0yq4xi901n98jxgyuue40tq0f3z1sune6eroyb09gpsufojfhqri0hbbbuy56sy3kido2uq3fc006yatcny4kgqd8etr73m6ch1unnljoo:latest/test/per_speaker_metrics.table.json","artifact_path":"wandb-client-artifact://x1zhrlmwfjtg779by5lwye3oc7wk5k4wngqudftfoay43mxld7jmf5vf31wyofz4mdw49f1csaec29vgkgmswmmdak557sjqdqkemd4m9fub3ph9j3hq1lobiqixl19j/test/per_speaker_metrics.table.json","sha256":"9a72b278e43c128a719f32c776bbf3e81fb954e4d7b9e8a541f32a9764eda9c4","path":"media/table/test/per_speaker_metrics_1_9a72b278e43c128a719f.table.json","ncols":4,"nrows":50},"_timestamp":1.7780762212087872e+09,"_wandb":{"runtime":2159},"test/chrf":13.139008522033691,"test/rougeL_recall":0.10088594257831573,"test/bleu1":17.649003982543945,"test/bleu3":1.8570435047149658,"_runtime":2159,"test/speaker_bleu4_std":0.5458764433860779,"test/rougeL_f1":0.09283461421728134,"test/bertscore_f1":0.8575076460838318,"_step":2,"test/bleurt20":0.27966323494911194,"test/bleu4":0.931571900844574,"test/visual_feat_std":0.07659861445426941,"test/logit_scale":27.26032829284668,"trainer/global_step":0,"test/rougeL_precision":0.0970124751329422,"epoch":0}
results/spamo/2026-05-07T04-18-55_test_v33_quad_si_scratch/config.yaml ADDED
@@ -0,0 +1,187 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ _wandb:
2
+ value:
3
+ cli_version: 0.23.1
4
+ e:
5
+ uu1tyz4dykwndmkdjsbnabn2r6s5akvc:
6
+ args:
7
+ - -c
8
+ - configs/finetune_v33_quad_xattn_si_scratch.yaml
9
+ - --ckpt
10
+ - logs/2026-05-06T16-03-46_finetune_v33_quad_xattn_si_scratch/checkpoints/epoch=00026-step=0037530-bleu4=1.06.ckpt
11
+ - -t
12
+ - "False"
13
+ - --test
14
+ - "True"
15
+ - -n
16
+ - test_v33_quad_si_scratch
17
+ - --tags
18
+ - test
19
+ - pjm-si
20
+ - quad
21
+ - scratch
22
+ codePath: main.py
23
+ codePathLocal: main.py
24
+ cpu_count: 12
25
+ cpu_count_logical: 24
26
+ cudaVersion: "12.8"
27
+ disk:
28
+ /:
29
+ total: "1967317549056"
30
+ used: "1680692973568"
31
+ email: s28855@pjwstk.edu.pl
32
+ executable: /home/croco/SpaMo-PJM/.venv/bin/python
33
+ git:
34
+ commit: 4f11b72511d6fd9692336b6b89e43f98e516e01c
35
+ remote: https://github.com/croco-corp/SpaMo-PJM.git
36
+ gpu: NVIDIA GeForce RTX 3090
37
+ gpu_count: 1
38
+ gpu_nvidia:
39
+ - architecture: Ampere
40
+ cudaCores: 10496
41
+ memoryTotal: "25769803776"
42
+ name: NVIDIA GeForce RTX 3090
43
+ uuid: GPU-5c32b58e-e363-6bec-ff14-3d6044d0ae84
44
+ host: lowca-desktop
45
+ memory:
46
+ total: "64894398464"
47
+ os: Linux-6.8.0-110-generic-x86_64-with-glibc2.39
48
+ program: /home/croco/SpaMo-PJM/main.py
49
+ python: CPython 3.10.19
50
+ root: logs/2026-05-07T04-18-55_test_v33_quad_si_scratch
51
+ startedAt: "2026-05-07T02:19:03.025728Z"
52
+ writerId: uu1tyz4dykwndmkdjsbnabn2r6s5akvc
53
+ m:
54
+ - "1": trainer/global_step
55
+ "6":
56
+ - 3
57
+ "7": []
58
+ - "2": '*'
59
+ "5": 1
60
+ "6":
61
+ - 1
62
+ "7": []
63
+ python_version: 3.10.19
64
+ t:
65
+ "1":
66
+ - 1
67
+ - 9
68
+ - 11
69
+ - 49
70
+ - 71
71
+ - 98
72
+ - 103
73
+ "2":
74
+ - 1
75
+ - 9
76
+ - 11
77
+ - 49
78
+ - 71
79
+ - 98
80
+ - 103
81
+ "3":
82
+ - 7
83
+ - 13
84
+ - 14
85
+ - 15
86
+ - 16
87
+ - 66
88
+ "4": 3.10.19
89
+ "5": 0.23.1
90
+ "6": 4.57.1
91
+ "12": 0.23.1
92
+ "13": linux-x86_64
93
+ alpha:
94
+ value: 1
95
+ aux_input_size:
96
+ value: 2048
97
+ beam_size:
98
+ value: 5
99
+ cache_dir:
100
+ value: /home/croco/.cache/huggingface/hub
101
+ combined_loss:
102
+ value: true
103
+ config_files:
104
+ value:
105
+ - configs/finetune_v33_quad_xattn_si_scratch.yaml
106
+ cross_modal_align:
107
+ value: true
108
+ data:
109
+ value:
110
+ aux_features_path: features/hand_vit_feat_pjm.h5
111
+ batch_size: 2
112
+ device: cuda
113
+ keypoint_features_path: features/mediapipe_feat_pjm.h5
114
+ max_frame_length: 512
115
+ motion_features_path: features/mae_feat_pjm.h5
116
+ multilang_path: features/texts_multilang_pjm.h5
117
+ num_workers: 4
118
+ set_to_test: test
119
+ target_lang: English
120
+ test_split_path: /home/croco/CrocoSign/data/split_test.csv
121
+ texts_path: features/texts_eng.h5
122
+ train_split_path: /home/croco/CrocoSign/data/split_train.csv
123
+ val_split_path: /home/croco/CrocoSign/data/split_val.csv
124
+ visual_features_path: features/vit_feat_pjm.h5
125
+ evaluation:
126
+ value: mse
127
+ frame_sample_rate:
128
+ value: 1
129
+ fusion_dropout:
130
+ value: 0.3
131
+ fusion_lr:
132
+ value: 1e-05
133
+ fusion_mode:
134
+ value: joint
135
+ input_size:
136
+ value: 2048
137
+ inter_hidden:
138
+ value: 768
139
+ keypoint_dim:
140
+ value: 258
141
+ lora_alpha:
142
+ value: 32
143
+ lora_dropout:
144
+ value: 0.1
145
+ lora_r:
146
+ value: 16
147
+ lr:
148
+ value: 0.0001
149
+ lr_patience:
150
+ value: 5
151
+ lr_scheduler_mode:
152
+ value: max
153
+ max_frame_len:
154
+ value: 512
155
+ max_txt_len:
156
+ value: 64
157
+ model_name:
158
+ value: google/flan-t5-xl
159
+ monitor:
160
+ value: val/bleu4
161
+ motion_input_size:
162
+ value: 1024
163
+ new_stream_lr:
164
+ value: 0.0001
165
+ num_in_context:
166
+ value: 3
167
+ prompt:
168
+ value: Translate the given sentence into {}.
169
+ queue_size:
170
+ value: 0
171
+ scheduler_config:
172
+ value:
173
+ params:
174
+ lr_max: 1
175
+ lr_min: 0.1
176
+ lr_start: 0
177
+ max_decay_steps: 40000
178
+ warm_up_steps: 1000
179
+ target: spamo.lr_scheduler.LambdaWarmUpCosineScheduler
180
+ seed:
181
+ value: 0
182
+ tuning_type:
183
+ value: lora
184
+ use_in_context:
185
+ value: true
186
+ warm_up_steps:
187
+ value: 0
results/spamo/2026-05-07T04-18-55_test_v33_quad_si_scratch/output.log ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Restoring states from the checkpoint path at logs/2026-05-06T16-03-46_finetune_v33_quad_xattn_si_scratch/checkpoints/epoch=00026-step=0037530-bleu4=1.06.ckpt
2
+ /home/croco/SpaMo-PJM/.venv/lib/python3.10/site-packages/pytorch_lightning/trainer/call.py:283: Be aware that when using `ckpt_path`, callbacks used to create the checkpoint need to be provided during `Trainer` instantiation. Please add the following callbacks: ["ModelCheckpoint{'monitor': 'val/bleu4', 'mode': 'max', 'every_n_train_steps': 0, 'every_n_epochs': 1, 'train_time_interval': None}", "EarlyStopping{'monitor': 'val/bleu4', 'mode': 'max'}"].
3
+ LOCAL_RANK: 0 - CUDA_VISIBLE_DEVICES: [0]
4
+ Loaded model weights from the checkpoint at logs/2026-05-06T16-03-46_finetune_v33_quad_xattn_si_scratch/checkpoints/epoch=00026-step=0037530-bleu4=1.06.ckpt
5
+ /home/croco/.local/share/uv/python/cpython-3.10.19-linux-x86_64-gnu/lib/python3.10/contextlib.py:103: FutureWarning: `torch.backends.cuda.sdp_kernel()` is deprecated. In the future, this context manager will be removed. Please see `torch.nn.attention.sdpa_kernel()` for the new context manager, with updated signature.
6
+ self.gen = func(*args, **kwds)
7
+
8
+ ===== Validation Examples =====
9
+ Reference: the same for the entire month.
10
+ Generated: he threw a stone, threw a stone, and threw a second time.
11
+ --------------------------------------------------
12
+ Reference: either way.
13
+ Generated: he threw it away.
14
+ --------------------------------------------------
15
+ Reference: what do you want to do? think about what you will do at home.
16
+ Generated: a fish swims in a glass spherical aquarium.
17
+ --------------------------------------------------
18
+ Reference: don't you want to?
19
+ Generated: i know, i know.
20
+ --------------------------------------------------
21
+ Reference: february two thousand and eleven?
22
+ Generated: he has a bicycle and a bag of berries.
23
+ --------------------------------------------------
24
+ Dumped 10850 pairs β†’ logs/2026-05-07T04-18-55_test_v33_quad_si_scratch/test_outputs.txt
25
+ Logged 10850 translations to W&B test/translations
26
+ Some weights of RobertaModel were not initialized from the model checkpoint at roberta-large and are newly initialized: ['pooler.dense.bias', 'pooler.dense.weight']
27
+ You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
28
+ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
29
+ ┃ Test metric ┃ DataLoader 0 ┃
30
+ ┑━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
31
+ β”‚ test/bertscore_f1 β”‚ 0.8603217005729675 β”‚
32
+ β”‚ test/bleu1 β”‚ 18.782516479492188 β”‚
33
+ β”‚ test/bleu2 β”‚ 5.233978271484375 β”‚
34
+ β”‚ test/bleu3 β”‚ 2.2732200622558594 β”‚
35
+ β”‚ test/bleu4 β”‚ 1.171427607536316 β”‚
36
+ β”‚ test/bleurt20 β”‚ 0.2767305076122284 β”‚
37
+ β”‚ test/chrf β”‚ 14.138314247131348 β”‚
38
+ β”‚ test/contra_loss β”‚ 0.8353700041770935 β”‚
39
+ β”‚ test/logit_scale β”‚ 47.965736389160156 β”‚
40
+ β”‚ test/rougeL_f1 β”‚ 0.10122055560350418 β”‚
41
+ β”‚ test/rougeL_precision β”‚ 0.10573126375675201 β”‚
42
+ β”‚ test/rougeL_recall β”‚ 0.11064910143613815 β”‚
43
+ β”‚ test/speaker_bleu4_std β”‚ 0.618619441986084 β”‚
44
+ β”‚ test/visual_feat_std β”‚ 0.07244817912578583 β”‚
45
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
46
+ Testing ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5425/5425 0:33:53 β€’ 0:00:00 2.21it/s
results/spamo/2026-05-07T04-18-55_test_v33_quad_si_scratch/test_outputs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/2026-05-07T04-18-55_test_v33_quad_si_scratch/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"test/translations":{"nrows":10850,"size":1018948,"sha256":"0a844f0903aa394add41af19026cc9793cbb9e7de575dcfe1d8770129b729820","log_mode":"IMMUTABLE","ncols":3,"_type":"table-file","artifact_path":"wandb-client-artifact://58xg70zfxnbeuv86gksioh7q6gn8yun5vdx24k9ekedsugy5yhw8o7zqhqd5su3fs1l712yz0xfxbg91bsogo7e8xjy86746r5zghk5629acno4dnh8nircnnpsfdynl/test/translations.table.json","path":"media/table/test/translations_0_0a844f0903aa394add41.table.json","_latest_artifact_path":"wandb-client-artifact://msij8n3mech9p94vgf1irouh080i4flntmlfoy09wvb1qi9ar7iiezxxzzb7zts3q5zoz20wig3ddgtsp1zfk0wjp83v5ytsl1qt183qvdw38whhiywuqn1vo9ng6od4:latest/test/translations.table.json"},"test/rougeL_precision":0.10573126375675201,"_runtime":2085,"test/bleurt20":0.2767305076122284,"test/bleu2":5.233978271484375,"test/visual_feat_std":0.07244817912578583,"test/rougeL_f1":0.10122055560350418,"test/bertscore_f1":0.8603217005729675,"test/contra_loss":0.8353700041770935,"_step":2,"test/bleu4":1.171427607536316,"test/chrf":14.138314247131348,"epoch":0,"test/logit_scale":47.965736389160156,"_timestamp":1.778122428197583e+09,"test/rougeL_recall":0.11064910143613815,"trainer/global_step":0,"test/speaker_bleu4_std":0.618619441986084,"_wandb":{"runtime":2085},"test/bleu1":18.782516479492188,"test/per_speaker_metrics":{"nrows":50,"ncols":4,"path":"media/table/test/per_speaker_metrics_1_e21b9e6f88eeb8e74514.table.json","sha256":"e21b9e6f88eeb8e745148c6bd23982d36056c512212bd05f297d0e1237838c5d","artifact_path":"wandb-client-artifact://x1zhrlmwfjtg779by5lwye3oc7wk5k4wngqudftfoay43mxld7jmf5vf31wyofz4mdw49f1csaec29vgkgmswmmdak557sjqdqkemd4m9fub3ph9j3hq1lobiqixl19j/test/per_speaker_metrics.table.json","log_mode":"IMMUTABLE","_type":"table-file","size":1885,"_latest_artifact_path":"wandb-client-artifact://83knle219posx65ilznuzp0yq4xi901n98jxgyuue40tq0f3z1sune6eroyb09gpsufojfhqri0hbbbuy56sy3kido2uq3fc006yatcny4kgqd8etr73m6ch1unnljoo:latest/test/per_speaker_metrics.table.json"},"test/bleu3":2.2732200622558594}
results/spamo/2026-10-31T07-09-05_test_upstream_pjm_si_dual/bleurt_BLEURT-20.json ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/2026-10-31T07-09-05_test_upstream_pjm_si_dual/test_outputs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/2026-10-31T15-20-57_test_v27_quad_si_filtered/bleurt_BLEURT-20.json ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/2026-10-31T15-20-57_test_v27_quad_si_filtered/test_outputs.txt ADDED
The diff for this file is too large to render. See raw diff
 
results/spamo/finetune_pjm_ms.log.gz ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eddc4f15703e0e13c31ab93f0e03bbb90a2376dda4e95199be33286af7ba4ec4
3
+ size 7779250