Legal_GQA_BERT1000

This model was trained from scratch on the None dataset. It achieves the following results on the evaluation set:

• Loss: 8.1875

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 32
• eval_batch_size: 4
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 1000

Training results

Training Loss	Epoch	Step	Validation Loss
No log	1.0	5	3.9743
No log	2.0	10	3.5372
No log	3.0	15	3.4254
No log	4.0	20	3.5207
No log	5.0	25	3.5558
No log	6.0	30	3.9697
No log	7.0	35	4.2918
No log	8.0	40	4.6181
No log	9.0	45	4.7107
No log	10.0	50	4.8748
No log	11.0	55	5.2327
No log	12.0	60	5.6292
No log	13.0	65	5.8671
No log	14.0	70	5.6838
No log	15.0	75	5.5434
No log	16.0	80	5.9402
No log	17.0	85	5.8799
No log	18.0	90	6.4195
No log	19.0	95	6.4886
No log	20.0	100	6.3513
No log	21.0	105	6.4612
No log	22.0	110	6.4754
No log	23.0	115	6.4456
No log	24.0	120	7.0586
No log	25.0	125	7.0618
No log	26.0	130	6.9459
No log	27.0	135	6.8421
No log	28.0	140	6.5651
No log	29.0	145	6.9905
No log	30.0	150	6.3596
No log	31.0	155	7.0807
No log	32.0	160	7.1982
No log	33.0	165	7.3955
No log	34.0	170	7.4059
No log	35.0	175	7.4678
No log	36.0	180	7.6056
No log	37.0	185	6.9081
No log	38.0	190	7.6481
No log	39.0	195	7.2091
No log	40.0	200	7.0908
No log	41.0	205	7.5022
No log	42.0	210	6.9420
No log	43.0	215	7.4599
No log	44.0	220	7.3581
No log	45.0	225	7.2576
No log	46.0	230	7.5230
No log	47.0	235	7.5638
No log	48.0	240	7.5331
No log	49.0	245	6.9412
No log	50.0	250	7.2134
No log	51.0	255	7.6715
No log	52.0	260	7.3006
No log	53.0	265	7.2024
No log	54.0	270	7.5210
No log	55.0	275	8.0935
No log	56.0	280	7.9519
No log	57.0	285	7.4438
No log	58.0	290	7.2827
No log	59.0	295	7.0894
No log	60.0	300	7.6032
No log	61.0	305	8.0517
No log	62.0	310	7.5937
No log	63.0	315	6.9395
No log	64.0	320	7.0522
No log	65.0	325	7.5948
No log	66.0	330	7.9039
No log	67.0	335	8.2209
No log	68.0	340	7.7581
No log	69.0	345	8.1243
No log	70.0	350	8.0726
No log	71.0	355	7.6872
No log	72.0	360	7.0063
No log	73.0	365	6.5753
No log	74.0	370	7.6136
No log	75.0	375	7.9254
No log	76.0	380	7.7021
No log	77.0	385	7.5406
No log	78.0	390	7.5491
No log	79.0	395	7.4915
No log	80.0	400	7.5097
No log	81.0	405	7.9212
No log	82.0	410	7.9283
No log	83.0	415	8.0748
No log	84.0	420	7.7280
No log	85.0	425	7.2118
No log	86.0	430	6.8779
No log	87.0	435	6.9110
No log	88.0	440	7.0416
No log	89.0	445	7.3057
No log	90.0	450	7.6491
No log	91.0	455	7.5459
No log	92.0	460	7.3228
No log	93.0	465	7.2695
No log	94.0	470	7.8725
No log	95.0	475	7.7156
No log	96.0	480	7.5736
No log	97.0	485	7.3761
No log	98.0	490	7.2304
No log	99.0	495	7.1071
0.2269	100.0	500	6.9306
0.2269	101.0	505	7.2086
0.2269	102.0	510	7.6169
0.2269	103.0	515	8.1745
0.2269	104.0	520	8.0064
0.2269	105.0	525	7.7911
0.2269	106.0	530	7.4022
0.2269	107.0	535	7.0566
0.2269	108.0	540	7.2674
0.2269	109.0	545	7.7018
0.2269	110.0	550	7.8705
0.2269	111.0	555	7.8524
0.2269	112.0	560	7.3932
0.2269	113.0	565	6.8269
0.2269	114.0	570	7.2616
0.2269	115.0	575	7.6497
0.2269	116.0	580	7.7979
0.2269	117.0	585	7.4772
0.2269	118.0	590	7.1395
0.2269	119.0	595	7.3239
0.2269	120.0	600	7.2565
0.2269	121.0	605	7.3059
0.2269	122.0	610	7.3107
0.2269	123.0	615	7.2712
0.2269	124.0	620	7.7671
0.2269	125.0	625	7.7734
0.2269	126.0	630	7.6092
0.2269	127.0	635	7.3898
0.2269	128.0	640	7.4747
0.2269	129.0	645	7.6096
0.2269	130.0	650	7.7822
0.2269	131.0	655	8.0582
0.2269	132.0	660	8.0955
0.2269	133.0	665	8.0012
0.2269	134.0	670	7.6445
0.2269	135.0	675	7.8296
0.2269	136.0	680	7.9571
0.2269	137.0	685	7.8609
0.2269	138.0	690	7.1324
0.2269	139.0	695	7.1330
0.2269	140.0	700	7.4522
0.2269	141.0	705	7.6582
0.2269	142.0	710	7.7165
0.2269	143.0	715	7.6934
0.2269	144.0	720	7.6916
0.2269	145.0	725	7.6940
0.2269	146.0	730	7.6455
0.2269	147.0	735	7.5148
0.2269	148.0	740	7.1121
0.2269	149.0	745	7.5019
0.2269	150.0	750	7.6891
0.2269	151.0	755	7.2418
0.2269	152.0	760	6.8392
0.2269	153.0	765	6.9463
0.2269	154.0	770	7.8955
0.2269	155.0	775	8.4044
0.2269	156.0	780	8.3787
0.2269	157.0	785	7.9366
0.2269	158.0	790	7.7610
0.2269	159.0	795	7.6725
0.2269	160.0	800	7.6167
0.2269	161.0	805	7.7071
0.2269	162.0	810	7.8047
0.2269	163.0	815	8.2038
0.2269	164.0	820	8.4593
0.2269	165.0	825	8.1716
0.2269	166.0	830	7.7754
0.2269	167.0	835	7.5142
0.2269	168.0	840	7.3776
0.2269	169.0	845	7.2984
0.2269	170.0	850	7.2359
0.2269	171.0	855	7.3082
0.2269	172.0	860	7.5800
0.2269	173.0	865	7.7336
0.2269	174.0	870	7.9577
0.2269	175.0	875	7.9004
0.2269	176.0	880	7.7436
0.2269	177.0	885	7.6707
0.2269	178.0	890	7.6256
0.2269	179.0	895	7.4739
0.2269	180.0	900	7.2640
0.2269	181.0	905	7.1892
0.2269	182.0	910	7.2558
0.2269	183.0	915	7.1922
0.2269	184.0	920	7.2135
0.2269	185.0	925	7.2850
0.2269	186.0	930	7.3150
0.2269	187.0	935	7.3337
0.2269	188.0	940	7.5405
0.2269	189.0	945	7.5892
0.2269	190.0	950	7.3344
0.2269	191.0	955	7.1228
0.2269	192.0	960	7.2493
0.2269	193.0	965	7.5115
0.2269	194.0	970	7.4463
0.2269	195.0	975	7.3382
0.2269	196.0	980	7.2726
0.2269	197.0	985	7.2558
0.2269	198.0	990	7.2353
0.2269	199.0	995	7.2022
0.0008	200.0	1000	7.1997
0.0008	201.0	1005	7.2157
0.0008	202.0	1010	7.2645
0.0008	203.0	1015	7.1960
0.0008	204.0	1020	7.1602
0.0008	205.0	1025	7.1455
0.0008	206.0	1030	7.1423
0.0008	207.0	1035	7.1524
0.0008	208.0	1040	7.1748
0.0008	209.0	1045	7.1960
0.0008	210.0	1050	7.2078
0.0008	211.0	1055	7.1741
0.0008	212.0	1060	7.9340
0.0008	213.0	1065	8.2643
0.0008	214.0	1070	8.1466
0.0008	215.0	1075	7.6816
0.0008	216.0	1080	8.5650
0.0008	217.0	1085	8.8665
0.0008	218.0	1090	8.0790
0.0008	219.0	1095	7.4438
0.0008	220.0	1100	7.2700
0.0008	221.0	1105	7.9172
0.0008	222.0	1110	8.0576
0.0008	223.0	1115	7.8573
0.0008	224.0	1120	7.5522
0.0008	225.0	1125	6.9782
0.0008	226.0	1130	7.1503
0.0008	227.0	1135	7.4730
0.0008	228.0	1140	7.9370
0.0008	229.0	1145	7.7869
0.0008	230.0	1150	7.0022
0.0008	231.0	1155	6.6475
0.0008	232.0	1160	7.2424
0.0008	233.0	1165	7.8082
0.0008	234.0	1170	7.4245
0.0008	235.0	1175	6.8436
0.0008	236.0	1180	6.5346
0.0008	237.0	1185	6.3053
0.0008	238.0	1190	6.4380
0.0008	239.0	1195	7.2193
0.0008	240.0	1200	7.6425
0.0008	241.0	1205	7.6422
0.0008	242.0	1210	7.3299
0.0008	243.0	1215	7.3236
0.0008	244.0	1220	7.2895
0.0008	245.0	1225	7.2075
0.0008	246.0	1230	6.7947
0.0008	247.0	1235	6.3677
0.0008	248.0	1240	6.7713
0.0008	249.0	1245	7.0393
0.0008	250.0	1250	7.1133
0.0008	251.0	1255	7.1206
0.0008	252.0	1260	6.7066
0.0008	253.0	1265	6.4519
0.0008	254.0	1270	6.3316
0.0008	255.0	1275	6.4723
0.0008	256.0	1280	7.1585
0.0008	257.0	1285	7.4964
0.0008	258.0	1290	7.0122
0.0008	259.0	1295	6.3236
0.0008	260.0	1300	6.0201
0.0008	261.0	1305	6.0107
0.0008	262.0	1310	6.9438
0.0008	263.0	1315	7.4045
0.0008	264.0	1320	7.4676
0.0008	265.0	1325	7.3376
0.0008	266.0	1330	7.1473
0.0008	267.0	1335	6.7904
0.0008	268.0	1340	6.3593
0.0008	269.0	1345	6.1926
0.0008	270.0	1350	6.4038
0.0008	271.0	1355	7.1407
0.0008	272.0	1360	7.7933
0.0008	273.0	1365	8.0508
0.0008	274.0	1370	8.1024
0.0008	275.0	1375	8.0394
0.0008	276.0	1380	7.8654
0.0008	277.0	1385	7.3339
0.0008	278.0	1390	6.6394
0.0008	279.0	1395	6.3018
0.0008	280.0	1400	6.4279
0.0008	281.0	1405	6.6617
0.0008	282.0	1410	6.8492
0.0008	283.0	1415	6.9763
0.0008	284.0	1420	6.9586
0.0008	285.0	1425	6.9465
0.0008	286.0	1430	6.9751
0.0008	287.0	1435	6.9967
0.0008	288.0	1440	6.9526
0.0008	289.0	1445	7.2242
0.0008	290.0	1450	7.4093
0.0008	291.0	1455	7.4869
0.0008	292.0	1460	7.4688
0.0008	293.0	1465	7.4282
0.0008	294.0	1470	7.3745
0.0008	295.0	1475	7.2768
0.0008	296.0	1480	7.0427
0.0008	297.0	1485	6.8857
0.0008	298.0	1490	6.8009
0.0008	299.0	1495	6.7757
0.0016	300.0	1500	6.7695
0.0016	301.0	1505	6.8204
0.0016	302.0	1510	6.8644
0.0016	303.0	1515	6.9037
0.0016	304.0	1520	6.9387
0.0016	305.0	1525	6.9556
0.0016	306.0	1530	6.9667
0.0016	307.0	1535	6.9767
0.0016	308.0	1540	6.9847
0.0016	309.0	1545	6.9937
0.0016	310.0	1550	7.0039
0.0016	311.0	1555	7.0099
0.0016	312.0	1560	7.0131
0.0016	313.0	1565	7.0060
0.0016	314.0	1570	7.0075
0.0016	315.0	1575	6.9711
0.0016	316.0	1580	6.9077
0.0016	317.0	1585	6.8807
0.0016	318.0	1590	6.8715
0.0016	319.0	1595	7.0453
0.0016	320.0	1600	7.1296
0.0016	321.0	1605	7.1700
0.0016	322.0	1610	7.1957
0.0016	323.0	1615	7.2246
0.0016	324.0	1620	7.2203
0.0016	325.0	1625	7.1906
0.0016	326.0	1630	7.1123
0.0016	327.0	1635	7.0487
0.0016	328.0	1640	7.0754
0.0016	329.0	1645	7.0720
0.0016	330.0	1650	7.7359
0.0016	331.0	1655	8.1144
0.0016	332.0	1660	8.1948
0.0016	333.0	1665	7.6789
0.0016	334.0	1670	7.2641
0.0016	335.0	1675	7.0059
0.0016	336.0	1680	6.8664
0.0016	337.0	1685	7.6781
0.0016	338.0	1690	8.2166
0.0016	339.0	1695	8.2097
0.0016	340.0	1700	8.0633
0.0016	341.0	1705	7.7949
0.0016	342.0	1710	7.6837
0.0016	343.0	1715	8.0097
0.0016	344.0	1720	8.5007
0.0016	345.0	1725	8.7010
0.0016	346.0	1730	8.0451
0.0016	347.0	1735	7.6189
0.0016	348.0	1740	7.4604
0.0016	349.0	1745	7.5163
0.0016	350.0	1750	7.5746
0.0016	351.0	1755	7.4632
0.0016	352.0	1760	7.1102
0.0016	353.0	1765	6.4877
0.0016	354.0	1770	6.3033
0.0016	355.0	1775	6.6979
0.0016	356.0	1780	7.0705
0.0016	357.0	1785	7.3203
0.0016	358.0	1790	7.4830
0.0016	359.0	1795	7.6461
0.0016	360.0	1800	7.7119
0.0016	361.0	1805	7.5914
0.0016	362.0	1810	7.3182
0.0016	363.0	1815	7.3903
0.0016	364.0	1820	8.0079
0.0016	365.0	1825	8.0597
0.0016	366.0	1830	7.8428
0.0016	367.0	1835	7.5143
0.0016	368.0	1840	7.2284
0.0016	369.0	1845	7.0162
0.0016	370.0	1850	6.8926
0.0016	371.0	1855	7.3822
0.0016	372.0	1860	7.8967
0.0016	373.0	1865	8.0392
0.0016	374.0	1870	7.9983
0.0016	375.0	1875	7.8815
0.0016	376.0	1880	7.8492
0.0016	377.0	1885	7.8035
0.0016	378.0	1890	7.4683
0.0016	379.0	1895	7.3420
0.0016	380.0	1900	7.3416
0.0016	381.0	1905	7.3430
0.0016	382.0	1910	7.2376
0.0016	383.0	1915	7.1507
0.0016	384.0	1920	7.0881
0.0016	385.0	1925	7.0704
0.0016	386.0	1930	7.0555
0.0016	387.0	1935	7.0502
0.0016	388.0	1940	7.0534
0.0016	389.0	1945	7.0915
0.0016	390.0	1950	7.1284
0.0016	391.0	1955	7.1272
0.0016	392.0	1960	7.1419
0.0016	393.0	1965	7.1658
0.0016	394.0	1970	7.1974
0.0016	395.0	1975	7.2366
0.0016	396.0	1980	7.3965
0.0016	397.0	1985	7.5398
0.0016	398.0	1990	7.5613
0.0016	399.0	1995	7.5672
0.0005	400.0	2000	7.5680
0.0005	401.0	2005	7.5623
0.0005	402.0	2010	7.5433
0.0005	403.0	2015	7.5265
0.0005	404.0	2020	7.4945
0.0005	405.0	2025	7.4549
0.0005	406.0	2030	7.4577
0.0005	407.0	2035	7.4779
0.0005	408.0	2040	7.4891
0.0005	409.0	2045	7.4967
0.0005	410.0	2050	7.4107
0.0005	411.0	2055	7.1431
0.0005	412.0	2060	7.0035
0.0005	413.0	2065	6.9515
0.0005	414.0	2070	7.8803
0.0005	415.0	2075	8.3234
0.0005	416.0	2080	8.2208
0.0005	417.0	2085	7.7650
0.0005	418.0	2090	7.4476
0.0005	419.0	2095	7.2501
0.0005	420.0	2100	7.1334
0.0005	421.0	2105	7.0705
0.0005	422.0	2110	7.1738
0.0005	423.0	2115	7.5227
0.0005	424.0	2120	7.6620
0.0005	425.0	2125	7.6966
0.0005	426.0	2130	7.6232
0.0005	427.0	2135	7.8679
0.0005	428.0	2140	8.0675
0.0005	429.0	2145	8.1644
0.0005	430.0	2150	8.1593
0.0005	431.0	2155	7.9555
0.0005	432.0	2160	7.7445
0.0005	433.0	2165	7.6033
0.0005	434.0	2170	7.4350
0.0005	435.0	2175	7.0173
0.0005	436.0	2180	6.6588
0.0005	437.0	2185	6.4948
0.0005	438.0	2190	6.5824
0.0005	439.0	2195	7.6368
0.0005	440.0	2200	8.1728
0.0005	441.0	2205	8.2726
0.0005	442.0	2210	7.7469
0.0005	443.0	2215	7.2934
0.0005	444.0	2220	7.5596
0.0005	445.0	2225	8.1491
0.0005	446.0	2230	8.3301
0.0005	447.0	2235	8.2448
0.0005	448.0	2240	7.8104
0.0005	449.0	2245	7.9229
0.0005	450.0	2250	8.1022
0.0005	451.0	2255	8.0934
0.0005	452.0	2260	7.7094
0.0005	453.0	2265	7.4145
0.0005	454.0	2270	7.2390
0.0005	455.0	2275	7.1232
0.0005	456.0	2280	7.0217
0.0005	457.0	2285	6.9630
0.0005	458.0	2290	6.9990
0.0005	459.0	2295	7.0975
0.0005	460.0	2300	7.2731
0.0005	461.0	2305	7.3999
0.0005	462.0	2310	7.4908
0.0005	463.0	2315	7.5303
0.0005	464.0	2320	7.5396
0.0005	465.0	2325	7.7371
0.0005	466.0	2330	7.9230
0.0005	467.0	2335	7.8567
0.0005	468.0	2340	7.6849
0.0005	469.0	2345	7.4645
0.0005	470.0	2350	7.2725
0.0005	471.0	2355	7.1459
0.0005	472.0	2360	7.0676
0.0005	473.0	2365	7.0132
0.0005	474.0	2370	7.2372
0.0005	475.0	2375	7.3722
0.0005	476.0	2380	7.4377
0.0005	477.0	2385	7.4674
0.0005	478.0	2390	7.5110
0.0005	479.0	2395	7.5325
0.0005	480.0	2400	7.5274
0.0005	481.0	2405	7.4662
0.0005	482.0	2410	7.4494
0.0005	483.0	2415	7.4524
0.0005	484.0	2420	7.4031
0.0005	485.0	2425	7.3314
0.0005	486.0	2430	7.2969
0.0005	487.0	2435	7.2840
0.0005	488.0	2440	7.2786
0.0005	489.0	2445	7.2734
0.0005	490.0	2450	7.2686
0.0005	491.0	2455	7.2638
0.0005	492.0	2460	7.2776
0.0005	493.0	2465	7.2766
0.0005	494.0	2470	7.2540
0.0005	495.0	2475	7.2411
0.0005	496.0	2480	7.2265
0.0005	497.0	2485	7.2093
0.0005	498.0	2490	7.1993
0.0005	499.0	2495	7.1873
0.0003	500.0	2500	7.2056
0.0003	501.0	2505	7.1856
0.0003	502.0	2510	7.1596
0.0003	503.0	2515	7.1560
0.0003	504.0	2520	7.1538
0.0003	505.0	2525	7.1515
0.0003	506.0	2530	7.1467
0.0003	507.0	2535	7.1436
0.0003	508.0	2540	7.1430
0.0003	509.0	2545	7.1430
0.0003	510.0	2550	7.1457
0.0003	511.0	2555	7.1455
0.0003	512.0	2560	7.1454
0.0003	513.0	2565	7.1502
0.0003	514.0	2570	7.1590
0.0003	515.0	2575	7.1663
0.0003	516.0	2580	7.1721
0.0003	517.0	2585	7.3175
0.0003	518.0	2590	7.4024
0.0003	519.0	2595	7.4591
0.0003	520.0	2600	7.5005
0.0003	521.0	2605	7.5190
0.0003	522.0	2610	7.5244
0.0003	523.0	2615	7.5142
0.0003	524.0	2620	7.5016
0.0003	525.0	2625	7.4944
0.0003	526.0	2630	7.4822
0.0003	527.0	2635	7.4619
0.0003	528.0	2640	7.4452
0.0003	529.0	2645	7.4272
0.0003	530.0	2650	7.4127
0.0003	531.0	2655	7.3964
0.0003	532.0	2660	7.3839
0.0003	533.0	2665	7.3774
0.0003	534.0	2670	7.3751
0.0003	535.0	2675	7.3757
0.0003	536.0	2680	7.3995
0.0003	537.0	2685	7.5061
0.0003	538.0	2690	7.6753
0.0003	539.0	2695	7.8693
0.0003	540.0	2700	7.9629
0.0003	541.0	2705	7.9955
0.0003	542.0	2710	7.9871
0.0003	543.0	2715	7.9481
0.0003	544.0	2720	7.8922
0.0003	545.0	2725	7.8483
0.0003	546.0	2730	7.7363
0.0003	547.0	2735	7.6099
0.0003	548.0	2740	7.5148
0.0003	549.0	2745	7.4265
0.0003	550.0	2750	7.3395
0.0003	551.0	2755	7.2852
0.0003	552.0	2760	7.2260
0.0003	553.0	2765	7.1631
0.0003	554.0	2770	7.0940
0.0003	555.0	2775	7.0527
0.0003	556.0	2780	7.0263
0.0003	557.0	2785	7.0268
0.0003	558.0	2790	7.0415
0.0003	559.0	2795	7.0553
0.0003	560.0	2800	7.0820
0.0003	561.0	2805	7.0881
0.0003	562.0	2810	7.1004
0.0003	563.0	2815	7.1222
0.0003	564.0	2820	7.1388
0.0003	565.0	2825	7.1178
0.0003	566.0	2830	7.0618
0.0003	567.0	2835	7.0635
0.0003	568.0	2840	7.0807
0.0003	569.0	2845	7.1122
0.0003	570.0	2850	7.1495
0.0003	571.0	2855	7.4825
0.0003	572.0	2860	7.7928
0.0003	573.0	2865	7.9377
0.0003	574.0	2870	7.9796
0.0003	575.0	2875	7.9407
0.0003	576.0	2880	7.8785
0.0003	577.0	2885	7.7661
0.0003	578.0	2890	7.6202
0.0003	579.0	2895	7.4375
0.0003	580.0	2900	7.3003
0.0003	581.0	2905	7.2421
0.0003	582.0	2910	7.2144
0.0003	583.0	2915	7.2008
0.0003	584.0	2920	7.1943
0.0003	585.0	2925	7.1818
0.0003	586.0	2930	7.1649
0.0003	587.0	2935	7.1678
0.0003	588.0	2940	7.1682
0.0003	589.0	2945	7.1682
0.0003	590.0	2950	7.1820
0.0003	591.0	2955	7.1733
0.0003	592.0	2960	7.1073
0.0003	593.0	2965	7.0944
0.0003	594.0	2970	7.0930
0.0003	595.0	2975	7.0540
0.0003	596.0	2980	7.0093
0.0003	597.0	2985	7.0004
0.0003	598.0	2990	7.0067
0.0003	599.0	2995	7.0881
0.0	600.0	3000	7.1548
0.0	601.0	3005	7.2375
0.0	602.0	3010	7.2878
0.0	603.0	3015	7.3185
0.0	604.0	3020	7.3354
0.0	605.0	3025	7.3406
0.0	606.0	3030	7.3317
0.0	607.0	3035	7.3047
0.0	608.0	3040	7.3201
0.0	609.0	3045	7.3473
0.0	610.0	3050	7.3646
0.0	611.0	3055	7.3762
0.0	612.0	3060	7.4159
0.0	613.0	3065	7.4055
0.0	614.0	3070	7.3618
0.0	615.0	3075	7.3422
0.0	616.0	3080	7.3280
0.0	617.0	3085	7.3244
0.0	618.0	3090	7.3479
0.0	619.0	3095	7.3583
0.0	620.0	3100	7.3661
0.0	621.0	3105	7.3711
0.0	622.0	3110	7.3755
0.0	623.0	3115	7.3852
0.0	624.0	3120	7.3909
0.0	625.0	3125	7.3913
0.0	626.0	3130	7.3942
0.0	627.0	3135	7.3957
0.0	628.0	3140	7.3552
0.0	629.0	3145	7.3116
0.0	630.0	3150	7.2359
0.0	631.0	3155	7.1832
0.0	632.0	3160	7.4450
0.0	633.0	3165	7.8032
0.0	634.0	3170	8.0078
0.0	635.0	3175	8.0751
0.0	636.0	3180	8.1035
0.0	637.0	3185	8.1090
0.0	638.0	3190	8.0995
0.0	639.0	3195	8.0641
0.0	640.0	3200	8.0800
0.0	641.0	3205	8.2266
0.0	642.0	3210	8.2961
0.0	643.0	3215	8.3050
0.0	644.0	3220	8.2454
0.0	645.0	3225	8.0781
0.0	646.0	3230	7.9448
0.0	647.0	3235	8.4501
0.0	648.0	3240	8.8742
0.0	649.0	3245	8.9382
0.0	650.0	3250	8.8590
0.0	651.0	3255	8.7752
0.0	652.0	3260	9.0839
0.0	653.0	3265	9.2408
0.0	654.0	3270	8.7313
0.0	655.0	3275	8.1789
0.0	656.0	3280	7.9457
0.0	657.0	3285	8.2609
0.0	658.0	3290	8.8193
0.0	659.0	3295	8.9991
0.0	660.0	3300	8.9444
0.0	661.0	3305	8.7020
0.0	662.0	3310	8.4658
0.0	663.0	3315	8.1487
0.0	664.0	3320	7.9372
0.0	665.0	3325	7.8059
0.0	666.0	3330	7.7367
0.0	667.0	3335	7.7029
0.0	668.0	3340	7.7040
0.0	669.0	3345	7.7337
0.0	670.0	3350	7.7597
0.0	671.0	3355	7.7904
0.0	672.0	3360	7.8477
0.0	673.0	3365	7.9769
0.0	674.0	3370	8.0324
0.0	675.0	3375	8.0651
0.0	676.0	3380	8.0791
0.0	677.0	3385	8.0787
0.0	678.0	3390	8.0685
0.0	679.0	3395	8.0537
0.0	680.0	3400	8.0366
0.0	681.0	3405	8.0120
0.0	682.0	3410	7.9724
0.0	683.0	3415	7.9284
0.0	684.0	3420	7.9102
0.0	685.0	3425	7.9282
0.0	686.0	3430	7.9453
0.0	687.0	3435	8.0253
0.0	688.0	3440	8.1062
0.0	689.0	3445	8.4114
0.0	690.0	3450	8.6330
0.0	691.0	3455	8.7306
0.0	692.0	3460	8.7663
0.0	693.0	3465	8.7704
0.0	694.0	3470	8.7281
0.0	695.0	3475	8.5414
0.0	696.0	3480	8.4111
0.0	697.0	3485	8.3237
0.0	698.0	3490	8.2621
0.0	699.0	3495	8.2238
0.0003	700.0	3500	8.2110
0.0003	701.0	3505	8.2046
0.0003	702.0	3510	8.2012
0.0003	703.0	3515	8.1988
0.0003	704.0	3520	8.1966
0.0003	705.0	3525	8.1963
0.0003	706.0	3530	8.1990
0.0003	707.0	3535	8.1923
0.0003	708.0	3540	8.1445
0.0003	709.0	3545	8.0983
0.0003	710.0	3550	7.9954
0.0003	711.0	3555	8.1276
0.0003	712.0	3560	8.2012
0.0003	713.0	3565	8.2454
0.0003	714.0	3570	8.1835
0.0003	715.0	3575	8.1445
0.0003	716.0	3580	8.1275
0.0003	717.0	3585	8.1340
0.0003	718.0	3590	8.1430
0.0003	719.0	3595	8.1899
0.0003	720.0	3600	8.3494
0.0003	721.0	3605	8.4368
0.0003	722.0	3610	8.4475
0.0003	723.0	3615	8.4250
0.0003	724.0	3620	8.4015
0.0003	725.0	3625	8.3753
0.0003	726.0	3630	8.3584
0.0003	727.0	3635	8.3282
0.0003	728.0	3640	8.2987
0.0003	729.0	3645	8.2507
0.0003	730.0	3650	8.2132
0.0003	731.0	3655	8.1682
0.0003	732.0	3660	8.1149
0.0003	733.0	3665	8.0639
0.0003	734.0	3670	8.0315
0.0003	735.0	3675	8.0111
0.0003	736.0	3680	8.0127
0.0003	737.0	3685	8.0286
0.0003	738.0	3690	8.0844
0.0003	739.0	3695	8.1191
0.0003	740.0	3700	8.1408
0.0003	741.0	3705	8.1528
0.0003	742.0	3710	8.1587
0.0003	743.0	3715	8.1577
0.0003	744.0	3720	8.1560
0.0003	745.0	3725	8.1390
0.0003	746.0	3730	8.1245
0.0003	747.0	3735	8.0511
0.0003	748.0	3740	7.9951
0.0003	749.0	3745	7.9622
0.0003	750.0	3750	7.9511
0.0003	751.0	3755	7.9444
0.0003	752.0	3760	7.9350
0.0003	753.0	3765	7.9291
0.0003	754.0	3770	7.9111
0.0003	755.0	3775	7.8924
0.0003	756.0	3780	7.8798
0.0003	757.0	3785	7.8645
0.0003	758.0	3790	7.8458
0.0003	759.0	3795	7.8342
0.0003	760.0	3800	7.8409
0.0003	761.0	3805	7.8678
0.0003	762.0	3810	7.8830
0.0003	763.0	3815	7.8976
0.0003	764.0	3820	7.8980
0.0003	765.0	3825	7.8971
0.0003	766.0	3830	7.8976
0.0003	767.0	3835	7.8952
0.0003	768.0	3840	7.8917
0.0003	769.0	3845	7.8917
0.0003	770.0	3850	7.8936
0.0003	771.0	3855	7.8947
0.0003	772.0	3860	7.8918
0.0003	773.0	3865	7.8896
0.0003	774.0	3870	7.8895
0.0003	775.0	3875	7.8923
0.0003	776.0	3880	7.8978
0.0003	777.0	3885	7.9035
0.0003	778.0	3890	7.9438
0.0003	779.0	3895	7.9692
0.0003	780.0	3900	7.9863
0.0003	781.0	3905	7.9950
0.0003	782.0	3910	8.0015
0.0003	783.0	3915	8.0069
0.0003	784.0	3920	8.0109
0.0003	785.0	3925	8.0149
0.0003	786.0	3930	8.0187
0.0003	787.0	3935	8.0199
0.0003	788.0	3940	8.0209
0.0003	789.0	3945	8.0164
0.0003	790.0	3950	7.9772
0.0003	791.0	3955	7.9407
0.0003	792.0	3960	7.9087
0.0003	793.0	3965	7.8911
0.0003	794.0	3970	7.9289
0.0003	795.0	3975	7.9628
0.0003	796.0	3980	7.9680
0.0003	797.0	3985	7.9641
0.0003	798.0	3990	7.9619
0.0003	799.0	3995	7.9623
0.0	800.0	4000	7.9633
0.0	801.0	4005	7.9648
0.0	802.0	4010	7.9798
0.0	803.0	4015	7.9897
0.0	804.0	4020	7.9961
0.0	805.0	4025	7.9887
0.0	806.0	4030	7.9816
0.0	807.0	4035	7.9786
0.0	808.0	4040	7.9777
0.0	809.0	4045	7.9770
0.0	810.0	4050	7.9754
0.0	811.0	4055	7.9729
0.0	812.0	4060	7.9698
0.0	813.0	4065	7.9702
0.0	814.0	4070	7.9739
0.0	815.0	4075	7.9780
0.0	816.0	4080	7.9806
0.0	817.0	4085	7.9826
0.0	818.0	4090	7.9843
0.0	819.0	4095	7.9845
0.0	820.0	4100	7.9863
0.0	821.0	4105	7.9889
0.0	822.0	4110	7.9911
0.0	823.0	4115	7.9917
0.0	824.0	4120	7.9917
0.0	825.0	4125	8.0033
0.0	826.0	4130	8.0243
0.0	827.0	4135	8.0396
0.0	828.0	4140	8.0470
0.0	829.0	4145	8.0425
0.0	830.0	4150	8.0306
0.0	831.0	4155	8.0234
0.0	832.0	4160	8.0166
0.0	833.0	4165	8.0121
0.0	834.0	4170	8.0110
0.0	835.0	4175	8.0115
0.0	836.0	4180	8.0123
0.0	837.0	4185	8.0130
0.0	838.0	4190	8.0135
0.0	839.0	4195	8.0111
0.0	840.0	4200	8.0079
0.0	841.0	4205	8.0060
0.0	842.0	4210	8.0050
0.0	843.0	4215	8.0022
0.0	844.0	4220	8.0029
0.0	845.0	4225	7.9907
0.0	846.0	4230	7.9819
0.0	847.0	4235	7.9792
0.0	848.0	4240	7.9801
0.0	849.0	4245	7.9793
0.0	850.0	4250	7.9804
0.0	851.0	4255	7.9819
0.0	852.0	4260	7.9834
0.0	853.0	4265	7.9841
0.0	854.0	4270	7.9749
0.0	855.0	4275	7.9663
0.0	856.0	4280	7.9615
0.0	857.0	4285	7.9586
0.0	858.0	4290	7.9576
0.0	859.0	4295	7.9592
0.0	860.0	4300	7.9603
0.0	861.0	4305	7.9620
0.0	862.0	4310	7.9653
0.0	863.0	4315	7.9676
0.0	864.0	4320	7.9700
0.0	865.0	4325	7.9705
0.0	866.0	4330	7.9704
0.0	867.0	4335	7.9727
0.0	868.0	4340	7.9742
0.0	869.0	4345	7.9749
0.0	870.0	4350	7.9759
0.0	871.0	4355	7.9768
0.0	872.0	4360	7.9808
0.0	873.0	4365	7.9833
0.0	874.0	4370	7.9846
0.0	875.0	4375	7.9865
0.0	876.0	4380	7.9886
0.0	877.0	4385	7.9896
0.0	878.0	4390	7.9879
0.0	879.0	4395	7.9882
0.0	880.0	4400	7.9908
0.0	881.0	4405	7.9923
0.0	882.0	4410	7.9940
0.0	883.0	4415	8.0049
0.0	884.0	4420	8.0110
0.0	885.0	4425	8.0147
0.0	886.0	4430	8.0186
0.0	887.0	4435	8.0218
0.0	888.0	4440	8.0243
0.0	889.0	4445	8.0263
0.0	890.0	4450	8.0270
0.0	891.0	4455	8.0259
0.0	892.0	4460	8.0262
0.0	893.0	4465	8.0251
0.0	894.0	4470	8.0222
0.0	895.0	4475	8.0264
0.0	896.0	4480	8.0314
0.0	897.0	4485	7.9993
0.0	898.0	4490	7.9422
0.0	899.0	4495	7.9029
0.0	900.0	4500	7.8787
0.0	901.0	4505	7.8649
0.0	902.0	4510	7.8576
0.0	903.0	4515	7.8572
0.0	904.0	4520	7.8583
0.0	905.0	4525	7.8608
0.0	906.0	4530	7.8629
0.0	907.0	4535	7.8646
0.0	908.0	4540	7.8653
0.0	909.0	4545	7.8648
0.0	910.0	4550	7.8648
0.0	911.0	4555	7.8656
0.0	912.0	4560	7.8664
0.0	913.0	4565	7.8673
0.0	914.0	4570	7.8652
0.0	915.0	4575	7.8608
0.0	916.0	4580	7.8587
0.0	917.0	4585	7.8582
0.0	918.0	4590	7.8578
0.0	919.0	4595	7.8576
0.0	920.0	4600	7.8601
0.0	921.0	4605	7.8619
0.0	922.0	4610	7.8625
0.0	923.0	4615	7.8608
0.0	924.0	4620	7.8602
0.0	925.0	4625	7.8618
0.0	926.0	4630	7.8637
0.0	927.0	4635	7.8667
0.0	928.0	4640	7.8688
0.0	929.0	4645	7.8704
0.0	930.0	4650	8.0677
0.0	931.0	4655	8.2072
0.0	932.0	4660	8.2881
0.0	933.0	4665	8.3336
0.0	934.0	4670	8.3598
0.0	935.0	4675	8.3735
0.0	936.0	4680	8.3807
0.0	937.0	4685	8.3839
0.0	938.0	4690	8.3851
0.0	939.0	4695	8.3839
0.0	940.0	4700	8.3757
0.0	941.0	4705	8.3662
0.0	942.0	4710	8.3601
0.0	943.0	4715	8.3562
0.0	944.0	4720	8.3537
0.0	945.0	4725	8.3519
0.0	946.0	4730	8.3451
0.0	947.0	4735	8.3340
0.0	948.0	4740	8.3263
0.0	949.0	4745	8.3216
0.0	950.0	4750	8.3179
0.0	951.0	4755	8.3154
0.0	952.0	4760	8.3134
0.0	953.0	4765	8.3076
0.0	954.0	4770	8.3021
0.0	955.0	4775	8.2970
0.0	956.0	4780	8.2906
0.0	957.0	4785	8.2868
0.0	958.0	4790	8.2843
0.0	959.0	4795	8.2827
0.0	960.0	4800	8.2812
0.0	961.0	4805	8.2718
0.0	962.0	4810	8.2711
0.0	963.0	4815	8.2724
0.0	964.0	4820	8.2733
0.0	965.0	4825	8.2742
0.0	966.0	4830	8.2747
0.0	967.0	4835	8.2738
0.0	968.0	4840	8.2638
0.0	969.0	4845	8.2467
0.0	970.0	4850	8.2368
0.0	971.0	4855	8.2293
0.0	972.0	4860	8.2246
0.0	973.0	4865	8.2216
0.0	974.0	4870	8.2196
0.0	975.0	4875	8.2184
0.0	976.0	4880	8.2176
0.0	977.0	4885	8.2154
0.0	978.0	4890	8.2081
0.0	979.0	4895	8.2039
0.0	980.0	4900	8.2007
0.0	981.0	4905	8.1990
0.0	982.0	4910	8.1961
0.0	983.0	4915	8.1936
0.0	984.0	4920	8.1916
0.0	985.0	4925	8.1905
0.0	986.0	4930	8.1902
0.0	987.0	4935	8.1908
0.0	988.0	4940	8.1911
0.0	989.0	4945	8.1912
0.0	990.0	4950	8.1913
0.0	991.0	4955	8.1912
0.0	992.0	4960	8.1908
0.0	993.0	4965	8.1901
0.0	994.0	4970	8.1888
0.0	995.0	4975	8.1881
0.0	996.0	4980	8.1877
0.0	997.0	4985	8.1876
0.0	998.0	4990	8.1876
0.0	999.0	4995	8.1875
0.0002	1000.0	5000	8.1875

Framework versions

• Transformers 4.36.2
• Pytorch 2.1.2+cu121
• Datasets 2.14.7
• Tokenizers 0.15.0