Buckets:

HCAI-Lab/dolma3-bin-characterization / data /rq4_top_bins_characterized.csv
glennmatlin's picture
download
raw
2.7 kB
rank,bin_label,n_docs,mean_doc_words,first_person_per_1k,second_person_per_1k,third_person_per_1k,mental_state_per_1k,siq_score,gsm_score,diff_siq_gsm
1,Industrial / Documentation,10000,5738.1,1.46,0.61,1.46,0.64,2.9772127518121393e-05,-0.0004348648939238,0.0004646370214419214
2,Health / Documentation,10000,7472.6,1.87,1.95,2.58,1.07,1.883098347146244e-05,-0.000409987728596,0.0004288187120674624
3,Industrial / Legal Notices,10000,5747.9,2.22,0.76,2.26,0.58,1.68463006319441e-05,-0.0002932089823989,0.0003100552830308441
4,Politics / Documentation,10000,6264.2,2.41,1.19,5.13,1.32,5.070578761281386e-06,-0.0002714684345465,0.0002765390133077814
5,Literature / Customer Supp.,10000,244.8,26.89,33.39,9.2,6.22,6.786238984689954e-05,-0.000199476439565,0.00026733882941189956
6,Health / Legal Notices,10000,3730.3,4.27,4.8,3.99,1.4,7.136392072713038e-06,-0.0002493199875263,0.00025645637959901304
7,History / Customer Supp.,7740,288.1,18.0,22.72,5.78,4.28,5.374252196725254e-06,-0.000232446171985,0.00023782042418172525
8,Fashion \& Beauty / Documentation,1065,4516.2,1.89,0.51,1.74,0.71,1.6723062831012714e-05,-0.0002063165682284,0.0002230396310594127
9,Politics / Legal Notices,10000,1937.9,2.4,0.67,4.19,0.7,2.649321631096768e-06,-0.0001846226244372,0.00018727194606829679
10,Sci. \& Tech. / Legal Notices,10000,5285.2,3.02,1.33,2.02,0.92,2.47435649274248e-06,-0.0001809011497371,0.00018337550622984247
11,Food \& Dining / Documentation,8381,4706.1,1.87,1.01,2.13,0.7,6.529804997760112e-06,-0.0001729512029916,0.00017948100798936012
12,Sci. \& Tech. / Documentation,10000,4953.3,2.37,1.44,1.58,0.92,1.3809184656888007e-05,-0.0001617039704817,0.00017551315513858798
13,Home \& Hobbies / Documentation,10000,5151.2,1.38,1.88,1.86,0.69,1.4599568785008454e-05,-0.0001507302654972,0.00016532983428220845
14,Crime \& Law / Documentation,10000,6734.6,2.19,1.85,5.09,1.44,6.159481752778984e-06,-0.0001481924384605,0.000154351920213279
15,Industrial / Structured Data,10000,2074.1,2.94,0.93,1.71,0.61,1.825317973099523e-05,-8.816761717560553e-05,0.00010642079690660075
16,Health / Academic,10000,3307.6,4.58,0.83,5.13,1.83,4.532118140896469e-06,-9.533209383117792e-05,9.986421197207439e-05
17,Industrial / Academic,10000,4655.3,3.24,0.5,4.51,1.57,7.810199439032183e-06,-8.317128346749989e-05,9.098148290653207e-05
18,Politics / Academic,10000,4851.9,6.23,0.9,11.74,3.15,7.857975288725783e-07,-8.112993774972779e-05,8.191573527860037e-05
19,Sports \& Fitness / Documentation,9177,3157.1,2.78,3.07,4.62,1.31,4.7299261286261515e-06,-7.168281663677139e-05,7.641274276539754e-05
20,Crime \& Law / Legal Notices,10000,1767.6,2.35,1.9,4.46,1.04,2.6284910518179496e-07,-7.536606336269287e-05,7.562891246787467e-05

Xet Storage Details

Size:
2.7 kB
·
Xet hash:
257b6902129275af128ffa2cb5d95716512ba045c0ac2fb8dd46c144a68aa35f

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.