trainer: training complete at 2024-03-02 11:16:09.587880.

Browse files

Files changed (4) hide show

README.md +31 -31
meta_data/README_s42_e16.md +31 -31
meta_data/meta_s42_e16_cvi2.json +1 -1
model.safetensors +1 -1

README.md CHANGED Viewed

@@ -17,12 +17,12 @@ model-index:
       name: essays_su_g
       type: essays_su_g
       config: full_labels
-      split: train[20%:40%]
       args: full_labels
     metrics:
     - name: Accuracy
       type: accuracy
-      value: 0.8449945467164623
 ---
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,17 +32,17 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6708
-- B-claim: {'precision': 0.5619047619047619, 'recall': 0.6, 'f1-score': 0.580327868852459, 'support': 295.0}
-- B-majorclaim: {'precision': 0.6789473684210526, 'recall': 0.8269230769230769, 'f1-score': 0.7456647398843931, 'support': 156.0}
-- B-premise: {'precision': 0.7630573248407644, 'recall': 0.8239339752407153, 'f1-score': 0.7923280423280424, 'support': 727.0}
-- I-claim: {'precision': 0.5966467065868264, 'recall': 0.6012551291334781, 'f1-score': 0.5989420533782159, 'support': 4143.0}
-- I-majorclaim: {'precision': 0.7935897435897435, 'recall': 0.8467852257181943, 'f1-score': 0.8193249503639972, 'support': 2193.0}
-- I-premise: {'precision': 0.8916157064692629, 'recall': 0.8820345458887209, 'f1-score': 0.8867992477291825, 'support': 12563.0}
-- O: {'precision': 0.9210893854748603, 'recall': 0.9069744597249508, 'f1-score': 0.9139774302118391, 'support': 10180.0}
-- Accuracy: 0.8450
-- Macro avg: {'precision': 0.7438358567553245, 'recall': 0.7839866303755908, 'f1-score': 0.7624806189640186, 'support': 30257.0}
-- Weighted avg: {'precision': 0.8466380687769368, 'recall': 0.8449945467164623, 'f1-score': 0.8456518702970672, 'support': 30257.0}
 ## Model description
@@ -71,24 +71,24 @@ The following hyperparameters were used during training:
 ### Training results
-| Training Loss | Epoch | Step | Validation Loss | B-claim                                                                                                              | B-majorclaim                                                                                                         | B-premise                                                                                                          | I-claim                                                                                                              | I-majorclaim                                                                                                        | I-premise                                                                                                           | O                                                                                                                   | Accuracy | Macro avg                                                                                                             | Weighted avg                                                                                                        |
-|:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:---------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
-| No log        | 1.0   | 41   | 0.6795          | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 295.0}                                                 | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 156.0}                                                 | {'precision': 0.8727272727272727, 'recall': 0.06602475928473177, 'f1-score': 0.1227621483375959, 'support': 727.0} | {'precision': 0.5111008325624422, 'recall': 0.26671494086410813, 'f1-score': 0.35051546391752586, 'support': 4143.0} | {'precision': 0.4952120383036936, 'recall': 0.16507067943456452, 'f1-score': 0.2476060191518468, 'support': 2193.0} | {'precision': 0.7927029242962558, 'recall': 0.9235055321181247, 'f1-score': 0.8531195999852935, 'support': 12563.0} | {'precision': 0.7493095557484416, 'recall': 0.9328094302554027, 'f1-score': 0.8310506279263117, 'support': 10180.0} | 0.7474   | {'precision': 0.48872180337687227, 'recall': 0.3363036202795617, 'f1-score': 0.34357912275979624, 'support': 30257.0} | {'precision': 0.7080894203665903, 'recall': 0.7473642462901147, 'f1-score': 0.7027223642713039, 'support': 30257.0} |
-| No log        | 2.0   | 82   | 0.5111          | {'precision': 0.6470588235294118, 'recall': 0.07457627118644068, 'f1-score': 0.1337386018237082, 'support': 295.0}   | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 156.0}                                                 | {'precision': 0.6562150055991042, 'recall': 0.8060522696011004, 'f1-score': 0.7234567901234568, 'support': 727.0}  | {'precision': 0.5315296566077004, 'recall': 0.6164615013275404, 'f1-score': 0.5708538220831472, 'support': 4143.0}   | {'precision': 0.5701344243132671, 'recall': 0.8896488828089375, 'f1-score': 0.6949243098842386, 'support': 2193.0}  | {'precision': 0.914638511095204, 'recall': 0.8136591578444639, 'f1-score': 0.861198871056068, 'support': 12563.0}   | {'precision': 0.9145764077767704, 'recall': 0.8918467583497053, 'f1-score': 0.9030685830805192, 'support': 10180.0} | 0.8069   | {'precision': 0.6048789755602082, 'recall': 0.5846064058740269, 'f1-score': 0.5553201397215911, 'support': 30257.0}   | {'precision': 0.8236564850419075, 'recall': 0.8068876623591235, 'f1-score': 0.8086360829977005, 'support': 30257.0} |
-| No log        | 3.0   | 123  | 0.4232          | {'precision': 0.46254071661237783, 'recall': 0.48135593220338985, 'f1-score': 0.47176079734219273, 'support': 295.0} | {'precision': 0.6666666666666666, 'recall': 0.038461538461538464, 'f1-score': 0.07272727272727274, 'support': 156.0} | {'precision': 0.7320341047503045, 'recall': 0.8266850068775791, 'f1-score': 0.7764857881136951, 'support': 727.0}  | {'precision': 0.5594361455922575, 'recall': 0.6418054549843109, 'f1-score': 0.597796762589928, 'support': 4143.0}    | {'precision': 0.7543689320388349, 'recall': 0.7086183310533516, 'f1-score': 0.730778274159417, 'support': 2193.0}   | {'precision': 0.8918637274549098, 'recall': 0.8856164928759054, 'f1-score': 0.8887291317197858, 'support': 12563.0} | {'precision': 0.934092758340114, 'recall': 0.9021611001964637, 'f1-score': 0.9178492904257447, 'support': 10180.0}  | 0.8352   | {'precision': 0.7144290073507807, 'recall': 0.6406719795217912, 'f1-score': 0.6365896167254336, 'support': 30257.0}   | {'precision': 0.841400720911604, 'recall': 0.835244736755131, 'f1-score': 0.836272553745959, 'support': 30257.0}    |
-| No log        | 4.0   | 164  | 0.4295          | {'precision': 0.523972602739726, 'recall': 0.5186440677966102, 'f1-score': 0.5212947189097104, 'support': 295.0}     | {'precision': 0.7076923076923077, 'recall': 0.5897435897435898, 'f1-score': 0.6433566433566433, 'support': 156.0}    | {'precision': 0.7304878048780488, 'recall': 0.8239339752407153, 'f1-score': 0.7744020685197156, 'support': 727.0}  | {'precision': 0.5975518361229079, 'recall': 0.5773594013999517, 'f1-score': 0.5872821016449792, 'support': 4143.0}   | {'precision': 0.7692971108236308, 'recall': 0.8134974920200638, 'f1-score': 0.7907801418439716, 'support': 2193.0}  | {'precision': 0.9042123485285631, 'recall': 0.873119477831728, 'f1-score': 0.8883939418482223, 'support': 12563.0}  | {'precision': 0.8958530581329294, 'recall': 0.9294695481335953, 'f1-score': 0.9123517500723171, 'support': 10180.0} | 0.8412   | {'precision': 0.7327238669883019, 'recall': 0.7322525074523221, 'f1-score': 0.7311230523136514, 'support': 30257.0}   | {'precision': 0.8407365647422267, 'recall': 0.8411607231384473, 'f1-score': 0.8405678153025818, 'support': 30257.0} |
-| No log        | 5.0   | 205  | 0.4565          | {'precision': 0.5276073619631901, 'recall': 0.5830508474576271, 'f1-score': 0.5539452495974235, 'support': 295.0}    | {'precision': 0.7123287671232876, 'recall': 0.6666666666666666, 'f1-score': 0.6887417218543046, 'support': 156.0}    | {'precision': 0.7634146341463415, 'recall': 0.8610729023383769, 'f1-score': 0.8093083387201035, 'support': 727.0}  | {'precision': 0.5808294015396076, 'recall': 0.5645667390779628, 'f1-score': 0.5725826193390453, 'support': 4143.0}   | {'precision': 0.7949438202247191, 'recall': 0.774281805745554, 'f1-score': 0.7844767844767844, 'support': 2193.0}   | {'precision': 0.8697251839615557, 'recall': 0.9219931545013134, 'f1-score': 0.8950967891503419, 'support': 12563.0} | {'precision': 0.9528679881906369, 'recall': 0.887721021611002, 'f1-score': 0.9191415785191211, 'support': 10180.0}  | 0.8447   | {'precision': 0.7431024510213342, 'recall': 0.7513361624855005, 'f1-score': 0.7461847259510178, 'support': 30257.0}   | {'precision': 0.8460194835144224, 'recall': 0.8447301450903923, 'f1-score': 0.8445567746699831, 'support': 30257.0} |
-| No log        | 6.0   | 246  | 0.4916          | {'precision': 0.5593869731800766, 'recall': 0.49491525423728816, 'f1-score': 0.5251798561151079, 'support': 295.0}   | {'precision': 0.6492146596858639, 'recall': 0.7948717948717948, 'f1-score': 0.7146974063400577, 'support': 156.0}    | {'precision': 0.7337278106508875, 'recall': 0.8528198074277854, 'f1-score': 0.7888040712468193, 'support': 727.0}  | {'precision': 0.6394230769230769, 'recall': 0.41733043688148685, 'f1-score': 0.5050387030816416, 'support': 4143.0}  | {'precision': 0.7733443027560675, 'recall': 0.8572731418148655, 'f1-score': 0.8131487889273357, 'support': 2193.0}  | {'precision': 0.8424233805020266, 'recall': 0.9430072434927963, 'f1-score': 0.8898820701569895, 'support': 12563.0} | {'precision': 0.9398688793280066, 'recall': 0.9012770137524558, 'f1-score': 0.9201684886169893, 'support': 10180.0} | 0.8435   | {'precision': 0.7339127261465722, 'recall': 0.7516420989254959, 'f1-score': 0.7367027692121344, 'support': 30257.0}   | {'precision': 0.8360386273187937, 'recall': 0.8434742373665598, 'f1-score': 0.8349273131912464, 'support': 30257.0} |
-| No log        | 7.0   | 287  | 0.5145          | {'precision': 0.5668789808917197, 'recall': 0.6033898305084746, 'f1-score': 0.5845648604269295, 'support': 295.0}    | {'precision': 0.6777777777777778, 'recall': 0.782051282051282, 'f1-score': 0.7261904761904762, 'support': 156.0}     | {'precision': 0.758873929008568, 'recall': 0.8528198074277854, 'f1-score': 0.8031088082901554, 'support': 727.0}   | {'precision': 0.6070287539936102, 'recall': 0.5503258508327299, 'f1-score': 0.5772882643372579, 'support': 4143.0}   | {'precision': 0.7948040510788199, 'recall': 0.8230734154126766, 'f1-score': 0.8086917562724014, 'support': 2193.0}  | {'precision': 0.8718995765275257, 'recall': 0.9177744169386293, 'f1-score': 0.8942490402140614, 'support': 12563.0} | {'precision': 0.9417225373904075, 'recall': 0.8968565815324165, 'f1-score': 0.9187421383647798, 'support': 10180.0} | 0.8482   | {'precision': 0.745569372381204, 'recall': 0.7751844549577135, 'f1-score': 0.7589764777280089, 'support': 30257.0}    | {'precision': 0.8468453317066018, 'recall': 0.8482334666358198, 'f1-score': 0.8468124537513947, 'support': 30257.0} |
-| No log        | 8.0   | 328  | 0.5386          | {'precision': 0.5384615384615384, 'recall': 0.6169491525423729, 'f1-score': 0.5750394944707741, 'support': 295.0}    | {'precision': 0.686046511627907, 'recall': 0.7564102564102564, 'f1-score': 0.7195121951219512, 'support': 156.0}     | {'precision': 0.7537688442211056, 'recall': 0.8253094910591472, 'f1-score': 0.7879185817465528, 'support': 727.0}  | {'precision': 0.5808619091751622, 'recall': 0.6051170649287956, 'f1-score': 0.5927414588012767, 'support': 4143.0}   | {'precision': 0.8207132388861749, 'recall': 0.7660738714090287, 'f1-score': 0.7924528301886793, 'support': 2193.0}  | {'precision': 0.8846666144323435, 'recall': 0.8987502984955823, 'f1-score': 0.8916528468767275, 'support': 12563.0} | {'precision': 0.9284478371501272, 'recall': 0.8960707269155206, 'f1-score': 0.9119720069982503, 'support': 10180.0} | 0.8428   | {'precision': 0.7418523562791942, 'recall': 0.7663829802515292, 'f1-score': 0.7530413448863159, 'support': 30257.0}   | {'precision': 0.8456178749149208, 'recall': 0.8427801830981261, 'f1-score': 0.8439033621710555, 'support': 30257.0} |
-| No log        | 9.0   | 369  | 0.5474          | {'precision': 0.5585284280936454, 'recall': 0.5661016949152542, 'f1-score': 0.5622895622895623, 'support': 295.0}    | {'precision': 0.6875, 'recall': 0.7756410256410257, 'f1-score': 0.7289156626506025, 'support': 156.0}                | {'precision': 0.7355769230769231, 'recall': 0.8418156808803301, 'f1-score': 0.7851186658114176, 'support': 727.0}  | {'precision': 0.604811876119785, 'recall': 0.570359642770939, 'f1-score': 0.587080745341615, 'support': 4143.0}      | {'precision': 0.8211678832116789, 'recall': 0.8207934336525308, 'f1-score': 0.8209806157354618, 'support': 2193.0}  | {'precision': 0.888625217528872, 'recall': 0.8942131656451484, 'f1-score': 0.8914104344376116, 'support': 12563.0}  | {'precision': 0.91595650896268, 'recall': 0.918565815324165, 'f1-score': 0.917259306488793, 'support': 10180.0}     | 0.8477   | {'precision': 0.7445952624276548, 'recall': 0.7696414941184847, 'f1-score': 0.7561507132507234, 'support': 30257.0}   | {'precision': 0.8461371897103921, 'recall': 0.8476716131804211, 'f1-score': 0.8467310896799954, 'support': 30257.0} |
-| No log        | 10.0  | 410  | 0.5962          | {'precision': 0.5531914893617021, 'recall': 0.6169491525423729, 'f1-score': 0.5833333333333334, 'support': 295.0}    | {'precision': 0.6582914572864321, 'recall': 0.8397435897435898, 'f1-score': 0.7380281690140845, 'support': 156.0}    | {'precision': 0.7450248756218906, 'recall': 0.8239339752407153, 'f1-score': 0.782495101241019, 'support': 727.0}   | {'precision': 0.6161803713527851, 'recall': 0.5607048032826454, 'f1-score': 0.5871350941488689, 'support': 4143.0}   | {'precision': 0.776742301458671, 'recall': 0.8741450068399452, 'f1-score': 0.8225702638918686, 'support': 2193.0}   | {'precision': 0.8831158622858041, 'recall': 0.8942927644670858, 'f1-score': 0.888669171445521, 'support': 12563.0}  | {'precision': 0.9232313095835424, 'recall': 0.9037328094302554, 'f1-score': 0.9133780094316207, 'support': 10180.0} | 0.8457   | {'precision': 0.7365396667072609, 'recall': 0.7876431573638013, 'f1-score': 0.7593727346437593, 'support': 30257.0}   | {'precision': 0.8446583764532496, 'recall': 0.8456555507816373, 'f1-score': 0.844598799846626, 'support': 30257.0}  |
-| No log        | 11.0  | 451  | 0.5957          | {'precision': 0.5545171339563862, 'recall': 0.6033898305084746, 'f1-score': 0.577922077922078, 'support': 295.0}     | {'precision': 0.6467661691542289, 'recall': 0.8333333333333334, 'f1-score': 0.7282913165266107, 'support': 156.0}    | {'precision': 0.7694300518134715, 'recall': 0.8170563961485557, 'f1-score': 0.7925283522348232, 'support': 727.0}  | {'precision': 0.6102831594634873, 'recall': 0.5930485155684286, 'f1-score': 0.6015424164524421, 'support': 4143.0}   | {'precision': 0.783003300330033, 'recall': 0.8654810761513908, 'f1-score': 0.8221789040502492, 'support': 2193.0}   | {'precision': 0.892235181338872, 'recall': 0.8890392422192152, 'f1-score': 0.8906343447230972, 'support': 12563.0}  | {'precision': 0.9259629814907454, 'recall': 0.9091355599214146, 'f1-score': 0.917472118959108, 'support': 10180.0}  | 0.8488   | {'precision': 0.7403139967924607, 'recall': 0.7872119934072589, 'f1-score': 0.7615099329812013, 'support': 30257.0}   | {'precision': 0.8495500818518233, 'recall': 0.8487622698879598, 'f1-score': 0.8488747259194414, 'support': 30257.0} |
-| No log        | 12.0  | 492  | 0.6363          | {'precision': 0.546583850931677, 'recall': 0.5966101694915255, 'f1-score': 0.5705024311183144, 'support': 295.0}     | {'precision': 0.6580310880829016, 'recall': 0.8141025641025641, 'f1-score': 0.7277936962750716, 'support': 156.0}    | {'precision': 0.7600502512562815, 'recall': 0.8321870701513068, 'f1-score': 0.7944845699277742, 'support': 727.0}  | {'precision': 0.6018252933507171, 'recall': 0.5570842384745354, 'f1-score': 0.5785911255953873, 'support': 4143.0}   | {'precision': 0.7675276752767528, 'recall': 0.853625170998632, 'f1-score': 0.8082901554404146, 'support': 2193.0}   | {'precision': 0.8818805551224076, 'recall': 0.9003422749343309, 'f1-score': 0.8910157942416007, 'support': 12563.0} | {'precision': 0.9259597806215722, 'recall': 0.8955795677799607, 'f1-score': 0.9105163287725957, 'support': 10180.0} | 0.8433   | {'precision': 0.73455121352033, 'recall': 0.7785044365618364, 'f1-score': 0.7544563001958797, 'support': 30257.0}     | {'precision': 0.8427252530453597, 'recall': 0.8433089863502661, 'f1-score': 0.8425156264772145, 'support': 30257.0} |
-| 0.3164        | 13.0  | 533  | 0.6392          | {'precision': 0.564935064935065, 'recall': 0.5898305084745763, 'f1-score': 0.5771144278606964, 'support': 295.0}     | {'precision': 0.6615384615384615, 'recall': 0.8269230769230769, 'f1-score': 0.7350427350427349, 'support': 156.0}    | {'precision': 0.7632911392405063, 'recall': 0.8294360385144429, 'f1-score': 0.7949901120632828, 'support': 727.0}  | {'precision': 0.6016421995521274, 'recall': 0.5836350470673425, 'f1-score': 0.5925018377848567, 'support': 4143.0}   | {'precision': 0.7977147693609818, 'recall': 0.8595531235750113, 'f1-score': 0.8274802458296752, 'support': 2193.0}  | {'precision': 0.8831720556997876, 'recall': 0.8935763750696489, 'f1-score': 0.8883437524728971, 'support': 12563.0} | {'precision': 0.9303008813696687, 'recall': 0.9020628683693517, 'f1-score': 0.9159642910578025, 'support': 10180.0} | 0.8467   | {'precision': 0.743227795956657, 'recall': 0.7835738625704929, 'f1-score': 0.7616339145874208, 'support': 30257.0}    | {'precision': 0.8471598021098077, 'recall': 0.8466801070826585, 'f1-score': 0.8466487613672259, 'support': 30257.0} |
-| 0.3164        | 14.0  | 574  | 0.6574          | {'precision': 0.5741935483870968, 'recall': 0.6033898305084746, 'f1-score': 0.5884297520661158, 'support': 295.0}    | {'precision': 0.673469387755102, 'recall': 0.8461538461538461, 'f1-score': 0.75, 'support': 156.0}                   | {'precision': 0.7689295039164491, 'recall': 0.8101788170563962, 'f1-score': 0.7890154052243804, 'support': 727.0}  | {'precision': 0.5957288303948348, 'recall': 0.5790489983104031, 'f1-score': 0.5872705018359853, 'support': 4143.0}   | {'precision': 0.7902335456475584, 'recall': 0.8486092111263109, 'f1-score': 0.8183817062445031, 'support': 2193.0}  | {'precision': 0.8890226287915263, 'recall': 0.8818753482448459, 'f1-score': 0.8854345654345654, 'support': 12563.0} | {'precision': 0.9146040824376295, 'recall': 0.9111001964636543, 'f1-score': 0.9128487771271099, 'support': 10180.0} | 0.8432   | {'precision': 0.7437402181900282, 'recall': 0.782908035409133, 'f1-score': 0.7616258154189514, 'support': 30257.0}    | {'precision': 0.8432431379603119, 'recall': 0.8432098357404898, 'f1-score': 0.8430607378149431, 'support': 30257.0} |
-| 0.3164        | 15.0  | 615  | 0.6657          | {'precision': 0.5636942675159236, 'recall': 0.6, 'f1-score': 0.5812807881773399, 'support': 295.0}                   | {'precision': 0.6717948717948717, 'recall': 0.8397435897435898, 'f1-score': 0.7464387464387464, 'support': 156.0}    | {'precision': 0.7634271099744245, 'recall': 0.8211829436038515, 'f1-score': 0.7912524850894631, 'support': 727.0}  | {'precision': 0.5987460815047022, 'recall': 0.5993241612358194, 'f1-score': 0.5990349819059108, 'support': 4143.0}   | {'precision': 0.793854033290653, 'recall': 0.8481532147742818, 'f1-score': 0.8201058201058201, 'support': 2193.0}   | {'precision': 0.8901107721945738, 'recall': 0.8826713364642204, 'f1-score': 0.8863754446265136, 'support': 12563.0} | {'precision': 0.9214414054701537, 'recall': 0.906777996070727, 'f1-score': 0.9140508961283296, 'support': 10180.0}  | 0.8450   | {'precision': 0.7432955059636147, 'recall': 0.7854076059846414, 'f1-score': 0.7626484517817319, 'support': 30257.0}   | {'precision': 0.8464277148202262, 'recall': 0.8450275969197211, 'f1-score': 0.8455573804598716, 'support': 30257.0} |
-| 0.3164        | 16.0  | 656  | 0.6708          | {'precision': 0.5619047619047619, 'recall': 0.6, 'f1-score': 0.580327868852459, 'support': 295.0}                    | {'precision': 0.6789473684210526, 'recall': 0.8269230769230769, 'f1-score': 0.7456647398843931, 'support': 156.0}    | {'precision': 0.7630573248407644, 'recall': 0.8239339752407153, 'f1-score': 0.7923280423280424, 'support': 727.0}  | {'precision': 0.5966467065868264, 'recall': 0.6012551291334781, 'f1-score': 0.5989420533782159, 'support': 4143.0}   | {'precision': 0.7935897435897435, 'recall': 0.8467852257181943, 'f1-score': 0.8193249503639972, 'support': 2193.0}  | {'precision': 0.8916157064692629, 'recall': 0.8820345458887209, 'f1-score': 0.8867992477291825, 'support': 12563.0} | {'precision': 0.9210893854748603, 'recall': 0.9069744597249508, 'f1-score': 0.9139774302118391, 'support': 10180.0} | 0.8450   | {'precision': 0.7438358567553245, 'recall': 0.7839866303755908, 'f1-score': 0.7624806189640186, 'support': 30257.0}   | {'precision': 0.8466380687769368, 'recall': 0.8449945467164623, 'f1-score': 0.8456518702970672, 'support': 30257.0} |
 ### Framework versions

       name: essays_su_g
       type: essays_su_g
       config: full_labels
+      split: train[40%:60%]
       args: full_labels
     metrics:
     - name: Accuracy
       type: accuracy
+      value: 0.8468549981568982
 ---
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
 It achieves the following results on the evaluation set:
+- Loss: 0.7231
+- B-claim: {'precision': 0.5840978593272171, 'recall': 0.6025236593059937, 'f1-score': 0.5931677018633541, 'support': 317.0}
+- B-majorclaim: {'precision': 0.7365269461077845, 'recall': 0.7935483870967742, 'f1-score': 0.7639751552795031, 'support': 155.0}
+- B-premise: {'precision': 0.7940841865756542, 'recall': 0.8481166464155528, 'f1-score': 0.8202115158636897, 'support': 823.0}
+- I-claim: {'precision': 0.6331192005710207, 'recall': 0.6125690607734806, 'f1-score': 0.6226746226746227, 'support': 4344.0}
+- I-majorclaim: {'precision': 0.8226415094339623, 'recall': 0.8249763481551561, 'f1-score': 0.8238072744449694, 'support': 2114.0}
+- I-premise: {'precision': 0.8901098901098901, 'recall': 0.8988755787462336, 'f1-score': 0.8944712593242651, 'support': 13607.0}
+- O: {'precision': 0.9070680628272252, 'recall': 0.8988326848249028, 'f1-score': 0.9029315960912051, 'support': 8481.0}
+- Accuracy: 0.8469
+- Macro avg: {'precision': 0.7668068078503933, 'recall': 0.7827774807597278, 'f1-score': 0.77446273222023, 'support': 29841.0}
+- Weighted avg: {'precision': 0.8460425407121772, 'recall': 0.8468549981568982, 'f1-score': 0.8463772936317426, 'support': 29841.0}
 ## Model description
 ### Training results
+| Training Loss | Epoch | Step | Validation Loss | B-claim                                                                                                             | B-majorclaim                                                                                                       | B-premise                                                                                                         | I-claim                                                                                                             | I-majorclaim                                                                                                       | I-premise                                                                                                           | O                                                                                                                  | Accuracy | Macro avg                                                                                                             | Weighted avg                                                                                                        |
+|:-------------:|:-----:|:----:|:---------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:--------:|:---------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
+| No log        | 1.0   | 41   | 0.6935          | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 317.0}                                                | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 155.0}                                               | {'precision': 0.8125, 'recall': 0.015795868772782502, 'f1-score': 0.030989272943980926, 'support': 823.0}         | {'precision': 0.4962158604804212, 'recall': 0.34714548802946593, 'f1-score': 0.4085060273601517, 'support': 4344.0} | {'precision': 0.5727332028701891, 'recall': 0.4153263954588458, 'f1-score': 0.4814916369618864, 'support': 2114.0} | {'precision': 0.7845887659890008, 'recall': 0.9331226574557213, 'f1-score': 0.8524337025847599, 'support': 13607.0} | {'precision': 0.7997794928335171, 'recall': 0.855323664662186, 'f1-score': 0.8266195658367045, 'support': 8481.0}  | 0.7490   | {'precision': 0.49511676031044694, 'recall': 0.36667343919700024, 'f1-score': 0.3714343150982119, 'support': 29841.0} | {'precision': 0.7202786906044678, 'recall': 0.748969538554338, 'f1-score': 0.7180574915034598, 'support': 29841.0}  |
+| No log        | 2.0   | 82   | 0.5276          | {'precision': 0.6521739130434783, 'recall': 0.0473186119873817, 'f1-score': 0.08823529411764705, 'support': 317.0}  | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 155.0}                                               | {'precision': 0.5978964401294499, 'recall': 0.8979343863912516, 'f1-score': 0.7178241864983002, 'support': 823.0} | {'precision': 0.6556732223903177, 'recall': 0.4988489871086556, 'f1-score': 0.5666100143809648, 'support': 4344.0}  | {'precision': 0.6422056384742952, 'recall': 0.7327341532639546, 'f1-score': 0.6844896155545735, 'support': 2114.0} | {'precision': 0.8662060301507538, 'recall': 0.9121040640846623, 'f1-score': 0.8885627349203508, 'support': 13607.0} | {'precision': 0.8665807660770762, 'recall': 0.8723027944817828, 'f1-score': 0.8694323657304031, 'support': 8481.0} | 0.8136   | {'precision': 0.6115337157521958, 'recall': 0.5658918567596698, 'f1-score': 0.5450220301717484, 'support': 29841.0}   | {'precision': 0.8056235390174763, 'recall': 0.8136121443651352, 'f1-score': 0.8039755326998906, 'support': 29841.0} |
+| No log        | 3.0   | 123  | 0.4752          | {'precision': 0.5123674911660777, 'recall': 0.45741324921135645, 'f1-score': 0.48333333333333334, 'support': 317.0} | {'precision': 1.0, 'recall': 0.03225806451612903, 'f1-score': 0.0625, 'support': 155.0}                            | {'precision': 0.7192268565615463, 'recall': 0.8590522478736331, 'f1-score': 0.7829457364341085, 'support': 823.0} | {'precision': 0.6404523258802365, 'recall': 0.5736648250460405, 'f1-score': 0.6052216150576806, 'support': 4344.0}  | {'precision': 0.7138364779874213, 'recall': 0.859035004730369, 'f1-score': 0.7797337913267497, 'support': 2114.0}  | {'precision': 0.867799679598802, 'recall': 0.9156316601749099, 'f1-score': 0.8910742383063939, 'support': 13607.0}  | {'precision': 0.9236307534070455, 'recall': 0.8470699209998821, 'f1-score': 0.8836951842056707, 'support': 8481.0} | 0.8313   | {'precision': 0.7681876549430184, 'recall': 0.6491607103646171, 'f1-score': 0.6412148426662767, 'support': 29841.0}   | {'precision': 0.8324782036689456, 'recall': 0.831339432324654, 'f1-score': 0.8278601406223198, 'support': 29841.0}  |
+| No log        | 4.0   | 164  | 0.4750          | {'precision': 0.5775075987841946, 'recall': 0.5993690851735016, 'f1-score': 0.5882352941176471, 'support': 317.0}   | {'precision': 0.7931034482758621, 'recall': 0.44516129032258067, 'f1-score': 0.5702479338842975, 'support': 155.0} | {'precision': 0.77491601343785, 'recall': 0.8408262454434994, 'f1-score': 0.8065268065268065, 'support': 823.0}   | {'precision': 0.6112942210503186, 'recall': 0.6404235727440147, 'f1-score': 0.6255199550309162, 'support': 4344.0}  | {'precision': 0.7840629611411707, 'recall': 0.7540208136234626, 'f1-score': 0.768748492886424, 'support': 2114.0}  | {'precision': 0.8953488372093024, 'recall': 0.8771220695230396, 'f1-score': 0.8861417381297101, 'support': 13607.0} | {'precision': 0.8846600139243443, 'recall': 0.89895059544865, 'f1-score': 0.8917480554418388, 'support': 8481.0}   | 0.8340   | {'precision': 0.7601275848318633, 'recall': 0.7222676674683927, 'f1-score': 0.7338811822882343, 'support': 29841.0}   | {'precision': 0.8358480354026695, 'recall': 0.8339532857477967, 'f1-score': 0.834478384347318, 'support': 29841.0}  |
+| No log        | 5.0   | 205  | 0.4792          | {'precision': 0.547486033519553, 'recall': 0.6182965299684543, 'f1-score': 0.5807407407407407, 'support': 317.0}    | {'precision': 0.7142857142857143, 'recall': 0.7419354838709677, 'f1-score': 0.7278481012658229, 'support': 155.0}  | {'precision': 0.7789115646258503, 'recall': 0.8347509113001215, 'f1-score': 0.8058651026392962, 'support': 823.0} | {'precision': 0.5776986951364176, 'recall': 0.6726519337016574, 'f1-score': 0.6215698787492023, 'support': 4344.0}  | {'precision': 0.7845402043536206, 'recall': 0.8353831598864712, 'f1-score': 0.809163802978236, 'support': 2114.0}  | {'precision': 0.8960392246993029, 'recall': 0.8595575806570148, 'f1-score': 0.8774193548387097, 'support': 13607.0} | {'precision': 0.9226293637038872, 'recall': 0.8787878787878788, 'f1-score': 0.9001751313485113, 'support': 8481.0} | 0.8322   | {'precision': 0.745941542903478, 'recall': 0.7773376397389379, 'f1-score': 0.7603974446515027, 'support': 29841.0}    | {'precision': 0.8414791080647194, 'recall': 0.8322442277403572, 'f1-score': 0.8359049808325034, 'support': 29841.0} |
+| No log        | 6.0   | 246  | 0.4945          | {'precision': 0.6072607260726073, 'recall': 0.580441640378549, 'f1-score': 0.5935483870967742, 'support': 317.0}    | {'precision': 0.7516339869281046, 'recall': 0.7419354838709677, 'f1-score': 0.7467532467532468, 'support': 155.0}  | {'precision': 0.7650214592274678, 'recall': 0.8663426488456865, 'f1-score': 0.8125356125356125, 'support': 823.0} | {'precision': 0.6300925925925925, 'recall': 0.6266114180478821, 'f1-score': 0.6283471837488457, 'support': 4344.0}  | {'precision': 0.8326810176125244, 'recall': 0.8051087984862819, 'f1-score': 0.8186628186628185, 'support': 2114.0} | {'precision': 0.8907519953137585, 'recall': 0.894025134122143, 'f1-score': 0.8923855633802816, 'support': 13607.0}  | {'precision': 0.9025142314990512, 'recall': 0.8972998467161891, 'f1-score': 0.8998994856027908, 'support': 8481.0} | 0.8448   | {'precision': 0.7685651441780151, 'recall': 0.7731092814953856, 'f1-score': 0.7703046139686244, 'support': 29841.0}   | {'precision': 0.8448347263870494, 'recall': 0.8448443416775577, 'f1-score': 0.8447287176785023, 'support': 29841.0} |
+| No log        | 7.0   | 287  | 0.5387          | {'precision': 0.6120401337792643, 'recall': 0.5772870662460567, 'f1-score': 0.5941558441558441, 'support': 317.0}   | {'precision': 0.6982248520710059, 'recall': 0.7612903225806451, 'f1-score': 0.7283950617283951, 'support': 155.0}  | {'precision': 0.7609860664523044, 'recall': 0.8626974483596598, 'f1-score': 0.8086560364464692, 'support': 823.0} | {'precision': 0.6266696349065004, 'recall': 0.6480202578268877, 'f1-score': 0.637166138524219, 'support': 4344.0}   | {'precision': 0.8459657701711492, 'recall': 0.8183538315988647, 'f1-score': 0.831930752584756, 'support': 2114.0}  | {'precision': 0.8917117250574031, 'recall': 0.8847651943852429, 'f1-score': 0.8882248782647189, 'support': 13607.0} | {'precision': 0.9062128064746489, 'recall': 0.8977714892111779, 'f1-score': 0.9019723982704495, 'support': 8481.0} | 0.8448   | {'precision': 0.7631158555588966, 'recall': 0.778597944315505, 'f1-score': 0.7700715871392646, 'support': 29841.0}    | {'precision': 0.8464284003187731, 'recall': 0.844777319794913, 'f1-score': 0.8454484668795899, 'support': 29841.0}  |
+| No log        | 8.0   | 328  | 0.5540          | {'precision': 0.6006493506493507, 'recall': 0.583596214511041, 'f1-score': 0.5920000000000001, 'support': 317.0}    | {'precision': 0.6931818181818182, 'recall': 0.7870967741935484, 'f1-score': 0.7371601208459214, 'support': 155.0}  | {'precision': 0.7774122807017544, 'recall': 0.8614823815309842, 'f1-score': 0.8172910662824208, 'support': 823.0} | {'precision': 0.6259250417760802, 'recall': 0.6035911602209945, 'f1-score': 0.61455525606469, 'support': 4344.0}    | {'precision': 0.7801418439716312, 'recall': 0.8325449385052034, 'f1-score': 0.805491990846682, 'support': 2114.0}  | {'precision': 0.8873371924746744, 'recall': 0.9012273094730653, 'f1-score': 0.8942283151638896, 'support': 13607.0} | {'precision': 0.919682151589242, 'recall': 0.8870416224501828, 'f1-score': 0.9030670427945501, 'support': 8481.0}  | 0.8439   | {'precision': 0.7549042399063646, 'recall': 0.779511485840717, 'f1-score': 0.7662562559997363, 'support': 29841.0}    | {'precision': 0.8437960885444236, 'recall': 0.8439395462618545, 'f1-score': 0.8435933360695711, 'support': 29841.0} |
+| No log        | 9.0   | 369  | 0.5799          | {'precision': 0.6095238095238096, 'recall': 0.6056782334384858, 'f1-score': 0.6075949367088608, 'support': 317.0}   | {'precision': 0.7109826589595376, 'recall': 0.7935483870967742, 'f1-score': 0.7500000000000001, 'support': 155.0}  | {'precision': 0.7925591882750845, 'recall': 0.8541919805589308, 'f1-score': 0.8222222222222222, 'support': 823.0} | {'precision': 0.6367403314917127, 'recall': 0.6367403314917127, 'f1-score': 0.6367403314917127, 'support': 4344.0}  | {'precision': 0.7997323818019625, 'recall': 0.848155156102176, 'f1-score': 0.8232323232323232, 'support': 2114.0}  | {'precision': 0.8937833296807656, 'recall': 0.8991695450870876, 'f1-score': 0.896468347010551, 'support': 13607.0}  | {'precision': 0.9211329507996582, 'recall': 0.8896356561726212, 'f1-score': 0.9051103646833014, 'support': 8481.0} | 0.8497   | {'precision': 0.7663506643617902, 'recall': 0.7895884699925412, 'f1-score': 0.7773383607641389, 'support': 29841.0}   | {'precision': 0.8507144582800709, 'recall': 0.8497369391106196, 'f1-score': 0.8500501127908038, 'support': 29841.0} |
+| No log        | 10.0  | 410  | 0.6519          | {'precision': 0.593103448275862, 'recall': 0.5425867507886435, 'f1-score': 0.5667215815485995, 'support': 317.0}    | {'precision': 0.6864864864864865, 'recall': 0.8193548387096774, 'f1-score': 0.7470588235294117, 'support': 155.0}  | {'precision': 0.785234899328859, 'recall': 0.8529769137302552, 'f1-score': 0.8177052999417589, 'support': 823.0}  | {'precision': 0.6414194915254238, 'recall': 0.5575506445672191, 'f1-score': 0.596551724137931, 'support': 4344.0}   | {'precision': 0.7576142131979695, 'recall': 0.8472090823084201, 'f1-score': 0.799910674408218, 'support': 2114.0}  | {'precision': 0.8857348185411427, 'recall': 0.9057837877563019, 'f1-score': 0.8956471186687013, 'support': 13607.0} | {'precision': 0.9042414161815374, 'recall': 0.8974177573399363, 'f1-score': 0.9008166646940468, 'support': 8481.0} | 0.8428   | {'precision': 0.7505478247910401, 'recall': 0.7746971107429219, 'f1-score': 0.7606302695612381, 'support': 29841.0}   | {'precision': 0.8394375310836902, 'recall': 0.8428001742568949, 'f1-score': 0.8403788295700347, 'support': 29841.0} |
+| No log        | 11.0  | 451  | 0.6617          | {'precision': 0.5849056603773585, 'recall': 0.5867507886435331, 'f1-score': 0.5858267716535434, 'support': 317.0}   | {'precision': 0.6927374301675978, 'recall': 0.8, 'f1-score': 0.7425149700598802, 'support': 155.0}                 | {'precision': 0.7931428571428571, 'recall': 0.8432563791008505, 'f1-score': 0.8174322732626619, 'support': 823.0} | {'precision': 0.6108083560399636, 'recall': 0.6192449355432781, 'f1-score': 0.6149977137631457, 'support': 4344.0}  | {'precision': 0.7798442906574394, 'recall': 0.8528855250709555, 'f1-score': 0.8147311342069589, 'support': 2114.0} | {'precision': 0.8911875138040197, 'recall': 0.8896156390093334, 'f1-score': 0.8904008826774549, 'support': 13607.0} | {'precision': 0.9186046511627907, 'recall': 0.8849192312227332, 'f1-score': 0.9014473605188877, 'support': 8481.0} | 0.8414   | {'precision': 0.7530329656217181, 'recall': 0.7823817855129549, 'f1-score': 0.7667644437346476, 'support': 29841.0}   | {'precision': 0.843288188846705, 'recall': 0.8413592037800341, 'f1-score': 0.8420728269602915, 'support': 29841.0}  |
+| No log        | 12.0  | 492  | 0.6726          | {'precision': 0.568733153638814, 'recall': 0.6656151419558359, 'f1-score': 0.6133720930232559, 'support': 317.0}    | {'precision': 0.7409638554216867, 'recall': 0.7935483870967742, 'f1-score': 0.766355140186916, 'support': 155.0}   | {'precision': 0.8093525179856115, 'recall': 0.8201701093560145, 'f1-score': 0.8147254073627037, 'support': 823.0} | {'precision': 0.5959249546096429, 'recall': 0.6800184162062615, 'f1-score': 0.6352005160735404, 'support': 4344.0}  | {'precision': 0.8207954000958313, 'recall': 0.8103122043519394, 'f1-score': 0.8155201142585099, 'support': 2114.0} | {'precision': 0.9055836784782942, 'recall': 0.8677151466157125, 'f1-score': 0.8862450741227248, 'support': 13607.0} | {'precision': 0.9062947067238912, 'recall': 0.8963565617262116, 'f1-score': 0.9012982393739997, 'support': 8481.0} | 0.8406   | {'precision': 0.7639497524219674, 'recall': 0.7905337096155357, 'f1-score': 0.7761023692002358, 'support': 29841.0}   | {'precision': 0.8476142531752411, 'recall': 0.8406219630709426, 'f1-score': 0.8434741015904832, 'support': 29841.0} |
+| 0.3002        | 13.0  | 533  | 0.6932          | {'precision': 0.5880398671096345, 'recall': 0.5583596214511041, 'f1-score': 0.5728155339805825, 'support': 317.0}   | {'precision': 0.7365269461077845, 'recall': 0.7935483870967742, 'f1-score': 0.7639751552795031, 'support': 155.0}  | {'precision': 0.78, 'recall': 0.8529769137302552, 'f1-score': 0.8148578061520603, 'support': 823.0}               | {'precision': 0.650231124807396, 'recall': 0.5828729281767956, 'f1-score': 0.6147123088128186, 'support': 4344.0}   | {'precision': 0.8384912959381045, 'recall': 0.8202459791863765, 'f1-score': 0.8292682926829268, 'support': 2114.0} | {'precision': 0.8844858473665352, 'recall': 0.9071066362901448, 'f1-score': 0.8956534358899934, 'support': 13607.0} | {'precision': 0.8977325853202431, 'recall': 0.9056715010022403, 'f1-score': 0.9016845688794975, 'support': 8481.0} | 0.8476   | {'precision': 0.7679296666642426, 'recall': 0.7743974238476702, 'f1-score': 0.7704238716681975, 'support': 29841.0}   | {'precision': 0.8440921517882902, 'recall': 0.8475587279246674, 'f1-score': 0.8454258643758608, 'support': 29841.0} |
+| 0.3002        | 14.0  | 574  | 0.6972          | {'precision': 0.58125, 'recall': 0.5867507886435331, 'f1-score': 0.5839874411302983, 'support': 317.0}              | {'precision': 0.7469879518072289, 'recall': 0.8, 'f1-score': 0.7725856697819314, 'support': 155.0}                 | {'precision': 0.7891770011273957, 'recall': 0.850546780072904, 'f1-score': 0.8187134502923977, 'support': 823.0}  | {'precision': 0.6454117647058824, 'recall': 0.6314456721915286, 'f1-score': 0.6383523388410519, 'support': 4344.0}  | {'precision': 0.8318417333961375, 'recall': 0.8353831598864712, 'f1-score': 0.8336086853906065, 'support': 2114.0} | {'precision': 0.8906204906204906, 'recall': 0.9071801278753583, 'f1-score': 0.8988240433975317, 'support': 13607.0} | {'precision': 0.9179113539769278, 'recall': 0.8912864049050819, 'f1-score': 0.9044029672170375, 'support': 8481.0} | 0.8519   | {'precision': 0.7718857565191518, 'recall': 0.7860847047964111, 'f1-score': 0.7786392280072649, 'support': 29841.0}   | {'precision': 0.8516870545119499, 'recall': 0.8519151502965718, 'f1-score': 0.8516627328696869, 'support': 29841.0} |
+| 0.3002        | 15.0  | 615  | 0.7235          | {'precision': 0.5818181818181818, 'recall': 0.6056782334384858, 'f1-score': 0.5935085007727976, 'support': 317.0}   | {'precision': 0.7071823204419889, 'recall': 0.8258064516129032, 'f1-score': 0.761904761904762, 'support': 155.0}   | {'precision': 0.7977011494252874, 'recall': 0.8432563791008505, 'f1-score': 0.819846426461902, 'support': 823.0}  | {'precision': 0.6238979118329466, 'recall': 0.6190147329650092, 'f1-score': 0.621446729835914, 'support': 4344.0}   | {'precision': 0.7945389435989257, 'recall': 0.8396404919583728, 'f1-score': 0.8164673413063478, 'support': 2114.0} | {'precision': 0.8926267956610965, 'recall': 0.8950540163151319, 'f1-score': 0.8938387582107079, 'support': 13607.0} | {'precision': 0.9125967117988395, 'recall': 0.89010729866761, 'f1-score': 0.9012117232734437, 'support': 8481.0}   | 0.8447   | {'precision': 0.7586231449396095, 'recall': 0.7883653720083377, 'f1-score': 0.7726034631094107, 'support': 29841.0}   | {'precision': 0.8453513972849044, 'recall': 0.8446767869709461, 'f1-score': 0.8448841595054579, 'support': 29841.0} |
+| 0.3002        | 16.0  | 656  | 0.7231          | {'precision': 0.5840978593272171, 'recall': 0.6025236593059937, 'f1-score': 0.5931677018633541, 'support': 317.0}   | {'precision': 0.7365269461077845, 'recall': 0.7935483870967742, 'f1-score': 0.7639751552795031, 'support': 155.0}  | {'precision': 0.7940841865756542, 'recall': 0.8481166464155528, 'f1-score': 0.8202115158636897, 'support': 823.0} | {'precision': 0.6331192005710207, 'recall': 0.6125690607734806, 'f1-score': 0.6226746226746227, 'support': 4344.0}  | {'precision': 0.8226415094339623, 'recall': 0.8249763481551561, 'f1-score': 0.8238072744449694, 'support': 2114.0} | {'precision': 0.8901098901098901, 'recall': 0.8988755787462336, 'f1-score': 0.8944712593242651, 'support': 13607.0} | {'precision': 0.9070680628272252, 'recall': 0.8988326848249028, 'f1-score': 0.9029315960912051, 'support': 8481.0} | 0.8469   | {'precision': 0.7668068078503933, 'recall': 0.7827774807597278, 'f1-score': 0.77446273222023, 'support': 29841.0}     | {'precision': 0.8460425407121772, 'recall': 0.8468549981568982, 'f1-score': 0.8463772936317426, 'support': 29841.0} |
 ### Framework versions

meta_data/README_s42_e16.md CHANGED Viewed

@@ -17,12 +17,12 @@ model-index:
       name: essays_su_g
       type: essays_su_g
       config: full_labels
-      split: train[20%:40%]
       args: full_labels
     metrics:
     - name: Accuracy
       type: accuracy
-      value: 0.8449945467164623
 ---
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -32,17 +32,17 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6708
-- B-claim: {'precision': 0.5619047619047619, 'recall': 0.6, 'f1-score': 0.580327868852459, 'support': 295.0}
-- B-majorclaim: {'precision': 0.6789473684210526, 'recall': 0.8269230769230769, 'f1-score': 0.7456647398843931, 'support': 156.0}
-- B-premise: {'precision': 0.7630573248407644, 'recall': 0.8239339752407153, 'f1-score': 0.7923280423280424, 'support': 727.0}
-- I-claim: {'precision': 0.5966467065868264, 'recall': 0.6012551291334781, 'f1-score': 0.5989420533782159, 'support': 4143.0}
-- I-majorclaim: {'precision': 0.7935897435897435, 'recall': 0.8467852257181943, 'f1-score': 0.8193249503639972, 'support': 2193.0}
-- I-premise: {'precision': 0.8916157064692629, 'recall': 0.8820345458887209, 'f1-score': 0.8867992477291825, 'support': 12563.0}
-- O: {'precision': 0.9210893854748603, 'recall': 0.9069744597249508, 'f1-score': 0.9139774302118391, 'support': 10180.0}
-- Accuracy: 0.8450
-- Macro avg: {'precision': 0.7438358567553245, 'recall': 0.7839866303755908, 'f1-score': 0.7624806189640186, 'support': 30257.0}
-- Weighted avg: {'precision': 0.8466380687769368, 'recall': 0.8449945467164623, 'f1-score': 0.8456518702970672, 'support': 30257.0}
 ## Model description
@@ -71,24 +71,24 @@ The following hyperparameters were used during training:
 ### Training results
-| Training Loss | Epoch | Step | Validation Loss | B-claim                                                                                                              | B-majorclaim                                                                                                         | B-premise                                                                                                          | I-claim                                                                                                              | I-majorclaim                                                                                                        | I-premise                                                                                                           | O                                                                                                                   | Accuracy | Macro avg                                                                                                             | Weighted avg                                                                                                        |
-|:-------------:|:-----:|:----:|:---------------:|:--------------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:--------:|:---------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
-| No log        | 1.0   | 41   | 0.6795          | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 295.0}                                                 | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 156.0}                                                 | {'precision': 0.8727272727272727, 'recall': 0.06602475928473177, 'f1-score': 0.1227621483375959, 'support': 727.0} | {'precision': 0.5111008325624422, 'recall': 0.26671494086410813, 'f1-score': 0.35051546391752586, 'support': 4143.0} | {'precision': 0.4952120383036936, 'recall': 0.16507067943456452, 'f1-score': 0.2476060191518468, 'support': 2193.0} | {'precision': 0.7927029242962558, 'recall': 0.9235055321181247, 'f1-score': 0.8531195999852935, 'support': 12563.0} | {'precision': 0.7493095557484416, 'recall': 0.9328094302554027, 'f1-score': 0.8310506279263117, 'support': 10180.0} | 0.7474   | {'precision': 0.48872180337687227, 'recall': 0.3363036202795617, 'f1-score': 0.34357912275979624, 'support': 30257.0} | {'precision': 0.7080894203665903, 'recall': 0.7473642462901147, 'f1-score': 0.7027223642713039, 'support': 30257.0} |
-| No log        | 2.0   | 82   | 0.5111          | {'precision': 0.6470588235294118, 'recall': 0.07457627118644068, 'f1-score': 0.1337386018237082, 'support': 295.0}   | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 156.0}                                                 | {'precision': 0.6562150055991042, 'recall': 0.8060522696011004, 'f1-score': 0.7234567901234568, 'support': 727.0}  | {'precision': 0.5315296566077004, 'recall': 0.6164615013275404, 'f1-score': 0.5708538220831472, 'support': 4143.0}   | {'precision': 0.5701344243132671, 'recall': 0.8896488828089375, 'f1-score': 0.6949243098842386, 'support': 2193.0}  | {'precision': 0.914638511095204, 'recall': 0.8136591578444639, 'f1-score': 0.861198871056068, 'support': 12563.0}   | {'precision': 0.9145764077767704, 'recall': 0.8918467583497053, 'f1-score': 0.9030685830805192, 'support': 10180.0} | 0.8069   | {'precision': 0.6048789755602082, 'recall': 0.5846064058740269, 'f1-score': 0.5553201397215911, 'support': 30257.0}   | {'precision': 0.8236564850419075, 'recall': 0.8068876623591235, 'f1-score': 0.8086360829977005, 'support': 30257.0} |
-| No log        | 3.0   | 123  | 0.4232          | {'precision': 0.46254071661237783, 'recall': 0.48135593220338985, 'f1-score': 0.47176079734219273, 'support': 295.0} | {'precision': 0.6666666666666666, 'recall': 0.038461538461538464, 'f1-score': 0.07272727272727274, 'support': 156.0} | {'precision': 0.7320341047503045, 'recall': 0.8266850068775791, 'f1-score': 0.7764857881136951, 'support': 727.0}  | {'precision': 0.5594361455922575, 'recall': 0.6418054549843109, 'f1-score': 0.597796762589928, 'support': 4143.0}    | {'precision': 0.7543689320388349, 'recall': 0.7086183310533516, 'f1-score': 0.730778274159417, 'support': 2193.0}   | {'precision': 0.8918637274549098, 'recall': 0.8856164928759054, 'f1-score': 0.8887291317197858, 'support': 12563.0} | {'precision': 0.934092758340114, 'recall': 0.9021611001964637, 'f1-score': 0.9178492904257447, 'support': 10180.0}  | 0.8352   | {'precision': 0.7144290073507807, 'recall': 0.6406719795217912, 'f1-score': 0.6365896167254336, 'support': 30257.0}   | {'precision': 0.841400720911604, 'recall': 0.835244736755131, 'f1-score': 0.836272553745959, 'support': 30257.0}    |
-| No log        | 4.0   | 164  | 0.4295          | {'precision': 0.523972602739726, 'recall': 0.5186440677966102, 'f1-score': 0.5212947189097104, 'support': 295.0}     | {'precision': 0.7076923076923077, 'recall': 0.5897435897435898, 'f1-score': 0.6433566433566433, 'support': 156.0}    | {'precision': 0.7304878048780488, 'recall': 0.8239339752407153, 'f1-score': 0.7744020685197156, 'support': 727.0}  | {'precision': 0.5975518361229079, 'recall': 0.5773594013999517, 'f1-score': 0.5872821016449792, 'support': 4143.0}   | {'precision': 0.7692971108236308, 'recall': 0.8134974920200638, 'f1-score': 0.7907801418439716, 'support': 2193.0}  | {'precision': 0.9042123485285631, 'recall': 0.873119477831728, 'f1-score': 0.8883939418482223, 'support': 12563.0}  | {'precision': 0.8958530581329294, 'recall': 0.9294695481335953, 'f1-score': 0.9123517500723171, 'support': 10180.0} | 0.8412   | {'precision': 0.7327238669883019, 'recall': 0.7322525074523221, 'f1-score': 0.7311230523136514, 'support': 30257.0}   | {'precision': 0.8407365647422267, 'recall': 0.8411607231384473, 'f1-score': 0.8405678153025818, 'support': 30257.0} |
-| No log        | 5.0   | 205  | 0.4565          | {'precision': 0.5276073619631901, 'recall': 0.5830508474576271, 'f1-score': 0.5539452495974235, 'support': 295.0}    | {'precision': 0.7123287671232876, 'recall': 0.6666666666666666, 'f1-score': 0.6887417218543046, 'support': 156.0}    | {'precision': 0.7634146341463415, 'recall': 0.8610729023383769, 'f1-score': 0.8093083387201035, 'support': 727.0}  | {'precision': 0.5808294015396076, 'recall': 0.5645667390779628, 'f1-score': 0.5725826193390453, 'support': 4143.0}   | {'precision': 0.7949438202247191, 'recall': 0.774281805745554, 'f1-score': 0.7844767844767844, 'support': 2193.0}   | {'precision': 0.8697251839615557, 'recall': 0.9219931545013134, 'f1-score': 0.8950967891503419, 'support': 12563.0} | {'precision': 0.9528679881906369, 'recall': 0.887721021611002, 'f1-score': 0.9191415785191211, 'support': 10180.0}  | 0.8447   | {'precision': 0.7431024510213342, 'recall': 0.7513361624855005, 'f1-score': 0.7461847259510178, 'support': 30257.0}   | {'precision': 0.8460194835144224, 'recall': 0.8447301450903923, 'f1-score': 0.8445567746699831, 'support': 30257.0} |
-| No log        | 6.0   | 246  | 0.4916          | {'precision': 0.5593869731800766, 'recall': 0.49491525423728816, 'f1-score': 0.5251798561151079, 'support': 295.0}   | {'precision': 0.6492146596858639, 'recall': 0.7948717948717948, 'f1-score': 0.7146974063400577, 'support': 156.0}    | {'precision': 0.7337278106508875, 'recall': 0.8528198074277854, 'f1-score': 0.7888040712468193, 'support': 727.0}  | {'precision': 0.6394230769230769, 'recall': 0.41733043688148685, 'f1-score': 0.5050387030816416, 'support': 4143.0}  | {'precision': 0.7733443027560675, 'recall': 0.8572731418148655, 'f1-score': 0.8131487889273357, 'support': 2193.0}  | {'precision': 0.8424233805020266, 'recall': 0.9430072434927963, 'f1-score': 0.8898820701569895, 'support': 12563.0} | {'precision': 0.9398688793280066, 'recall': 0.9012770137524558, 'f1-score': 0.9201684886169893, 'support': 10180.0} | 0.8435   | {'precision': 0.7339127261465722, 'recall': 0.7516420989254959, 'f1-score': 0.7367027692121344, 'support': 30257.0}   | {'precision': 0.8360386273187937, 'recall': 0.8434742373665598, 'f1-score': 0.8349273131912464, 'support': 30257.0} |
-| No log        | 7.0   | 287  | 0.5145          | {'precision': 0.5668789808917197, 'recall': 0.6033898305084746, 'f1-score': 0.5845648604269295, 'support': 295.0}    | {'precision': 0.6777777777777778, 'recall': 0.782051282051282, 'f1-score': 0.7261904761904762, 'support': 156.0}     | {'precision': 0.758873929008568, 'recall': 0.8528198074277854, 'f1-score': 0.8031088082901554, 'support': 727.0}   | {'precision': 0.6070287539936102, 'recall': 0.5503258508327299, 'f1-score': 0.5772882643372579, 'support': 4143.0}   | {'precision': 0.7948040510788199, 'recall': 0.8230734154126766, 'f1-score': 0.8086917562724014, 'support': 2193.0}  | {'precision': 0.8718995765275257, 'recall': 0.9177744169386293, 'f1-score': 0.8942490402140614, 'support': 12563.0} | {'precision': 0.9417225373904075, 'recall': 0.8968565815324165, 'f1-score': 0.9187421383647798, 'support': 10180.0} | 0.8482   | {'precision': 0.745569372381204, 'recall': 0.7751844549577135, 'f1-score': 0.7589764777280089, 'support': 30257.0}    | {'precision': 0.8468453317066018, 'recall': 0.8482334666358198, 'f1-score': 0.8468124537513947, 'support': 30257.0} |
-| No log        | 8.0   | 328  | 0.5386          | {'precision': 0.5384615384615384, 'recall': 0.6169491525423729, 'f1-score': 0.5750394944707741, 'support': 295.0}    | {'precision': 0.686046511627907, 'recall': 0.7564102564102564, 'f1-score': 0.7195121951219512, 'support': 156.0}     | {'precision': 0.7537688442211056, 'recall': 0.8253094910591472, 'f1-score': 0.7879185817465528, 'support': 727.0}  | {'precision': 0.5808619091751622, 'recall': 0.6051170649287956, 'f1-score': 0.5927414588012767, 'support': 4143.0}   | {'precision': 0.8207132388861749, 'recall': 0.7660738714090287, 'f1-score': 0.7924528301886793, 'support': 2193.0}  | {'precision': 0.8846666144323435, 'recall': 0.8987502984955823, 'f1-score': 0.8916528468767275, 'support': 12563.0} | {'precision': 0.9284478371501272, 'recall': 0.8960707269155206, 'f1-score': 0.9119720069982503, 'support': 10180.0} | 0.8428   | {'precision': 0.7418523562791942, 'recall': 0.7663829802515292, 'f1-score': 0.7530413448863159, 'support': 30257.0}   | {'precision': 0.8456178749149208, 'recall': 0.8427801830981261, 'f1-score': 0.8439033621710555, 'support': 30257.0} |
-| No log        | 9.0   | 369  | 0.5474          | {'precision': 0.5585284280936454, 'recall': 0.5661016949152542, 'f1-score': 0.5622895622895623, 'support': 295.0}    | {'precision': 0.6875, 'recall': 0.7756410256410257, 'f1-score': 0.7289156626506025, 'support': 156.0}                | {'precision': 0.7355769230769231, 'recall': 0.8418156808803301, 'f1-score': 0.7851186658114176, 'support': 727.0}  | {'precision': 0.604811876119785, 'recall': 0.570359642770939, 'f1-score': 0.587080745341615, 'support': 4143.0}      | {'precision': 0.8211678832116789, 'recall': 0.8207934336525308, 'f1-score': 0.8209806157354618, 'support': 2193.0}  | {'precision': 0.888625217528872, 'recall': 0.8942131656451484, 'f1-score': 0.8914104344376116, 'support': 12563.0}  | {'precision': 0.91595650896268, 'recall': 0.918565815324165, 'f1-score': 0.917259306488793, 'support': 10180.0}     | 0.8477   | {'precision': 0.7445952624276548, 'recall': 0.7696414941184847, 'f1-score': 0.7561507132507234, 'support': 30257.0}   | {'precision': 0.8461371897103921, 'recall': 0.8476716131804211, 'f1-score': 0.8467310896799954, 'support': 30257.0} |
-| No log        | 10.0  | 410  | 0.5962          | {'precision': 0.5531914893617021, 'recall': 0.6169491525423729, 'f1-score': 0.5833333333333334, 'support': 295.0}    | {'precision': 0.6582914572864321, 'recall': 0.8397435897435898, 'f1-score': 0.7380281690140845, 'support': 156.0}    | {'precision': 0.7450248756218906, 'recall': 0.8239339752407153, 'f1-score': 0.782495101241019, 'support': 727.0}   | {'precision': 0.6161803713527851, 'recall': 0.5607048032826454, 'f1-score': 0.5871350941488689, 'support': 4143.0}   | {'precision': 0.776742301458671, 'recall': 0.8741450068399452, 'f1-score': 0.8225702638918686, 'support': 2193.0}   | {'precision': 0.8831158622858041, 'recall': 0.8942927644670858, 'f1-score': 0.888669171445521, 'support': 12563.0}  | {'precision': 0.9232313095835424, 'recall': 0.9037328094302554, 'f1-score': 0.9133780094316207, 'support': 10180.0} | 0.8457   | {'precision': 0.7365396667072609, 'recall': 0.7876431573638013, 'f1-score': 0.7593727346437593, 'support': 30257.0}   | {'precision': 0.8446583764532496, 'recall': 0.8456555507816373, 'f1-score': 0.844598799846626, 'support': 30257.0}  |
-| No log        | 11.0  | 451  | 0.5957          | {'precision': 0.5545171339563862, 'recall': 0.6033898305084746, 'f1-score': 0.577922077922078, 'support': 295.0}     | {'precision': 0.6467661691542289, 'recall': 0.8333333333333334, 'f1-score': 0.7282913165266107, 'support': 156.0}    | {'precision': 0.7694300518134715, 'recall': 0.8170563961485557, 'f1-score': 0.7925283522348232, 'support': 727.0}  | {'precision': 0.6102831594634873, 'recall': 0.5930485155684286, 'f1-score': 0.6015424164524421, 'support': 4143.0}   | {'precision': 0.783003300330033, 'recall': 0.8654810761513908, 'f1-score': 0.8221789040502492, 'support': 2193.0}   | {'precision': 0.892235181338872, 'recall': 0.8890392422192152, 'f1-score': 0.8906343447230972, 'support': 12563.0}  | {'precision': 0.9259629814907454, 'recall': 0.9091355599214146, 'f1-score': 0.917472118959108, 'support': 10180.0}  | 0.8488   | {'precision': 0.7403139967924607, 'recall': 0.7872119934072589, 'f1-score': 0.7615099329812013, 'support': 30257.0}   | {'precision': 0.8495500818518233, 'recall': 0.8487622698879598, 'f1-score': 0.8488747259194414, 'support': 30257.0} |
-| No log        | 12.0  | 492  | 0.6363          | {'precision': 0.546583850931677, 'recall': 0.5966101694915255, 'f1-score': 0.5705024311183144, 'support': 295.0}     | {'precision': 0.6580310880829016, 'recall': 0.8141025641025641, 'f1-score': 0.7277936962750716, 'support': 156.0}    | {'precision': 0.7600502512562815, 'recall': 0.8321870701513068, 'f1-score': 0.7944845699277742, 'support': 727.0}  | {'precision': 0.6018252933507171, 'recall': 0.5570842384745354, 'f1-score': 0.5785911255953873, 'support': 4143.0}   | {'precision': 0.7675276752767528, 'recall': 0.853625170998632, 'f1-score': 0.8082901554404146, 'support': 2193.0}   | {'precision': 0.8818805551224076, 'recall': 0.9003422749343309, 'f1-score': 0.8910157942416007, 'support': 12563.0} | {'precision': 0.9259597806215722, 'recall': 0.8955795677799607, 'f1-score': 0.9105163287725957, 'support': 10180.0} | 0.8433   | {'precision': 0.73455121352033, 'recall': 0.7785044365618364, 'f1-score': 0.7544563001958797, 'support': 30257.0}     | {'precision': 0.8427252530453597, 'recall': 0.8433089863502661, 'f1-score': 0.8425156264772145, 'support': 30257.0} |
-| 0.3164        | 13.0  | 533  | 0.6392          | {'precision': 0.564935064935065, 'recall': 0.5898305084745763, 'f1-score': 0.5771144278606964, 'support': 295.0}     | {'precision': 0.6615384615384615, 'recall': 0.8269230769230769, 'f1-score': 0.7350427350427349, 'support': 156.0}    | {'precision': 0.7632911392405063, 'recall': 0.8294360385144429, 'f1-score': 0.7949901120632828, 'support': 727.0}  | {'precision': 0.6016421995521274, 'recall': 0.5836350470673425, 'f1-score': 0.5925018377848567, 'support': 4143.0}   | {'precision': 0.7977147693609818, 'recall': 0.8595531235750113, 'f1-score': 0.8274802458296752, 'support': 2193.0}  | {'precision': 0.8831720556997876, 'recall': 0.8935763750696489, 'f1-score': 0.8883437524728971, 'support': 12563.0} | {'precision': 0.9303008813696687, 'recall': 0.9020628683693517, 'f1-score': 0.9159642910578025, 'support': 10180.0} | 0.8467   | {'precision': 0.743227795956657, 'recall': 0.7835738625704929, 'f1-score': 0.7616339145874208, 'support': 30257.0}    | {'precision': 0.8471598021098077, 'recall': 0.8466801070826585, 'f1-score': 0.8466487613672259, 'support': 30257.0} |
-| 0.3164        | 14.0  | 574  | 0.6574          | {'precision': 0.5741935483870968, 'recall': 0.6033898305084746, 'f1-score': 0.5884297520661158, 'support': 295.0}    | {'precision': 0.673469387755102, 'recall': 0.8461538461538461, 'f1-score': 0.75, 'support': 156.0}                   | {'precision': 0.7689295039164491, 'recall': 0.8101788170563962, 'f1-score': 0.7890154052243804, 'support': 727.0}  | {'precision': 0.5957288303948348, 'recall': 0.5790489983104031, 'f1-score': 0.5872705018359853, 'support': 4143.0}   | {'precision': 0.7902335456475584, 'recall': 0.8486092111263109, 'f1-score': 0.8183817062445031, 'support': 2193.0}  | {'precision': 0.8890226287915263, 'recall': 0.8818753482448459, 'f1-score': 0.8854345654345654, 'support': 12563.0} | {'precision': 0.9146040824376295, 'recall': 0.9111001964636543, 'f1-score': 0.9128487771271099, 'support': 10180.0} | 0.8432   | {'precision': 0.7437402181900282, 'recall': 0.782908035409133, 'f1-score': 0.7616258154189514, 'support': 30257.0}    | {'precision': 0.8432431379603119, 'recall': 0.8432098357404898, 'f1-score': 0.8430607378149431, 'support': 30257.0} |
-| 0.3164        | 15.0  | 615  | 0.6657          | {'precision': 0.5636942675159236, 'recall': 0.6, 'f1-score': 0.5812807881773399, 'support': 295.0}                   | {'precision': 0.6717948717948717, 'recall': 0.8397435897435898, 'f1-score': 0.7464387464387464, 'support': 156.0}    | {'precision': 0.7634271099744245, 'recall': 0.8211829436038515, 'f1-score': 0.7912524850894631, 'support': 727.0}  | {'precision': 0.5987460815047022, 'recall': 0.5993241612358194, 'f1-score': 0.5990349819059108, 'support': 4143.0}   | {'precision': 0.793854033290653, 'recall': 0.8481532147742818, 'f1-score': 0.8201058201058201, 'support': 2193.0}   | {'precision': 0.8901107721945738, 'recall': 0.8826713364642204, 'f1-score': 0.8863754446265136, 'support': 12563.0} | {'precision': 0.9214414054701537, 'recall': 0.906777996070727, 'f1-score': 0.9140508961283296, 'support': 10180.0}  | 0.8450   | {'precision': 0.7432955059636147, 'recall': 0.7854076059846414, 'f1-score': 0.7626484517817319, 'support': 30257.0}   | {'precision': 0.8464277148202262, 'recall': 0.8450275969197211, 'f1-score': 0.8455573804598716, 'support': 30257.0} |
-| 0.3164        | 16.0  | 656  | 0.6708          | {'precision': 0.5619047619047619, 'recall': 0.6, 'f1-score': 0.580327868852459, 'support': 295.0}                    | {'precision': 0.6789473684210526, 'recall': 0.8269230769230769, 'f1-score': 0.7456647398843931, 'support': 156.0}    | {'precision': 0.7630573248407644, 'recall': 0.8239339752407153, 'f1-score': 0.7923280423280424, 'support': 727.0}  | {'precision': 0.5966467065868264, 'recall': 0.6012551291334781, 'f1-score': 0.5989420533782159, 'support': 4143.0}   | {'precision': 0.7935897435897435, 'recall': 0.8467852257181943, 'f1-score': 0.8193249503639972, 'support': 2193.0}  | {'precision': 0.8916157064692629, 'recall': 0.8820345458887209, 'f1-score': 0.8867992477291825, 'support': 12563.0} | {'precision': 0.9210893854748603, 'recall': 0.9069744597249508, 'f1-score': 0.9139774302118391, 'support': 10180.0} | 0.8450   | {'precision': 0.7438358567553245, 'recall': 0.7839866303755908, 'f1-score': 0.7624806189640186, 'support': 30257.0}   | {'precision': 0.8466380687769368, 'recall': 0.8449945467164623, 'f1-score': 0.8456518702970672, 'support': 30257.0} |
 ### Framework versions

       name: essays_su_g
       type: essays_su_g
       config: full_labels
+      split: train[40%:60%]
       args: full_labels
     metrics:
     - name: Accuracy
       type: accuracy
+      value: 0.8468549981568982
 ---
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 This model is a fine-tuned version of [allenai/longformer-base-4096](https://huggingface.co/allenai/longformer-base-4096) on the essays_su_g dataset.
 It achieves the following results on the evaluation set:
+- Loss: 0.7231
+- B-claim: {'precision': 0.5840978593272171, 'recall': 0.6025236593059937, 'f1-score': 0.5931677018633541, 'support': 317.0}
+- B-majorclaim: {'precision': 0.7365269461077845, 'recall': 0.7935483870967742, 'f1-score': 0.7639751552795031, 'support': 155.0}
+- B-premise: {'precision': 0.7940841865756542, 'recall': 0.8481166464155528, 'f1-score': 0.8202115158636897, 'support': 823.0}
+- I-claim: {'precision': 0.6331192005710207, 'recall': 0.6125690607734806, 'f1-score': 0.6226746226746227, 'support': 4344.0}
+- I-majorclaim: {'precision': 0.8226415094339623, 'recall': 0.8249763481551561, 'f1-score': 0.8238072744449694, 'support': 2114.0}
+- I-premise: {'precision': 0.8901098901098901, 'recall': 0.8988755787462336, 'f1-score': 0.8944712593242651, 'support': 13607.0}
+- O: {'precision': 0.9070680628272252, 'recall': 0.8988326848249028, 'f1-score': 0.9029315960912051, 'support': 8481.0}
+- Accuracy: 0.8469
+- Macro avg: {'precision': 0.7668068078503933, 'recall': 0.7827774807597278, 'f1-score': 0.77446273222023, 'support': 29841.0}
+- Weighted avg: {'precision': 0.8460425407121772, 'recall': 0.8468549981568982, 'f1-score': 0.8463772936317426, 'support': 29841.0}
 ## Model description
 ### Training results
+| Training Loss | Epoch | Step | Validation Loss | B-claim                                                                                                             | B-majorclaim                                                                                                       | B-premise                                                                                                         | I-claim                                                                                                             | I-majorclaim                                                                                                       | I-premise                                                                                                           | O                                                                                                                  | Accuracy | Macro avg                                                                                                             | Weighted avg                                                                                                        |
+|:-------------:|:-----:|:----:|:---------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------------:|:--------:|:---------------------------------------------------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------------------:|
+| No log        | 1.0   | 41   | 0.6935          | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 317.0}                                                | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 155.0}                                               | {'precision': 0.8125, 'recall': 0.015795868772782502, 'f1-score': 0.030989272943980926, 'support': 823.0}         | {'precision': 0.4962158604804212, 'recall': 0.34714548802946593, 'f1-score': 0.4085060273601517, 'support': 4344.0} | {'precision': 0.5727332028701891, 'recall': 0.4153263954588458, 'f1-score': 0.4814916369618864, 'support': 2114.0} | {'precision': 0.7845887659890008, 'recall': 0.9331226574557213, 'f1-score': 0.8524337025847599, 'support': 13607.0} | {'precision': 0.7997794928335171, 'recall': 0.855323664662186, 'f1-score': 0.8266195658367045, 'support': 8481.0}  | 0.7490   | {'precision': 0.49511676031044694, 'recall': 0.36667343919700024, 'f1-score': 0.3714343150982119, 'support': 29841.0} | {'precision': 0.7202786906044678, 'recall': 0.748969538554338, 'f1-score': 0.7180574915034598, 'support': 29841.0}  |
+| No log        | 2.0   | 82   | 0.5276          | {'precision': 0.6521739130434783, 'recall': 0.0473186119873817, 'f1-score': 0.08823529411764705, 'support': 317.0}  | {'precision': 0.0, 'recall': 0.0, 'f1-score': 0.0, 'support': 155.0}                                               | {'precision': 0.5978964401294499, 'recall': 0.8979343863912516, 'f1-score': 0.7178241864983002, 'support': 823.0} | {'precision': 0.6556732223903177, 'recall': 0.4988489871086556, 'f1-score': 0.5666100143809648, 'support': 4344.0}  | {'precision': 0.6422056384742952, 'recall': 0.7327341532639546, 'f1-score': 0.6844896155545735, 'support': 2114.0} | {'precision': 0.8662060301507538, 'recall': 0.9121040640846623, 'f1-score': 0.8885627349203508, 'support': 13607.0} | {'precision': 0.8665807660770762, 'recall': 0.8723027944817828, 'f1-score': 0.8694323657304031, 'support': 8481.0} | 0.8136   | {'precision': 0.6115337157521958, 'recall': 0.5658918567596698, 'f1-score': 0.5450220301717484, 'support': 29841.0}   | {'precision': 0.8056235390174763, 'recall': 0.8136121443651352, 'f1-score': 0.8039755326998906, 'support': 29841.0} |
+| No log        | 3.0   | 123  | 0.4752          | {'precision': 0.5123674911660777, 'recall': 0.45741324921135645, 'f1-score': 0.48333333333333334, 'support': 317.0} | {'precision': 1.0, 'recall': 0.03225806451612903, 'f1-score': 0.0625, 'support': 155.0}                            | {'precision': 0.7192268565615463, 'recall': 0.8590522478736331, 'f1-score': 0.7829457364341085, 'support': 823.0} | {'precision': 0.6404523258802365, 'recall': 0.5736648250460405, 'f1-score': 0.6052216150576806, 'support': 4344.0}  | {'precision': 0.7138364779874213, 'recall': 0.859035004730369, 'f1-score': 0.7797337913267497, 'support': 2114.0}  | {'precision': 0.867799679598802, 'recall': 0.9156316601749099, 'f1-score': 0.8910742383063939, 'support': 13607.0}  | {'precision': 0.9236307534070455, 'recall': 0.8470699209998821, 'f1-score': 0.8836951842056707, 'support': 8481.0} | 0.8313   | {'precision': 0.7681876549430184, 'recall': 0.6491607103646171, 'f1-score': 0.6412148426662767, 'support': 29841.0}   | {'precision': 0.8324782036689456, 'recall': 0.831339432324654, 'f1-score': 0.8278601406223198, 'support': 29841.0}  |
+| No log        | 4.0   | 164  | 0.4750          | {'precision': 0.5775075987841946, 'recall': 0.5993690851735016, 'f1-score': 0.5882352941176471, 'support': 317.0}   | {'precision': 0.7931034482758621, 'recall': 0.44516129032258067, 'f1-score': 0.5702479338842975, 'support': 155.0} | {'precision': 0.77491601343785, 'recall': 0.8408262454434994, 'f1-score': 0.8065268065268065, 'support': 823.0}   | {'precision': 0.6112942210503186, 'recall': 0.6404235727440147, 'f1-score': 0.6255199550309162, 'support': 4344.0}  | {'precision': 0.7840629611411707, 'recall': 0.7540208136234626, 'f1-score': 0.768748492886424, 'support': 2114.0}  | {'precision': 0.8953488372093024, 'recall': 0.8771220695230396, 'f1-score': 0.8861417381297101, 'support': 13607.0} | {'precision': 0.8846600139243443, 'recall': 0.89895059544865, 'f1-score': 0.8917480554418388, 'support': 8481.0}   | 0.8340   | {'precision': 0.7601275848318633, 'recall': 0.7222676674683927, 'f1-score': 0.7338811822882343, 'support': 29841.0}   | {'precision': 0.8358480354026695, 'recall': 0.8339532857477967, 'f1-score': 0.834478384347318, 'support': 29841.0}  |
+| No log        | 5.0   | 205  | 0.4792          | {'precision': 0.547486033519553, 'recall': 0.6182965299684543, 'f1-score': 0.5807407407407407, 'support': 317.0}    | {'precision': 0.7142857142857143, 'recall': 0.7419354838709677, 'f1-score': 0.7278481012658229, 'support': 155.0}  | {'precision': 0.7789115646258503, 'recall': 0.8347509113001215, 'f1-score': 0.8058651026392962, 'support': 823.0} | {'precision': 0.5776986951364176, 'recall': 0.6726519337016574, 'f1-score': 0.6215698787492023, 'support': 4344.0}  | {'precision': 0.7845402043536206, 'recall': 0.8353831598864712, 'f1-score': 0.809163802978236, 'support': 2114.0}  | {'precision': 0.8960392246993029, 'recall': 0.8595575806570148, 'f1-score': 0.8774193548387097, 'support': 13607.0} | {'precision': 0.9226293637038872, 'recall': 0.8787878787878788, 'f1-score': 0.9001751313485113, 'support': 8481.0} | 0.8322   | {'precision': 0.745941542903478, 'recall': 0.7773376397389379, 'f1-score': 0.7603974446515027, 'support': 29841.0}    | {'precision': 0.8414791080647194, 'recall': 0.8322442277403572, 'f1-score': 0.8359049808325034, 'support': 29841.0} |
+| No log        | 6.0   | 246  | 0.4945          | {'precision': 0.6072607260726073, 'recall': 0.580441640378549, 'f1-score': 0.5935483870967742, 'support': 317.0}    | {'precision': 0.7516339869281046, 'recall': 0.7419354838709677, 'f1-score': 0.7467532467532468, 'support': 155.0}  | {'precision': 0.7650214592274678, 'recall': 0.8663426488456865, 'f1-score': 0.8125356125356125, 'support': 823.0} | {'precision': 0.6300925925925925, 'recall': 0.6266114180478821, 'f1-score': 0.6283471837488457, 'support': 4344.0}  | {'precision': 0.8326810176125244, 'recall': 0.8051087984862819, 'f1-score': 0.8186628186628185, 'support': 2114.0} | {'precision': 0.8907519953137585, 'recall': 0.894025134122143, 'f1-score': 0.8923855633802816, 'support': 13607.0}  | {'precision': 0.9025142314990512, 'recall': 0.8972998467161891, 'f1-score': 0.8998994856027908, 'support': 8481.0} | 0.8448   | {'precision': 0.7685651441780151, 'recall': 0.7731092814953856, 'f1-score': 0.7703046139686244, 'support': 29841.0}   | {'precision': 0.8448347263870494, 'recall': 0.8448443416775577, 'f1-score': 0.8447287176785023, 'support': 29841.0} |
+| No log        | 7.0   | 287  | 0.5387          | {'precision': 0.6120401337792643, 'recall': 0.5772870662460567, 'f1-score': 0.5941558441558441, 'support': 317.0}   | {'precision': 0.6982248520710059, 'recall': 0.7612903225806451, 'f1-score': 0.7283950617283951, 'support': 155.0}  | {'precision': 0.7609860664523044, 'recall': 0.8626974483596598, 'f1-score': 0.8086560364464692, 'support': 823.0} | {'precision': 0.6266696349065004, 'recall': 0.6480202578268877, 'f1-score': 0.637166138524219, 'support': 4344.0}   | {'precision': 0.8459657701711492, 'recall': 0.8183538315988647, 'f1-score': 0.831930752584756, 'support': 2114.0}  | {'precision': 0.8917117250574031, 'recall': 0.8847651943852429, 'f1-score': 0.8882248782647189, 'support': 13607.0} | {'precision': 0.9062128064746489, 'recall': 0.8977714892111779, 'f1-score': 0.9019723982704495, 'support': 8481.0} | 0.8448   | {'precision': 0.7631158555588966, 'recall': 0.778597944315505, 'f1-score': 0.7700715871392646, 'support': 29841.0}    | {'precision': 0.8464284003187731, 'recall': 0.844777319794913, 'f1-score': 0.8454484668795899, 'support': 29841.0}  |
+| No log        | 8.0   | 328  | 0.5540          | {'precision': 0.6006493506493507, 'recall': 0.583596214511041, 'f1-score': 0.5920000000000001, 'support': 317.0}    | {'precision': 0.6931818181818182, 'recall': 0.7870967741935484, 'f1-score': 0.7371601208459214, 'support': 155.0}  | {'precision': 0.7774122807017544, 'recall': 0.8614823815309842, 'f1-score': 0.8172910662824208, 'support': 823.0} | {'precision': 0.6259250417760802, 'recall': 0.6035911602209945, 'f1-score': 0.61455525606469, 'support': 4344.0}    | {'precision': 0.7801418439716312, 'recall': 0.8325449385052034, 'f1-score': 0.805491990846682, 'support': 2114.0}  | {'precision': 0.8873371924746744, 'recall': 0.9012273094730653, 'f1-score': 0.8942283151638896, 'support': 13607.0} | {'precision': 0.919682151589242, 'recall': 0.8870416224501828, 'f1-score': 0.9030670427945501, 'support': 8481.0}  | 0.8439   | {'precision': 0.7549042399063646, 'recall': 0.779511485840717, 'f1-score': 0.7662562559997363, 'support': 29841.0}    | {'precision': 0.8437960885444236, 'recall': 0.8439395462618545, 'f1-score': 0.8435933360695711, 'support': 29841.0} |
+| No log        | 9.0   | 369  | 0.5799          | {'precision': 0.6095238095238096, 'recall': 0.6056782334384858, 'f1-score': 0.6075949367088608, 'support': 317.0}   | {'precision': 0.7109826589595376, 'recall': 0.7935483870967742, 'f1-score': 0.7500000000000001, 'support': 155.0}  | {'precision': 0.7925591882750845, 'recall': 0.8541919805589308, 'f1-score': 0.8222222222222222, 'support': 823.0} | {'precision': 0.6367403314917127, 'recall': 0.6367403314917127, 'f1-score': 0.6367403314917127, 'support': 4344.0}  | {'precision': 0.7997323818019625, 'recall': 0.848155156102176, 'f1-score': 0.8232323232323232, 'support': 2114.0}  | {'precision': 0.8937833296807656, 'recall': 0.8991695450870876, 'f1-score': 0.896468347010551, 'support': 13607.0}  | {'precision': 0.9211329507996582, 'recall': 0.8896356561726212, 'f1-score': 0.9051103646833014, 'support': 8481.0} | 0.8497   | {'precision': 0.7663506643617902, 'recall': 0.7895884699925412, 'f1-score': 0.7773383607641389, 'support': 29841.0}   | {'precision': 0.8507144582800709, 'recall': 0.8497369391106196, 'f1-score': 0.8500501127908038, 'support': 29841.0} |
+| No log        | 10.0  | 410  | 0.6519          | {'precision': 0.593103448275862, 'recall': 0.5425867507886435, 'f1-score': 0.5667215815485995, 'support': 317.0}    | {'precision': 0.6864864864864865, 'recall': 0.8193548387096774, 'f1-score': 0.7470588235294117, 'support': 155.0}  | {'precision': 0.785234899328859, 'recall': 0.8529769137302552, 'f1-score': 0.8177052999417589, 'support': 823.0}  | {'precision': 0.6414194915254238, 'recall': 0.5575506445672191, 'f1-score': 0.596551724137931, 'support': 4344.0}   | {'precision': 0.7576142131979695, 'recall': 0.8472090823084201, 'f1-score': 0.799910674408218, 'support': 2114.0}  | {'precision': 0.8857348185411427, 'recall': 0.9057837877563019, 'f1-score': 0.8956471186687013, 'support': 13607.0} | {'precision': 0.9042414161815374, 'recall': 0.8974177573399363, 'f1-score': 0.9008166646940468, 'support': 8481.0} | 0.8428   | {'precision': 0.7505478247910401, 'recall': 0.7746971107429219, 'f1-score': 0.7606302695612381, 'support': 29841.0}   | {'precision': 0.8394375310836902, 'recall': 0.8428001742568949, 'f1-score': 0.8403788295700347, 'support': 29841.0} |
+| No log        | 11.0  | 451  | 0.6617          | {'precision': 0.5849056603773585, 'recall': 0.5867507886435331, 'f1-score': 0.5858267716535434, 'support': 317.0}   | {'precision': 0.6927374301675978, 'recall': 0.8, 'f1-score': 0.7425149700598802, 'support': 155.0}                 | {'precision': 0.7931428571428571, 'recall': 0.8432563791008505, 'f1-score': 0.8174322732626619, 'support': 823.0} | {'precision': 0.6108083560399636, 'recall': 0.6192449355432781, 'f1-score': 0.6149977137631457, 'support': 4344.0}  | {'precision': 0.7798442906574394, 'recall': 0.8528855250709555, 'f1-score': 0.8147311342069589, 'support': 2114.0} | {'precision': 0.8911875138040197, 'recall': 0.8896156390093334, 'f1-score': 0.8904008826774549, 'support': 13607.0} | {'precision': 0.9186046511627907, 'recall': 0.8849192312227332, 'f1-score': 0.9014473605188877, 'support': 8481.0} | 0.8414   | {'precision': 0.7530329656217181, 'recall': 0.7823817855129549, 'f1-score': 0.7667644437346476, 'support': 29841.0}   | {'precision': 0.843288188846705, 'recall': 0.8413592037800341, 'f1-score': 0.8420728269602915, 'support': 29841.0}  |
+| No log        | 12.0  | 492  | 0.6726          | {'precision': 0.568733153638814, 'recall': 0.6656151419558359, 'f1-score': 0.6133720930232559, 'support': 317.0}    | {'precision': 0.7409638554216867, 'recall': 0.7935483870967742, 'f1-score': 0.766355140186916, 'support': 155.0}   | {'precision': 0.8093525179856115, 'recall': 0.8201701093560145, 'f1-score': 0.8147254073627037, 'support': 823.0} | {'precision': 0.5959249546096429, 'recall': 0.6800184162062615, 'f1-score': 0.6352005160735404, 'support': 4344.0}  | {'precision': 0.8207954000958313, 'recall': 0.8103122043519394, 'f1-score': 0.8155201142585099, 'support': 2114.0} | {'precision': 0.9055836784782942, 'recall': 0.8677151466157125, 'f1-score': 0.8862450741227248, 'support': 13607.0} | {'precision': 0.9062947067238912, 'recall': 0.8963565617262116, 'f1-score': 0.9012982393739997, 'support': 8481.0} | 0.8406   | {'precision': 0.7639497524219674, 'recall': 0.7905337096155357, 'f1-score': 0.7761023692002358, 'support': 29841.0}   | {'precision': 0.8476142531752411, 'recall': 0.8406219630709426, 'f1-score': 0.8434741015904832, 'support': 29841.0} |
+| 0.3002        | 13.0  | 533  | 0.6932          | {'precision': 0.5880398671096345, 'recall': 0.5583596214511041, 'f1-score': 0.5728155339805825, 'support': 317.0}   | {'precision': 0.7365269461077845, 'recall': 0.7935483870967742, 'f1-score': 0.7639751552795031, 'support': 155.0}  | {'precision': 0.78, 'recall': 0.8529769137302552, 'f1-score': 0.8148578061520603, 'support': 823.0}               | {'precision': 0.650231124807396, 'recall': 0.5828729281767956, 'f1-score': 0.6147123088128186, 'support': 4344.0}   | {'precision': 0.8384912959381045, 'recall': 0.8202459791863765, 'f1-score': 0.8292682926829268, 'support': 2114.0} | {'precision': 0.8844858473665352, 'recall': 0.9071066362901448, 'f1-score': 0.8956534358899934, 'support': 13607.0} | {'precision': 0.8977325853202431, 'recall': 0.9056715010022403, 'f1-score': 0.9016845688794975, 'support': 8481.0} | 0.8476   | {'precision': 0.7679296666642426, 'recall': 0.7743974238476702, 'f1-score': 0.7704238716681975, 'support': 29841.0}   | {'precision': 0.8440921517882902, 'recall': 0.8475587279246674, 'f1-score': 0.8454258643758608, 'support': 29841.0} |
+| 0.3002        | 14.0  | 574  | 0.6972          | {'precision': 0.58125, 'recall': 0.5867507886435331, 'f1-score': 0.5839874411302983, 'support': 317.0}              | {'precision': 0.7469879518072289, 'recall': 0.8, 'f1-score': 0.7725856697819314, 'support': 155.0}                 | {'precision': 0.7891770011273957, 'recall': 0.850546780072904, 'f1-score': 0.8187134502923977, 'support': 823.0}  | {'precision': 0.6454117647058824, 'recall': 0.6314456721915286, 'f1-score': 0.6383523388410519, 'support': 4344.0}  | {'precision': 0.8318417333961375, 'recall': 0.8353831598864712, 'f1-score': 0.8336086853906065, 'support': 2114.0} | {'precision': 0.8906204906204906, 'recall': 0.9071801278753583, 'f1-score': 0.8988240433975317, 'support': 13607.0} | {'precision': 0.9179113539769278, 'recall': 0.8912864049050819, 'f1-score': 0.9044029672170375, 'support': 8481.0} | 0.8519   | {'precision': 0.7718857565191518, 'recall': 0.7860847047964111, 'f1-score': 0.7786392280072649, 'support': 29841.0}   | {'precision': 0.8516870545119499, 'recall': 0.8519151502965718, 'f1-score': 0.8516627328696869, 'support': 29841.0} |
+| 0.3002        | 15.0  | 615  | 0.7235          | {'precision': 0.5818181818181818, 'recall': 0.6056782334384858, 'f1-score': 0.5935085007727976, 'support': 317.0}   | {'precision': 0.7071823204419889, 'recall': 0.8258064516129032, 'f1-score': 0.761904761904762, 'support': 155.0}   | {'precision': 0.7977011494252874, 'recall': 0.8432563791008505, 'f1-score': 0.819846426461902, 'support': 823.0}  | {'precision': 0.6238979118329466, 'recall': 0.6190147329650092, 'f1-score': 0.621446729835914, 'support': 4344.0}   | {'precision': 0.7945389435989257, 'recall': 0.8396404919583728, 'f1-score': 0.8164673413063478, 'support': 2114.0} | {'precision': 0.8926267956610965, 'recall': 0.8950540163151319, 'f1-score': 0.8938387582107079, 'support': 13607.0} | {'precision': 0.9125967117988395, 'recall': 0.89010729866761, 'f1-score': 0.9012117232734437, 'support': 8481.0}   | 0.8447   | {'precision': 0.7586231449396095, 'recall': 0.7883653720083377, 'f1-score': 0.7726034631094107, 'support': 29841.0}   | {'precision': 0.8453513972849044, 'recall': 0.8446767869709461, 'f1-score': 0.8448841595054579, 'support': 29841.0} |
+| 0.3002        | 16.0  | 656  | 0.7231          | {'precision': 0.5840978593272171, 'recall': 0.6025236593059937, 'f1-score': 0.5931677018633541, 'support': 317.0}   | {'precision': 0.7365269461077845, 'recall': 0.7935483870967742, 'f1-score': 0.7639751552795031, 'support': 155.0}  | {'precision': 0.7940841865756542, 'recall': 0.8481166464155528, 'f1-score': 0.8202115158636897, 'support': 823.0} | {'precision': 0.6331192005710207, 'recall': 0.6125690607734806, 'f1-score': 0.6226746226746227, 'support': 4344.0}  | {'precision': 0.8226415094339623, 'recall': 0.8249763481551561, 'f1-score': 0.8238072744449694, 'support': 2114.0} | {'precision': 0.8901098901098901, 'recall': 0.8988755787462336, 'f1-score': 0.8944712593242651, 'support': 13607.0} | {'precision': 0.9070680628272252, 'recall': 0.8988326848249028, 'f1-score': 0.9029315960912051, 'support': 8481.0} | 0.8469   | {'precision': 0.7668068078503933, 'recall': 0.7827774807597278, 'f1-score': 0.77446273222023, 'support': 29841.0}     | {'precision': 0.8460425407121772, 'recall': 0.8468549981568982, 'f1-score': 0.8463772936317426, 'support': 29841.0} |
 ### Framework versions

meta_data/meta_s42_e16_cvi2.json CHANGED Viewed

@@ -1 +1 @@

- {"B-Claim": {"precision": 0.~~5818181818181818~~, "recall": 0.~~6056782334384858~~, "f1-score": 0.~~5935085007727976~~, "support": 317.0}, "B-MajorClaim": {"precision": 0.~~7071823204419889~~, "recall": 0.~~8258064516129032~~, "f1-score": 0.~~761904761904762~~, "support": 155.0}, "B-Premise": {"precision": 0.~~7977011494252874~~, "recall": 0.~~8432563791008505~~, "f1-score": 0.~~819846426461902~~, "support": 823.0}, "I-Claim": {"precision": 0.~~6238979118329466~~, "recall": 0.~~6190147329650092~~, "f1-score": 0.~~621446729835914~~, "support": 4344.0}, "I-MajorClaim": {"precision": 0.~~7945389435989257~~, "recall": 0.~~8396404919583728~~, "f1-score": 0.~~8164673413063478~~, "support": 2114.0}, "I-Premise": {"precision": 0.~~8926267956610965~~, "recall": 0.~~8950540163151319~~, "f1-score": 0.~~8938387582107079~~, "support": 13607.0}, "O": {"precision": 0.~~9125967117988395~~, "recall": 0.~~89010729866761~~, "f1-score": 0.~~9012117232734437~~, "support": 8481.0}, "accuracy": 0.~~8446767869709461~~, "macro avg": {"precision": 0.~~7586231449396095~~, "recall": 0.~~7883653720083377~~, "f1-score": 0.~~7726034631094107~~, "support": 29841.0}, "weighted avg": {"precision": 0.~~8453513972849044~~, "recall": 0.~~8446767869709461~~, "f1-score": 0.~~8448841595054579~~, "support": 29841.0}}

+ {"B-Claim": {"precision": 0.5840978593272171, "recall": 0.6025236593059937, "f1-score": 0.5931677018633541, "support": 317.0}, "B-MajorClaim": {"precision": 0.7365269461077845, "recall": 0.7935483870967742, "f1-score": 0.7639751552795031, "support": 155.0}, "B-Premise": {"precision": 0.7940841865756542, "recall": 0.8481166464155528, "f1-score": 0.8202115158636897, "support": 823.0}, "I-Claim": {"precision": 0.6331192005710207, "recall": 0.6125690607734806, "f1-score": 0.6226746226746227, "support": 4344.0}, "I-MajorClaim": {"precision": 0.8226415094339623, "recall": 0.8249763481551561, "f1-score": 0.8238072744449694, "support": 2114.0}, "I-Premise": {"precision": 0.8901098901098901, "recall": 0.8988755787462336, "f1-score": 0.8944712593242651, "support": 13607.0}, "O": {"precision": 0.9070680628272252, "recall": 0.8988326848249028, "f1-score": 0.9029315960912051, "support": 8481.0}, "accuracy": 0.8468549981568982, "macro avg": {"precision": 0.7668068078503933, "recall": 0.7827774807597278, "f1-score": 0.77446273222023, "support": 29841.0}, "weighted avg": {"precision": 0.8460425407121772, "recall": 0.8468549981568982, "f1-score": 0.8463772936317426, "support": 29841.0}}

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4da62bb0e4c11f2910c3f09a7318902579e2a922f08a1afbb129a00e365d1dbb
 size 592330980

 version https://git-lfs.github.com/spec/v1
+oid sha256:0fcd047e963b2992c6fe79e2ce567d0b7121a9ae1f866cd7c98da29245bbc948
 size 592330980