AlgorithmicResearchGroup
/

led_large_16384_billsum_summarization

text2text-generation

Eval Results (legacy)

Model card Files Files and versions

ArtifactAI commited on Nov 26, 2022

Commit

1de5f30

·

1 Parent(s): 5e23461

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -163,7 +163,7 @@ model-index:
 # Longformer Encoder-Decoder (LED) fine-tuned on Billsum
 This model is a fine-tuned version of led-large-16384 on the billsum dataset.
-As described in Longformer: The Long-Document Transformer by Iz Beltagy, Matthew E. Peters, Arman Cohan, led-base-16384 was initialized from bart-base since both models share the exact same architecture. To be able to process 16K tokens, bart-base's position embedding matrix was simply copied 16 times.
 # Use In Transformers

 # Longformer Encoder-Decoder (LED) fine-tuned on Billsum
 This model is a fine-tuned version of led-large-16384 on the billsum dataset.
+As described in Longformer: The Long-Document Transformer by Iz Beltagy, Matthew E. Peters, Arman Cohan, led-large-16384 was initialized from bart-base since both models share the exact same architecture. To be able to process 16K tokens, bart-base's position embedding matrix was simply copied 16 times.
 # Use In Transformers