ArtifactAI
commited on
Commit
·
dde5eeb
1
Parent(s):
1c11a8b
Update README.md
Browse files
README.md
CHANGED
|
@@ -179,4 +179,31 @@ from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
|
|
| 179 |
tokenizer = AutoTokenizer.from_pretrained("Artifact-AI/led_large_16384_billsum_summarization")
|
| 180 |
|
| 181 |
model = AutoModelForSeq2SeqLM.from_pretrained("Artifact-AI/led_large_16384_billsum_summarization")
|
| 182 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 179 |
tokenizer = AutoTokenizer.from_pretrained("Artifact-AI/led_large_16384_billsum_summarization")
|
| 180 |
|
| 181 |
model = AutoModelForSeq2SeqLM.from_pretrained("Artifact-AI/led_large_16384_billsum_summarization")
|
| 182 |
+
```
|
| 183 |
+
|
| 184 |
+
### Results
|
| 185 |
+
|
| 186 |
+
| Model | Rouge-1 | Rouge-2 | Rouge-L | Rouge-Lsum |
|
| 187 |
+
| --- | --- | --- | --- | --- |
|
| 188 |
+
| LED Large | 47.843 | 26.342 | 34.230 | 41.689 |
|
| 189 |
+
| LED Base | 47.672 | 26.737 | 34.568 | 41.529 |
|
| 190 |
+
|
| 191 |
+
|
| 192 |
+
[
|
| 193 |
+
|
| 194 |
+
|
| 195 |
+
The model is trained on the BillSum summarization dataset found [here](https://huggingface.co/datasets/billsum)
|
| 196 |
+
|
| 197 |
+
### Test The Model
|
| 198 |
+
|
| 199 |
+
Please find a notebook to test the model below:
|
| 200 |
+
|
| 201 |
+
[](https://colab.research.google.com/drive/1TX4IVyvwduDqsok6XuS6i9VIOs9pTXra?usp=sharing)
|
| 202 |
+
|
| 203 |
+
## Citing & Authors
|
| 204 |
+
|
| 205 |
+
@misc{led_large_16384_billsum_summarization,
|
| 206 |
+
title={led_large_16384_billsum_summarization},
|
| 207 |
+
author={Matthew Kenney},
|
| 208 |
+
year={2023}
|
| 209 |
+
}
|