Update README.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,49 @@
|
|
| 1 |
-
|
| 2 |
|
| 3 |
-
|
| 4 |
|
| 5 |
-
|
| 6 |
|
| 7 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
|
| 3 |
+
datasets:
|
| 4 |
|
| 5 |
+
- arxiv
|
| 6 |
|
| 7 |
+
|
| 8 |
+
widget:
|
| 9 |
+
|
| 10 |
+
- text: "summarize: We describe a system called Overton, whose main design goal is to support engineers in building, monitoring, and improving production
|
| 11 |
+
machinelearning systems. Key challenges engineers face are monitoring fine-grained quality, diagnosing errors in sophisticated applications, and
|
| 12 |
+
handling contradictory or incomplete supervision data. Overton automates the life cycle of model construction, deployment, and monitoring by providing a set of novel high-level, declarative abstractions. Overton's vision is to shift developers to these higher-level tasks instead of lower-level machine learning tasks.
|
| 13 |
+
In fact, using Overton, engineers can build deep-learning-based applications without writing any code in frameworks like TensorFlow. For over a year,
|
| 14 |
+
Overton has been used in production to support multiple applications in both near-real-time applications and back-of-house processing.
|
| 15 |
+
In that time, Overton-based applications have answered billions of queries in multiple languages and processed trillions of records reducing errors
|
| 16 |
+
1.7-2.9 times versus production systems."
|
| 17 |
+
|
| 18 |
+
license: mit
|
| 19 |
+
---
|
| 20 |
+
|
| 21 |
+
# T5 One Line Summary
|
| 22 |
+
A T5 model trained on 370,000 research papers, to generate one line summary based on description/abstract of the papers. It is trained using [simpleT5] library - A python package built on top of pytorch lightning⚡️ & transformers🤗 to quickly train T5 models
|
| 23 |
+
|
| 24 |
+
## Usage:
|
| 25 |
+
```python
|
| 26 |
+
abstract = """We describe a system called Overton, whose main design goal is to support engineers in building, monitoring, and improving production
|
| 27 |
+
machine learning systems. Key challenges engineers face are monitoring fine-grained quality, diagnosing errors in sophisticated applications, and
|
| 28 |
+
handling contradictory or incomplete supervision data. Overton automates the life cycle of model construction, deployment, and monitoring by providing a
|
| 29 |
+
set of novel high-level, declarative abstractions. Overton's vision is to shift developers to these higher-level tasks instead of lower-level machine learning tasks.
|
| 30 |
+
In fact, using Overton, engineers can build deep-learning-based applications without writing any code in frameworks like TensorFlow. For over a year,
|
| 31 |
+
Overton has been used in production to support multiple applications in both near-real-time applications and back-of-house processing. In that time,
|
| 32 |
+
Overton-based applications have answered billions of queries in multiple languages and processed trillions of records reducing errors 1.7-2.9 times versus production systems.
|
| 33 |
+
"""
|
| 34 |
+
```
|
| 35 |
+
### Using Transformers🤗
|
| 36 |
+
```python
|
| 37 |
+
model_name = "Suva/uptag-url-model"
|
| 38 |
+
from transformers import AutoModelForSeq2SeqLM, AutoTokenizer
|
| 39 |
+
model = AutoModelForSeq2SeqLM.from_pretrained(model_name)
|
| 40 |
+
tokenizer = AutoTokenizer.from_pretrained(model_name)
|
| 41 |
+
input_ids = tokenizer.encode("summarize: " + abstract, return_tensors="pt", add_special_tokens=True)
|
| 42 |
+
generated_ids = model.generate(input_ids=input_ids,num_beams=5,max_length=50,repetition_penalty=2.5,length_penalty=1,early_stopping=True,num_return_sequences=3)
|
| 43 |
+
preds = [tokenizer.decode(g, skip_special_tokens=True, clean_up_tokenization_spaces=True) for g in generated_ids]
|
| 44 |
+
print(preds)
|
| 45 |
+
# output
|
| 46 |
+
["Overton: Building, Deploying, and Monitoring Machine Learning Systems for Engineers",
|
| 47 |
+
"Overton: A System for Building, Monitoring, and Improving Production Machine Learning Systems",
|
| 48 |
+
"Overton: Building, Monitoring, and Improving Production Machine Learning Systems"]
|
| 49 |
+
```
|