Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,47 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
widget:
|
| 6 |
+
- text: >-
|
| 7 |
+
A nervous passenger is about to book a flight ticket, and he asks the
|
| 8 |
+
airlines' ticket seller, 'I hope your planes are safe. Do they have a good
|
| 9 |
+
track record for safety?' The airline agent replies, 'Sir, I can guarantee
|
| 10 |
+
you, we've never had a plane that has crashed more than once.'
|
| 11 |
+
example_title: A joke
|
| 12 |
+
- text: >-
|
| 13 |
+
Let me, however, hasten to assure that I am the same Gandhi as I was in
|
| 14 |
+
1920. I have not changed in any fundamental respect. I attach the same
|
| 15 |
+
importance to nonviolence that I did then. If at all, my emphasis on it has
|
| 16 |
+
grown stronger. There is no real contradiction between the present
|
| 17 |
+
resolution and my previous writings and utterances.
|
| 18 |
+
example_title: Not a joke
|
| 19 |
+
tags:
|
| 20 |
+
- distilbert
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
### What is this?
|
| 24 |
+
This model has been developed to detect "narrative-style" jokes, stories and anecdotes (i.e. they are narrated as a story) spoken during speeches or conversations etc. It works best when jokes/anecdotes are at least 40 words or longer. It is based on [lvwerra's distilbert](https://huggingface.co/lvwerra/distilbert-imdb).
|
| 25 |
+
|
| 26 |
+
The training dataset was a private collection of around 2000 jokes. This model has not been trained or tested on one-liners, puns or Reddit-style language-manipulation jokes such as knock-knock, Q&A jokes etc.
|
| 27 |
+
|
| 28 |
+
See the example in the inference widget or How to use section for what constitues a narrative-style joke.
|
| 29 |
+
|
| 30 |
+
For a more accurate model (2.4% more) that is slower at inference, see the [Roberta model](Reggie/muppet-roberta-base-joke_detector). For a still more accurate model (2.9% more) that is much slower at inference, see the [Deberta-v3 model](https://huggingface.co/Reggie/DeBERTa-v3-base-joke_detector).
|
| 31 |
+
|
| 32 |
+
|
| 33 |
+
### Install these first
|
| 34 |
+
You'll need to pip install transformers & maybe sentencepiece
|
| 35 |
+
|
| 36 |
+
### How to use
|
| 37 |
+
```python
|
| 38 |
+
from transformers import pipeline
|
| 39 |
+
device = 0 if torch.cuda.is_available() else -1
|
| 40 |
+
model_name = 'Reggie/distilbert-joke_detector'
|
| 41 |
+
max_seq_len = 510
|
| 42 |
+
|
| 43 |
+
pipe = pipeline(model=model_name, device=device, truncation=True, max_length=max_seq_len)
|
| 44 |
+
is_it_a_joke = """A nervous passenger is about to book a flight ticket, and he asks the airlines' ticket seller, "I hope your planes are safe. Do they have a good track record for safety?" The airline agent replies, "Sir, I can guarantee you, we've never had a plane that has crashed more than once." """
|
| 45 |
+
result = pipe(is_it_a_joke) # [{'label': 'LABEL_1', 'score': 0.7313136458396912}]
|
| 46 |
+
print('This is a joke') if result[0]['label'] == 'LABEL_1' else print('This is not a joke')
|
| 47 |
+
```
|