oluwatosin adewumi commited on
Commit ·
e98e1e0
1
Parent(s): 066460b
modification to README
Browse files
README.md
CHANGED
|
@@ -1,4 +1,5 @@
|
|
| 1 |
---
|
|
|
|
| 2 |
language:
|
| 3 |
- en
|
| 4 |
license: cc-by-4.0
|
|
@@ -13,9 +14,44 @@ widget:
|
|
| 13 |
- text: "I would like to have breakfast."
|
| 14 |
---
|
| 15 |
|
| 16 |
-
DialoGPT_MWOZ
|
| 17 |
|
| 18 |
This is a fine-tuned model of DialoGPT (medium) on the MultiWOZ v2.2 dataset. It is intended to be used as a conversational system.
|
| 19 |
The dataset it's trained on is limited in scope, as it covers only certain domains such as restaurants, hotel, taxi, train, hospital and police.
|
| 20 |
|
| 21 |
-
The perplexity achieved on the test and validation sets are 10.25 and 10.71, respectively.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
thumbnail: https://huggingface.co/front/thumbnails/dialogpt.png
|
| 3 |
language:
|
| 4 |
- en
|
| 5 |
license: cc-by-4.0
|
|
|
|
| 14 |
- text: "I would like to have breakfast."
|
| 15 |
---
|
| 16 |
|
| 17 |
+
## DialoGPT_MWOZ
|
| 18 |
|
| 19 |
This is a fine-tuned model of DialoGPT (medium) on the MultiWOZ v2.2 dataset. It is intended to be used as a conversational system.
|
| 20 |
The dataset it's trained on is limited in scope, as it covers only certain domains such as restaurants, hotel, taxi, train, hospital and police.
|
| 21 |
|
| 22 |
+
The perplexity achieved on the test and validation sets are 10.25 and 10.71, respectively. More information about the original pre-trained model can be found [here](https://huggingface.co/microsoft/DialoGPT-medium)
|
| 23 |
+
|
| 24 |
+
* Generation example from an interactive environment:
|
| 25 |
+
|
| 26 |
+
|Role | Response |
|
| 27 |
+
|---------|------------|
|
| 28 |
+
|User | I would like to have breakfast. |
|
| 29 |
+
|Bot | There are several options for Chinese in the city centre. Are you looking for a particular price range? |
|
| 30 |
+
|User | I'm looking for free food |
|
| 31 |
+
|Bot | There are 4 Chinese restaurants that are in the cheap price range. 3 in centre and one in north. |
|
| 32 |
+
|User | Not good enough |
|
| 33 |
+
|Bot | How about Charlie Chan? It is a Chinese restaurant in the centre of town. |
|
| 34 |
+
|
| 35 |
+
Please find the information about preprocessing, training and full details of the DialoGPT in the [original DialoGPT repository](https://github.com/microsoft/DialoGPT)
|
| 36 |
+
|
| 37 |
+
The paper for this work was accepted at the Northern Lights Deep Learning (NLDL) conference 2022. Arxiv paper: [https://arxiv.org/pdf/2110.06273.pdf](https://arxiv.org/pdf/2110.06273.pdf)
|
| 38 |
+
|
| 39 |
+
### How to use
|
| 40 |
+
|
| 41 |
+
Now we are ready to try out how the model works as a chatting partner!
|
| 42 |
+
|
| 43 |
+
```python
|
| 44 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 45 |
+
import torch
|
| 46 |
+
tokenizer = AutoTokenizer.from_pretrained("tosin/dialogpt_mwoz")
|
| 47 |
+
model = AutoModelForCausalLM.from_pretrained("tosin/dialogpt_mwoz")
|
| 48 |
+
# Let's chat for 5 lines
|
| 49 |
+
for step in range(5):
|
| 50 |
+
# encode the new user input, add the eos_token and return a tensor in Pytorch
|
| 51 |
+
new_user_input_ids = tokenizer.encode(input(">> User:") + tokenizer.eos_token, return_tensors='pt')
|
| 52 |
+
# append the new user input tokens to the chat history
|
| 53 |
+
bot_input_ids = torch.cat([chat_history_ids, new_user_input_ids], dim=-1) if step > 0 else new_user_input_ids
|
| 54 |
+
# generated a response while limiting the total chat history to 1000 tokens,
|
| 55 |
+
chat_history_ids = model.generate(bot_input_ids, max_length=1000, pad_token_id=tokenizer.eos_token_id)
|
| 56 |
+
# pretty print last ouput tokens from bot
|
| 57 |
+
print("DialoGPT_MWOZ_Bot: {}".format(tokenizer.decode(chat_history_ids[:, bot_input_ids.shape[-1]:][0], skip_special_tokens=True)))
|