Spaces:
Build error
Build error
Update app.py
Browse files
app.py
CHANGED
|
@@ -41,7 +41,9 @@ with gr.Blocks() as demo:
|
|
| 41 |
gr.Markdown("""
|
| 42 |
# Phi-2 Chatbot Demo
|
| 43 |
|
| 44 |
-
This chatbot was created using Microsoft's 2.7 billion parameter [phi-2](https://huggingface.co/microsoft/phi-2) Transformer model.
|
|
|
|
|
|
|
| 45 |
""")
|
| 46 |
|
| 47 |
chatbot = gr.Chatbot()
|
|
|
|
| 41 |
gr.Markdown("""
|
| 42 |
# Phi-2 Chatbot Demo
|
| 43 |
|
| 44 |
+
This chatbot was created using Microsoft's 2.7 billion parameter [phi-2](https://huggingface.co/microsoft/phi-2) Transformer model.
|
| 45 |
+
|
| 46 |
+
In order to reduce the response time on this hardware, `max_new_tokens` has been set to `42` in the text generation pipeline. It takes up to *150 seconds* for each response to be generated.
|
| 47 |
""")
|
| 48 |
|
| 49 |
chatbot = gr.Chatbot()
|