Instructions to use ThisIs-Developer/Llama-2-GGML-Medical-Chatbot with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use ThisIs-Developer/Llama-2-GGML-Medical-Chatbot with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("question-answering", model="ThisIs-Developer/Llama-2-GGML-Medical-Chatbot") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ThisIs-Developer/Llama-2-GGML-Medical-Chatbot", dtype="auto") - Notebooks
- Google Colab
- Kaggle
'Message' object has no attribute 'replace'
#3
by ThisIs-Developer - opened
AttributeError: 'Message' object has no attribute 'replace'
Solution
It looks like the issue is resolved by changing res = await chain.acall(message, callbacks=[cb]) to res = await chain.acall(message.content, callbacks=[cb]) in line 86. Now we are passing only the content attribute of the message object to acall.
Updated in v2.0.3dev11012024
Github issues #9
