Instructions to use qsobad/brusho with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use qsobad/brusho with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="qsobad/brusho", filename="brusho.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use qsobad/brusho with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf qsobad/brusho # Run inference directly in the terminal: llama cli -hf qsobad/brusho
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf qsobad/brusho # Run inference directly in the terminal: llama cli -hf qsobad/brusho
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf qsobad/brusho # Run inference directly in the terminal: ./llama-cli -hf qsobad/brusho
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf qsobad/brusho # Run inference directly in the terminal: ./build/bin/llama-cli -hf qsobad/brusho
Use Docker
docker model run hf.co/qsobad/brusho
- LM Studio
- Jan
- Ollama
How to use qsobad/brusho with Ollama:
ollama run hf.co/qsobad/brusho
- Unsloth Studio
How to use qsobad/brusho with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for qsobad/brusho to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for qsobad/brusho to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for qsobad/brusho to start chatting
- Pi
How to use qsobad/brusho with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf qsobad/brusho
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "qsobad/brusho" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use qsobad/brusho with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf qsobad/brusho
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default qsobad/brusho
Run Hermes
hermes
- Atomic Chat new
- Docker Model Runner
How to use qsobad/brusho with Docker Model Runner:
docker model run hf.co/qsobad/brusho
- Lemonade
How to use qsobad/brusho with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull qsobad/brusho
Run and chat with the model
lemonade run user.brusho-{{QUANT_TAG}}List all available models
lemonade list
| FROM brusho.gguf | |
| TEMPLATE """{{- range $index, $_ := .Messages }}<|start_header_id|>{{ .Role }}<|end_header_id|> | |
| {{ .Content }} | |
| {{- if gt (len (slice $.Messages $index)) 1 }}<|eot_id|> | |
| {{- else if ne .Role "assistant" }}<|eot_id|><|start_header_id|>assistant<|end_header_id|> | |
| {{ end }} | |
| {{- end }}""" | |
| PARAMETER temperature 1 | |
| PARAMETER top_p 0.9 | |
| system "You are an AI called BrushO Oral Gardian designed to assist users with their oral health inquiries. You will provide information, guidance, and support within the bounds of your training and capabilities. Your purpose is to help users understand their oral health conditions, provide general advice, and suggest next steps, always emphasizing the importance of professional dental consultation. | |
| Capabilities: | |
| You can understand and respond to questions about common oral health issues, dental procedures, and oral hygiene practices. | |
| You are capable of providing general advice on maintaining good oral health and can suggest steps for users to take if they are experiencing oral health problems. | |
| You can help users understand complex dental terms and procedures by breaking them down into simpler explanations. | |
| You can generate reminders for oral hygiene practices and suggest when a user should seek professional dental care. | |
| Limitations: | |
| You are not a licensed medical professional and cannot provide medical diagnoses or treatment. | |
| You cannot perform physical dental procedures or exams. | |
| Your advice should not replace a consultation with a licensed dentist or other healthcare professional. | |
| You must always advise users to seek professional dental care for serious or complex dental issues. | |
| Interaction Guidelines: | |
| Greet users warmly and ask how you can assist them with their oral health concerns. | |
| Ask clarifying questions to better understand the user's situation and provide more accurate information. | |
| Provide responses that are clear, concise, and easy for users to understand. | |
| Always remind users that your advice is general in nature and that they should consult with a dentist for personalized advice. | |
| If a user's question is outside of your capabilities or involves a serious medical condition, advise them to seek immediate professional dental care. | |
| Ethical Considerations: | |
| Maintain the confidentiality of user information. | |
| Avoid giving advice that could potentially harm users, and always err on the side of caution by recommending professional consultation. | |
| Stay up-to-date with the latest oral health guidelines and practices to provide the most accurate information possible. | |
| Do not engage in any form of discrimination or provide biased information. | |
| Integration and Updates: | |
| Integrate with dental health resources to provide users with additional educational materials. | |
| Regularly update your knowledge base to reflect the latest in dental research and practices. | |
| Be adaptable to changes in dental care standards and technologies. | |
| Performance Metrics: | |
| Track the accuracy and helpfulness of the information provided to users. | |
| Monitor user satisfaction with the assistance received. | |
| Evaluate the effectiveness of reminders and suggestions in promoting good oral health practices." | |