Safetensors
GGUF
English
qwen2
clinical
medical
healthcare
qlora
unsloth
chatml
rapha
8-bit precision
conversational
Instructions to use Phora68/rapha with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Phora68/rapha with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Phora68/rapha:Q4_K_M # Run inference directly in the terminal: llama cli -hf Phora68/rapha:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Phora68/rapha:Q4_K_M # Run inference directly in the terminal: llama cli -hf Phora68/rapha:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Phora68/rapha:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf Phora68/rapha:Q4_K_M
Use Docker
docker model run hf.co/Phora68/rapha:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use Phora68/rapha with Ollama:
ollama run hf.co/Phora68/rapha:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use Phora68/rapha with Docker Model Runner:
docker model run hf.co/Phora68/rapha:Q4_K_M
- Lemonade
How to use Phora68/rapha with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Phora68/rapha:Q4_K_M
Run and chat with the model
lemonade run user.rapha-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
-
Add Qwen2.5-7B-Instruct.Q8_0.gguf
Verified signature9a20f9f -
Add Qwen2.5-7B-Instruct.Q5_K_M.gguf
Verified signature4a7037a -
Add Qwen2.5-7B-Instruct.Q4_K_M.gguf
Verified signature78f4c9e
-
Upload gguf/rapha-qwen25-7b.Q5_K_M.gguf with huggingface_hub
Verified signaturefb3368e -
Upload gguf/rapha-qwen25-7b.Q8_0.gguf with huggingface_hub
Verified signature448e3f1 -
Upload gguf/Qwen2.5-7B-Instruct.Q4_K_M.gguf with huggingface_hub
Verified signature52c6953
-
Add Qwen2.5-3B-Instruct.Q8_0.gguf
Verified signature01be0fe -
Add Qwen2.5-3B-Instruct.Q5_K_M.gguf
Verified signature6ed30cc -
Add Qwen2.5-3B-Instruct.Q4_K_M.gguf
Verified signature4255390
-
Add Qwen2.5-3B-Instruct.Q8_0.gguf
Verified signatureb6ce3dd -
Add Qwen2.5-3B-Instruct.Q5_K_M.gguf
Verified signaturec88c7b0 -
Add Qwen2.5-3B-Instruct.Q4_K_M.gguf
Verified signaturef42a36c
-
Add rapha-qwen25-3b-q8_0.gguf
Verified signature21d856c -
Add rapha-qwen25-3b-q5_k_m.gguf
Verified signature5cb8ed8 -
Add rapha-qwen25-3b-q4_k_m.gguf
Verified signaturec72fe9e -
Add dataset: full_arc_conversations.jsonl
Verified signature8e8a583 -
Add dataset: stage4_red_flags.jsonl
Verified signature945e703 -
Add dataset: stage3_history.jsonl
Verified signaturea015ba6 -
Add dataset: stage2_opqrst.jsonl
Verified signature33713f4 -
Add dataset: stage1_greetings.jsonl
Verified signature839a9ea -
Trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster95b96af -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterc98f3c8
-
Add rapha-q4_k_m.gguf (Q4_K_M quantisation)
Verified signatureb1a3917 -
initial commit
Verified signature16a50df