Instructions to use linagora/Labess-7b-chat-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use linagora/Labess-7b-chat-gguf with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("linagora/Labess-7b-chat-gguf", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use linagora/Labess-7b-chat-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf linagora/Labess-7b-chat-gguf:Q4_K_M # Run inference directly in the terminal: llama cli -hf linagora/Labess-7b-chat-gguf:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf linagora/Labess-7b-chat-gguf:Q4_K_M # Run inference directly in the terminal: llama cli -hf linagora/Labess-7b-chat-gguf:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf linagora/Labess-7b-chat-gguf:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf linagora/Labess-7b-chat-gguf:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf linagora/Labess-7b-chat-gguf:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf linagora/Labess-7b-chat-gguf:Q4_K_M
Use Docker
docker model run hf.co/linagora/Labess-7b-chat-gguf:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use linagora/Labess-7b-chat-gguf with Ollama:
ollama run hf.co/linagora/Labess-7b-chat-gguf:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use linagora/Labess-7b-chat-gguf with Docker Model Runner:
docker model run hf.co/linagora/Labess-7b-chat-gguf:Q4_K_M
- Lemonade
How to use linagora/Labess-7b-chat-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull linagora/Labess-7b-chat-gguf:Q4_K_M
Run and chat with the model
lemonade run user.Labess-7b-chat-gguf-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
Update README.md 38fe7b1 verified
Wajdi Ghezaiel commited on
Update README.md e0c768c verified
Wajdi Ghezaiel commited on
Update README.md fa4c02a verified
Wajdi Ghezaiel commited on
Update README.md bfb8c9a verified
Wajdi Ghezaiel commited on
Add Modelfile f9218fe
(Trained with Unsloth) cb98a9a verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) 3d1eb8e verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) 1d14ae5 verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) 968e582 verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) d4a78e8 verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) 3c0786e verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) 8c9b8bf verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) 5461bb5 verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) 6ca2c9f verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) 205517e verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) 7e46a6c verified
Wajdi Ghezaiel commited on
(Trained with Unsloth) cdeafb6 verified
Wajdi Ghezaiel commited on
Upload README.md with huggingface_hub d673323 verified
Wajdi Ghezaiel commited on
initial commit da3d924 verified
Wajdi Ghezaiel commited on