ReWiz
Collection
The ReWiz series is based on a subset of data from 3 different data sets, which has been used for fine tuning. • 18 items • Updated • 1
Transformers
Safetensors
GGUF
English
gemma2
text-generation-inference
unsloth
trl
sft
rewiz
theprint
How to use from
llama.cppInstall from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf theprint/ReWiz-Gemma2-9B:# Run inference directly in the terminal:
llama cli -hf theprint/ReWiz-Gemma2-9B:Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf theprint/ReWiz-Gemma2-9B:# Run inference directly in the terminal:
./llama-cli -hf theprint/ReWiz-Gemma2-9B:Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf theprint/ReWiz-Gemma2-9B:# Run inference directly in the terminal:
./build/bin/llama-cli -hf theprint/ReWiz-Gemma2-9B:Use Docker
docker model run hf.co/theprint/ReWiz-Gemma2-9B:Quick Links
Use the Alpaca-format chat template
- Before both User and Assistant:
\n\n - Before User:
### Instruction:\n - Before Assistant:
### Response:\n
Uploaded model
- Developed by: theprint
- License: apache-2.0
- Finetuned from model : unsloth/gemma-2-9b-bnb-4bit
This gemma2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf theprint/ReWiz-Gemma2-9B:# Run inference directly in the terminal: llama cli -hf theprint/ReWiz-Gemma2-9B: