How to use from
llama.cppInstall from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf generalchucklese/OpenClyde-1B:# Run inference directly in the terminal:
llama cli -hf generalchucklese/OpenClyde-1B:Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf generalchucklese/OpenClyde-1B:# Run inference directly in the terminal:
./llama-cli -hf generalchucklese/OpenClyde-1B:Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf generalchucklese/OpenClyde-1B:# Run inference directly in the terminal:
./build/bin/llama-cli -hf generalchucklese/OpenClyde-1B:Use Docker
docker model run hf.co/generalchucklese/OpenClyde-1B:Quick Links
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
base_model: GreekIceDragon/gemma-3-1b-abliterated library_name: peft model_name: OpenClyde tags: - base_model:adapter:GreekIceDragon/gemma-3-1b-abliterated - lora - sft - transformers - trl licence: license pipeline_tag: text-generation
What is this?
This is a model trained using pytorch on around 3000 lines of data from Discord's shut down AI, Clyde. It is almost completely accurate, but struggles to keep its personality in unusual situations Come Join Us on Discord to follow updates
Model Card for gemma3-clyde-finetune
This model is a fine-tuned version of Gemma 3 1B (abliterated by GeekIceDragon) It has been trained using TRL.
Training procedure
This model was trained with SFT.
Framework versions
- PEFT 0.19.1
- TRL: 1.8.0
- Transformers: 5.13.1
- Pytorch: 2.13.0
- Datasets: 5.0.0
- Tokenizers: 0.22.2
Citations
Cite TRL as:
@software{vonwerra2020trl,
title = {{TRL: Transformers Reinforcement Learning}},
author = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin},
license = {Apache-2.0},
url = {https://github.com/huggingface/trl},
year = {2020}
}
- Downloads last month
- 27
Hardware compatibility
Log In to add your hardware
4-bit
6-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 1 Ask for provider support
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf generalchucklese/OpenClyde-1B:# Run inference directly in the terminal: llama cli -hf generalchucklese/OpenClyde-1B: