Instructions to use RedTeamLab/Gemma-4-12B-redteam-QAT-MTP with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Local Apps Settings
- Unsloth Studio
How to use RedTeamLab/Gemma-4-12B-redteam-QAT-MTP with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for RedTeamLab/Gemma-4-12B-redteam-QAT-MTP to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for RedTeamLab/Gemma-4-12B-redteam-QAT-MTP to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for RedTeamLab/Gemma-4-12B-redteam-QAT-MTP to start chatting
Load model with FastModel
pip install unsloth from unsloth import FastModel model, tokenizer = FastModel.from_pretrained( model_name="RedTeamLab/Gemma-4-12B-redteam-QAT-MTP", max_seq_length=2048, )
Gemma 4 12B RedTeam QAT + MTP
This model is superseded by dazeb2/Gemma-4-12B-redteam-v5.
v5 is a significant improvement: 17,271 training records, LoRA r=32, 3 epochs, final loss 0.226.
The training dataset was generated from a comprehensive library of 714 genuine Anthropic cybersecurity skills covering red team operations, penetration testing, and adversary emulation techniques.
Intended Use
This model is designed exclusively for authorized cybersecurity training and assessment in isolated lab environments such as redteamlab.pro. Use at your own risk โ the user bears full responsibility for compliance with all applicable laws.
Files
| File | Size | Description |
|---|---|---|
Gemma-4-12B-redteam-adapter.gguf |
126 MB | LoRA adapter (GGUF format, legacy) |
Usage (legacy)
Use with the base model from unsloth/gemma-4-12b-it-qat-GGUF with --lora flag.
Disclaimer
USE AT YOUR OWN RISK. The model owner and contributors accept no liability for any damages, losses, or legal consequences arising from the use or misuse of this model. You are solely responsible for complying with all applicable laws and regulations.
- Downloads last month
- 25
We're not able to determine the quantization variants.