Hugging Face's logo

QuantFactory
/
EstopianMaid-13B-GGUF

Transformers
GGUF
English
roleplay
text-generation-inference
Model card Files
xet
 Community
How to use from
llama.cpp
Install (macOS, Linux) 
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf QuantFactory/EstopianMaid-13B-GGUF:
# Run inference directly in the terminal:
llama cli -hf QuantFactory/EstopianMaid-13B-GGUF:
Install from WinGet (Windows) 
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf QuantFactory/EstopianMaid-13B-GGUF:
# Run inference directly in the terminal:
llama cli -hf QuantFactory/EstopianMaid-13B-GGUF:
Use pre-built binary 
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf QuantFactory/EstopianMaid-13B-GGUF:
# Run inference directly in the terminal:
./llama-cli -hf QuantFactory/EstopianMaid-13B-GGUF:
Build from source code 
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf QuantFactory/EstopianMaid-13B-GGUF:
# Run inference directly in the terminal:
./build/bin/llama-cli -hf QuantFactory/EstopianMaid-13B-GGUF:
Use Docker 
docker model run hf.co/QuantFactory/EstopianMaid-13B-GGUF:
Quick Links

QuantFactory Banner

QuantFactory/EstopianMaid-13B-GGUF

This is quantized version of KatyTheCutie/EstopianMaid-13B created using llama.cpp

Original Model Card

image/png

Based on feedback Estopian made can:

  • EstopianMaid is good at sticking to the character card.

  • maintains coherency in a setting with multiple characters.

  • Able to create new scenario's

  • Feature from Thespis:

image/webp

  • Prompt Template: Alpaca

    Instruction:

    {prompt}

    Response:

Recommended settings:

  • SillyTavern Default Preset.
  • Temperature: 0.7
  • Min-P: 0.3
  • Amount to Gen: 256
  • Top P: 1
  • Repetition penalty: 1.10

Models used:

BlueNipples/TimeCrystal-l2-13B
cgato/Thespis-13b-DPO-v0.7
KoboldAI/LLaMA2-13B-Estopia
NeverSleep/Noromaid-13B-0.4-DPO
Doctor-Shotgun/cat-v1.0-13b

Feedback is always appreciated! Thank you KoboldAI for their usage of their MergeBox and Caitlyn G. for their support and feedback.

Downloads last month
14
GGUF
Model size
13B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support