Instructions to use zerofata/L3.3-Genetic-Lemonade-Sunset-70B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use zerofata/L3.3-Genetic-Lemonade-Sunset-70B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="zerofata/L3.3-Genetic-Lemonade-Sunset-70B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("zerofata/L3.3-Genetic-Lemonade-Sunset-70B")
model = AutoModelForCausalLM.from_pretrained("zerofata/L3.3-Genetic-Lemonade-Sunset-70B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use zerofata/L3.3-Genetic-Lemonade-Sunset-70B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "zerofata/L3.3-Genetic-Lemonade-Sunset-70B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zerofata/L3.3-Genetic-Lemonade-Sunset-70B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/zerofata/L3.3-Genetic-Lemonade-Sunset-70B

SGLang

How to use zerofata/L3.3-Genetic-Lemonade-Sunset-70B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "zerofata/L3.3-Genetic-Lemonade-Sunset-70B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zerofata/L3.3-Genetic-Lemonade-Sunset-70B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "zerofata/L3.3-Genetic-Lemonade-Sunset-70B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "zerofata/L3.3-Genetic-Lemonade-Sunset-70B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use zerofata/L3.3-Genetic-Lemonade-Sunset-70B with Docker Model Runner:
```
docker model run hf.co/zerofata/L3.3-Genetic-Lemonade-Sunset-70B
```
Browse Quantizations to use this model in llama.cpp, Ollama, LM Studio, or any compatible app.

Genetic Lemonade Sunset

Inspired to learn how to merge by the Nevoria series from SteelSkull.

I wasn't planning to release any more models in this series, but I wasn't fully satisfied with Unleashed or the Final version. I happened upon the below when testing merges and found myself coming back to it, so decided to publish.

Model Comparison

Designed for RP and creative writing, all three models are focused around striking a balance between writing style, creativity and intelligence. The basic differences between the models are below.

Version	Strength	Weakness
Unleashed	Well balanced	Somewhat censored
Final	Fully uncensored	Least intelligent
Sunset	Well balanced, most intelligent	GPTisms / weakest writing style

SillyTavern Settings

Sampler Settings

Temp: 0.9-1.0
MinP: 0.03-0.04
TopP 0.95-1
Dry: 0.8, 1.75, 4

Temperature last, neutralize other samplers. This model natively strikes a balance of creativity & intelligence.

Instruct

Llama-3-Instruct-Names but you will need to uncheck "System same as user".

Quants

GGUF

iMatrix quants by Mradermacher

EXL2

4.5bpw
6bpw

Merge Details

Merge Method

This model was merged using the SCE merge method.

merge_base_v1

models:
  - model: deepseek-ai/DeepSeek-R1-Distill-Llama-70B
  - model: nbeerbower/llama3.1-kartoffeldes-70B
  - model: tokyotech-llm/Llama-3.3-Swallow-70B-Instruct-v0.4
  - model: TheDrummer/Fallen-Llama-3.3-R1-70B-v1
select_topk: .15
merge_method: sce
base_model: meta-llama/Llama-3.3-70B-Instruct
dtype: bfloat16
tokenizer:
  source: base

Genetic Lemonade Sunset

models:
  - model: Sao10K/70B-L3.3-Cirrus-x1
  - model: OpenBuddy/openbuddy-llama3.3-70b-v24.3-131k
  - model: Saxo/Linkbricks-Horizon-AI-Japanese-Superb-V4-70B
  - model: LatitudeGames/Wayfarer-Large-70B-Llama-3.3
  - model: SicariusSicariiStuff/Negative_LLAMA_70B
  - model: crestf411/L3.1-nemotron-sunfall-v0.7.0
merge_method: sce
base_model: ./merge_base_v1
select_topk: 0.15
dtype: bfloat16
tokenizer:
  source: union