Instructions to use ecloudtech/Erk-32B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ecloudtech/Erk-32B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ecloudtech/Erk-32B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ecloudtech/Erk-32B")
model = AutoModelForCausalLM.from_pretrained("ecloudtech/Erk-32B", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ecloudtech/Erk-32B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ecloudtech/Erk-32B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ecloudtech/Erk-32B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/ecloudtech/Erk-32B

SGLang

How to use ecloudtech/Erk-32B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ecloudtech/Erk-32B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ecloudtech/Erk-32B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ecloudtech/Erk-32B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ecloudtech/Erk-32B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use ecloudtech/Erk-32B with Docker Model Runner:
```
docker model run hf.co/ecloudtech/Erk-32B
```

Erk-32B / NOTICE

aigencydev

Erk-32B: model karti, olcum protokolu, betikler, sonuc vektorleri

9c90564 verified 20 days ago

Raw

History Blame Contribute Delete

1.63 kB

	Erk-32B
	Copyright (c) 2026 eCloud Yazılım Teknolojileri (eCloud Tech.)

	This model is a derivative work of Qwen3-32B
	(https://huggingface.co/Qwen/Qwen3-32B), Copyright (c) Alibaba Cloud,
	licensed under the Apache License, Version 2.0. The base model's architecture,
	tokenizer and chat format are unchanged; eCloud Tech. modified the weights by
	continued pretraining on Turkish text (1.05B tokens, LoRA r=256), Turkish
	instruction tuning (423M tokens) and an additional instruction round, then
	merged the adapter at scale 0.75 and added a default identity system prompt to
	the chat template. Details: OLCUM-PROTOKOLU.md.

	Erk-32B is distributed under the Apache License, Version 2.0 (see LICENSE).

	"Erk" and "eCloud Tech." are names and marks of eCloud Yazılım Teknolojileri.
	This license does not grant permission to use them to endorse or promote
	derived products without prior written permission, except as required for
	reasonable and customary attribution.

	--------------------------------------------------------------------------
	Erk-32B
	Telif (c) 2026 eCloud Yazılım Teknolojileri (eCloud Tech.)

	Bu model, Apache Lisansı 2.0 ile dağıtılan Qwen3-32B'nin (Alibaba Cloud)
	türev çalışmasıdır. Mimari, tokenizer ve sohbet biçimi tabandan gelir;
	eCloud Tech. ağırlıkları Türkçe devam-eğitimi, talimat ayarı ve ek turla
	değiştirmiş, adaptörü 0,75 ölçeğiyle birleştirmiş ve sohbet şablonuna
	varsayılan kimlik istemi eklemiştir. Erk-32B, Apache Lisansı 2.0 ile dağıtılır.
	"Erk" ve "eCloud Tech." adları eCloud Yazılım Teknolojileri'ne aittir; bu
	lisans marka kullanım hakkı vermez.