DAC6
Collection
A complete collection with all DAC6 Models. • 2 items • Updated • 1
How to use Mattimax/DAC6-0.5B with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-generation", model="Mattimax/DAC6-0.5B")
messages = [
{"role": "user", "content": "Who are you?"},
]
pipe(messages) # Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM
tokenizer = AutoTokenizer.from_pretrained("Mattimax/DAC6-0.5B")
model = AutoModelForCausalLM.from_pretrained("Mattimax/DAC6-0.5B", device_map="auto")
messages = [
{"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
messages,
add_generation_prompt=True,
tokenize=True,
return_dict=True,
return_tensors="pt",
).to(model.device)
outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))How to use Mattimax/DAC6-0.5B with vLLM:
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Mattimax/DAC6-0.5B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "Mattimax/DAC6-0.5B",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'docker model run hf.co/Mattimax/DAC6-0.5B
How to use Mattimax/DAC6-0.5B with SGLang:
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
--model-path "Mattimax/DAC6-0.5B" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "Mattimax/DAC6-0.5B",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'docker run --gpus all \
--shm-size 32g \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<secret>" \
--ipc=host \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server \
--model-path "Mattimax/DAC6-0.5B" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "Mattimax/DAC6-0.5B",
"messages": [
{
"role": "user",
"content": "What is the capital of France?"
}
]
}'How to use Mattimax/DAC6-0.5B with Docker Model Runner:
docker model run hf.co/Mattimax/DAC6-0.5B
DAC6 è un modello linguistico di 500 milioni di parametri (0.5B), progettato per offrire un equilibrio tra efficienza e capacità di ragionamento.
È sviluppato principalmente per l’ecosistema Android, dove può conversare fluentemente e eseguire chiamate a strumenti locali (tool calling) direttamente sul dispositivo.
DAC6 is a 500‑million‑parameter (0.5B) language model designed for balanced performance and reasoning efficiency.
It’s primarily developed for the Android ecosystem, capable of natural conversation and local tool calling directly on the device.
docker model run hf.co/Mattimax/DAC6-0.5B