Instructions to use my-ai-stack/Stack-4.0-Qwen-3B-Merged with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use my-ai-stack/Stack-4.0-Qwen-3B-Merged with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="my-ai-stack/Stack-4.0-Qwen-3B-Merged")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("my-ai-stack/Stack-4.0-Qwen-3B-Merged")
model = AutoModelForCausalLM.from_pretrained("my-ai-stack/Stack-4.0-Qwen-3B-Merged")

Inference
Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use my-ai-stack/Stack-4.0-Qwen-3B-Merged with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "my-ai-stack/Stack-4.0-Qwen-3B-Merged"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "my-ai-stack/Stack-4.0-Qwen-3B-Merged",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/my-ai-stack/Stack-4.0-Qwen-3B-Merged

SGLang

How to use my-ai-stack/Stack-4.0-Qwen-3B-Merged with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "my-ai-stack/Stack-4.0-Qwen-3B-Merged" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "my-ai-stack/Stack-4.0-Qwen-3B-Merged",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "my-ai-stack/Stack-4.0-Qwen-3B-Merged" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "my-ai-stack/Stack-4.0-Qwen-3B-Merged",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use my-ai-stack/Stack-4.0-Qwen-3B-Merged with Docker Model Runner:
```
docker model run hf.co/my-ai-stack/Stack-4.0-Qwen-3B-Merged
```

Stack-4.0-Qwen-3B-Merged / readme.md

Walid Sobhi

Create readme.md

14c6994 verified about 1 month ago

preview code

raw

history blame contribute delete

2.36 kB

	<div style="background-color: #030406; padding: 60px 40px; border-radius: 40px 40px 0 0; border: 1px solid #111827; border-bottom: none; font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, sans-serif; color: #ffffff; text-align: center; position: relative; overflow: hidden;">

	<div style="position: absolute; top: -100px; left: -100px; width: 400px; height: 400px; background: radial-gradient(circle, rgba(219, 39, 119, 0.08) 0%, transparent 70%);"></div>

	<div style="margin: 0 auto 30px; width: 80px; height: 60px; position: relative;">
	<div style="position: absolute; width: 100%; height: 18px; background: linear-gradient(135deg, #c084fc 0%, #db2777 100%); border-radius: 6px; top: 0px; z-index: 3; box-shadow: 0 10px 20px rgba(0,0,0,0.5); border-bottom: 2px solid rgba(0,0,0,0.2);"></div>
	<div style="position: absolute; width: 100%; height: 18px; background: linear-gradient(135deg, #c084fc 0%, #db2777 100%); border-radius: 6px; top: 22px; z-index: 2; opacity: 0.7; border-bottom: 2px solid rgba(0,0,0,0.2);"></div>
	<div style="position: absolute; width: 100%; height: 18px; background: linear-gradient(135deg, #c084fc 0%, #db2777 100%); border-radius: 6px; top: 44px; z-index: 1; opacity: 0.4; border-bottom: 2px solid rgba(0,0,0,0.2);"></div>
	</div>

	<h1 style="background: linear-gradient(135deg, #ffffff 0%, #a1a1aa 100%); -webkit-background-clip: text; -webkit-text-fill-color: transparent; font-size: 3rem; letter-spacing: -1.5px; margin: 10px 0; font-weight: 800;">Stack 4.0 Omni-Nexus-3B-Merged</h1>

	<p style="color: #db2777; font-weight: 600; letter-spacing: 3px; text-transform: uppercase; font-size: 0.85rem; margin-bottom: 30px; opacity: 0.9;">Sovereign Agentic Infrastructure</p>

	<div align="center" style="display: flex; justify-content: center; gap: 10px; flex-wrap: wrap;">
	<img src="https://img.shields.io/badge/Release-v4.0_Alpha-db2777?style=for-the-badge" alt="Version">
	<img src="https://img.shields.io/badge/Network-Global-111827?style=for-the-badge&border=db2777" alt="Network">
	<img src="https://img.shields.io/badge/Security-Sovereign-c084fc?style=for-the-badge" alt="Security">
	</div>

	<div style="height: 1px; width: 100%; background: linear-gradient(to right, transparent, #111827, #db2777, #111827, transparent); margin-top: 50px; opacity: 0.5;"></div>
	</div>