Instructions to use mediusware-ai/intellix with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries
PEFT
How to use mediusware-ai/intellix with PEFT:
```
Task type is invalid.
```

How to use mediusware-ai/intellix with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="mediusware-ai/intellix")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("mediusware-ai/intellix")
model = AutoModelForCausalLM.from_pretrained("mediusware-ai/intellix")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use mediusware-ai/intellix with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "mediusware-ai/intellix"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mediusware-ai/intellix",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/mediusware-ai/intellix

SGLang

How to use mediusware-ai/intellix with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "mediusware-ai/intellix" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mediusware-ai/intellix",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "mediusware-ai/intellix" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "mediusware-ai/intellix",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use mediusware-ai/intellix with Docker Model Runner:
```
docker model run hf.co/mediusware-ai/intellix
```

intellix

Commit History

Upload README.md with huggingface_hub

5598409
verified

mediusware-ai commited on Apr 9

Upload README.md with huggingface_hub

10f1b15
verified

mediusware-ai commited on Apr 9

Upload intellix-Q8_0.gguf with huggingface_hub

8b78c78
verified

mediusware-ai commited on Apr 6

Upload logo.webp with huggingface_hub

79bb425
verified

mediusware-ai commited on Apr 3

Upload README.md with huggingface_hub

8e15674
verified

mediusware-ai commited on Apr 3

Delete adapter_config.json with huggingface_hub

f97a181
verified

mediusware-ai commited on Apr 3

Delete adapter_model.safetensors with huggingface_hub

9294053
verified

mediusware-ai commited on Apr 3

Delete logo.png with huggingface_hub

f26e135
verified

mediusware-ai commited on Apr 3

Delete mw-intellix-Q8_0.gguf with huggingface_hub

0c39aeb
verified

mediusware-ai commited on Apr 3

Upload INFERENCE.md with huggingface_hub

257c308
verified

mediusware-ai commited on Apr 3

Upload README.md with huggingface_hub

ba7774d
verified

mediusware-ai commited on Apr 3

Upload Modelfile with huggingface_hub

24597f7
verified

mediusware-ai commited on Apr 3

Upload logo.webp with huggingface_hub

f670a8e
verified

mediusware-ai commited on Apr 3

Upload intellix-Q8_0.gguf with huggingface_hub

07f005d
verified

mediusware-ai commited on Apr 3

Upload params with huggingface_hub

cd8bb19
verified

mediusware-ai commited on Apr 2

Upload system with huggingface_hub

74df348
verified

mediusware-ai commited on Apr 2

Upload Modelfile with huggingface_hub

32e9636
verified

mediusware-ai commited on Apr 2

Upload README.md with huggingface_hub

eacb8bb
verified

mediusware-ai commited on Apr 2

Upload config.json with huggingface_hub

7d11fde
verified

mediusware-ai commited on Apr 2

Upload mw-intellix-Q8_0.gguf with huggingface_hub

72f74d3
verified

mediusware-ai commited on Apr 2

Upload README.md with huggingface_hub

107c4ac
verified

mediusware-ai commited on Apr 2

Upload config.json with huggingface_hub

59829b5
verified

mediusware-ai commited on Apr 2

Upload mw-intellix-Q8_0.gguf with huggingface_hub

98b8327
verified

mediusware-ai commited on Apr 2

Upload README.md with huggingface_hub

413b827
verified

mediusware-ai commited on Apr 2

Upload config.json with huggingface_hub

4a832e2
verified

mediusware-ai commited on Apr 2

Upload mw-intellix-Q8_0.gguf with huggingface_hub

7795d9b
verified

mediusware-ai commited on Apr 2

Upload README.md with huggingface_hub

e0bea2c
verified

mediusware-ai commited on Apr 2

Upload config.json with huggingface_hub

5162312
verified

mediusware-ai commited on Apr 2

Upload README.md with huggingface_hub

9b69c8d
verified

mediusware-ai commited on Apr 2

Upload config.json with huggingface_hub

8f971be
verified

mediusware-ai commited on Apr 2

Upload README.md with huggingface_hub

e77984d
verified

mediusware-ai commited on Apr 2

Upload README.md with huggingface_hub

1d32ecb
verified

mediusware-ai commited on Mar 30

Upload mw-intellix-Q8_0.gguf with huggingface_hub

4df560f
verified

mediusware-ai commited on Mar 30

Upload README.md with huggingface_hub

e38c146
verified

mediusware-ai commited on Mar 30

Upload config.json with huggingface_hub

705dfe7
verified

mediusware-ai commited on Mar 30

Upload processor_config.json with huggingface_hub

8535d80
verified

mediusware-ai commited on Mar 30

Upload tokenizer_config.json with huggingface_hub

0008130
verified

mediusware-ai commited on Mar 30

Upload adapter_config.json with huggingface_hub

f6694e7
verified

mediusware-ai commited on Mar 30

Upload logo.png with huggingface_hub

1d2f8ad
verified

mediusware-ai commited on Mar 30

Upload README.md with huggingface_hub

181ec46
verified

mediusware-ai commited on Mar 30

Upload logo.png with huggingface_hub

9aa0609
verified

mediusware-ai commited on Mar 30

Upload README.md with huggingface_hub

a21b8d1
verified

mediusware-ai commited on Mar 30

Upload system with huggingface_hub

eb56583
verified

Sonia Hendrix commited on Mar 30

Upload Modelfile with huggingface_hub

566abb0
verified

Sonia Hendrix commited on Mar 30

Upload params with huggingface_hub

398b873
verified

Sonia Hendrix commited on Mar 30

Upload system with huggingface_hub

6f3e181
verified

Sonia Hendrix commited on Mar 30

Upload template with huggingface_hub

b5135cc
verified

Sonia Hendrix commited on Mar 30

Upload Modelfile with huggingface_hub

2c6593d
verified

Sonia Hendrix commited on Mar 30

Upload Modelfile with huggingface_hub

3143e59
verified

Sonia Hendrix commited on Mar 30

Upload README.md with huggingface_hub

2c894b4
verified

Sonia Hendrix commited on Mar 30

Commit History

Upload README.md with huggingface_hub 5598409 verified

Upload README.md with huggingface_hub 10f1b15 verified

Upload intellix-Q8_0.gguf with huggingface_hub 8b78c78 verified

Upload logo.webp with huggingface_hub 79bb425 verified

Upload README.md with huggingface_hub 8e15674 verified

Delete adapter_config.json with huggingface_hub f97a181 verified

Delete adapter_model.safetensors with huggingface_hub 9294053 verified

Delete logo.png with huggingface_hub f26e135 verified

Delete mw-intellix-Q8_0.gguf with huggingface_hub 0c39aeb verified

Upload INFERENCE.md with huggingface_hub 257c308 verified

Upload README.md with huggingface_hub ba7774d verified

Upload Modelfile with huggingface_hub 24597f7 verified

Upload logo.webp with huggingface_hub f670a8e verified

Upload intellix-Q8_0.gguf with huggingface_hub 07f005d verified

Upload params with huggingface_hub cd8bb19 verified

Upload system with huggingface_hub 74df348 verified

Upload Modelfile with huggingface_hub 32e9636 verified

Upload README.md with huggingface_hub eacb8bb verified

Upload config.json with huggingface_hub 7d11fde verified

Upload mw-intellix-Q8_0.gguf with huggingface_hub 72f74d3 verified

Upload README.md with huggingface_hub 107c4ac verified

Upload config.json with huggingface_hub 59829b5 verified

Upload mw-intellix-Q8_0.gguf with huggingface_hub 98b8327 verified

Upload README.md with huggingface_hub 413b827 verified

Upload config.json with huggingface_hub 4a832e2 verified

Upload mw-intellix-Q8_0.gguf with huggingface_hub 7795d9b verified

Upload README.md with huggingface_hub e0bea2c verified

Upload config.json with huggingface_hub 5162312 verified

Upload README.md with huggingface_hub 9b69c8d verified

Upload config.json with huggingface_hub 8f971be verified

Upload README.md with huggingface_hub e77984d verified

Upload README.md with huggingface_hub 1d32ecb verified

Upload mw-intellix-Q8_0.gguf with huggingface_hub 4df560f verified

Upload README.md with huggingface_hub e38c146 verified

Upload config.json with huggingface_hub 705dfe7 verified

Upload processor_config.json with huggingface_hub 8535d80 verified

Upload tokenizer_config.json with huggingface_hub 0008130 verified

Upload adapter_config.json with huggingface_hub f6694e7 verified

Upload logo.png with huggingface_hub 1d2f8ad verified

Upload README.md with huggingface_hub 181ec46 verified

Upload logo.png with huggingface_hub 9aa0609 verified

Upload README.md with huggingface_hub a21b8d1 verified

Upload system with huggingface_hub eb56583 verified

Upload Modelfile with huggingface_hub 566abb0 verified

Upload params with huggingface_hub 398b873 verified

Upload system with huggingface_hub 6f3e181 verified

Upload template with huggingface_hub b5135cc verified

Upload Modelfile with huggingface_hub 2c6593d verified

Upload Modelfile with huggingface_hub 3143e59 verified

Upload README.md with huggingface_hub 2c894b4 verified

Upload README.md with huggingface_hub

5598409
verified

Upload README.md with huggingface_hub

10f1b15
verified

Upload intellix-Q8_0.gguf with huggingface_hub

8b78c78
verified

Upload logo.webp with huggingface_hub

79bb425
verified

Upload README.md with huggingface_hub

8e15674
verified

Delete adapter_config.json with huggingface_hub

f97a181
verified

Delete adapter_model.safetensors with huggingface_hub

9294053
verified

Delete logo.png with huggingface_hub

f26e135
verified

Delete mw-intellix-Q8_0.gguf with huggingface_hub

0c39aeb
verified

Upload INFERENCE.md with huggingface_hub

257c308
verified

Upload README.md with huggingface_hub

ba7774d
verified

Upload Modelfile with huggingface_hub

24597f7
verified

Upload logo.webp with huggingface_hub

f670a8e
verified

Upload intellix-Q8_0.gguf with huggingface_hub

07f005d
verified

Upload params with huggingface_hub

cd8bb19
verified

Upload system with huggingface_hub

74df348
verified

Upload Modelfile with huggingface_hub

32e9636
verified

Upload README.md with huggingface_hub

eacb8bb
verified

Upload config.json with huggingface_hub

7d11fde
verified

Upload mw-intellix-Q8_0.gguf with huggingface_hub

72f74d3
verified

Upload README.md with huggingface_hub

107c4ac
verified

Upload config.json with huggingface_hub

59829b5
verified

Upload mw-intellix-Q8_0.gguf with huggingface_hub

98b8327
verified

Upload README.md with huggingface_hub

413b827
verified

Upload config.json with huggingface_hub

4a832e2
verified

Upload mw-intellix-Q8_0.gguf with huggingface_hub

7795d9b
verified

Upload README.md with huggingface_hub

e0bea2c
verified

Upload config.json with huggingface_hub

5162312
verified

Upload README.md with huggingface_hub

9b69c8d
verified

Upload config.json with huggingface_hub

8f971be
verified

Upload README.md with huggingface_hub

e77984d
verified

Upload README.md with huggingface_hub

1d32ecb
verified

Upload mw-intellix-Q8_0.gguf with huggingface_hub

4df560f
verified

Upload README.md with huggingface_hub

e38c146
verified

Upload config.json with huggingface_hub

705dfe7
verified

Upload processor_config.json with huggingface_hub

8535d80
verified

Upload tokenizer_config.json with huggingface_hub

0008130
verified

Upload adapter_config.json with huggingface_hub

f6694e7
verified

Upload logo.png with huggingface_hub

1d2f8ad
verified

Upload README.md with huggingface_hub

181ec46
verified

Upload logo.png with huggingface_hub

9aa0609
verified

Upload README.md with huggingface_hub

a21b8d1
verified

Upload system with huggingface_hub

eb56583
verified

Upload Modelfile with huggingface_hub

566abb0
verified

Upload params with huggingface_hub

398b873
verified

Upload system with huggingface_hub

6f3e181
verified

Upload template with huggingface_hub

b5135cc
verified

Upload Modelfile with huggingface_hub

2c6593d
verified

Upload Modelfile with huggingface_hub

3143e59
verified

Upload README.md with huggingface_hub

2c894b4
verified