Text Generation
Transformers
Safetensors
gpt_oss
Claude
Fable
Antropic
Agent
Ollama
vLLM
mxfp4
quantization
Mixture of Experts
conversational
Eval Results (legacy)
8-bit precision
Instructions to use Tesleum/0xCoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Tesleum/0xCoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Tesleum/0xCoder") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Tesleum/0xCoder") model = AutoModelForCausalLM.from_pretrained("Tesleum/0xCoder", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Tesleum/0xCoder with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Tesleum/0xCoder" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Tesleum/0xCoder", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Tesleum/0xCoder
- SGLang
How to use Tesleum/0xCoder with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Tesleum/0xCoder" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Tesleum/0xCoder", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Tesleum/0xCoder" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Tesleum/0xCoder", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Tesleum/0xCoder with Docker Model Runner:
docker model run hf.co/Tesleum/0xCoder
Update README.md
Browse files
README.md
CHANGED
|
@@ -23,7 +23,7 @@ library_name: transformers
|
|
| 23 |
|
| 24 |
# This structures your data into Hugging Face's official widget database
|
| 25 |
model-index:
|
| 26 |
-
- name:
|
| 27 |
results:
|
| 28 |
- task:
|
| 29 |
type: text-generation
|
|
@@ -39,7 +39,7 @@ model-index:
|
|
| 39 |
value: "MXFP4 (Microscaling 4-bit)"
|
| 40 |
---
|
| 41 |
|
| 42 |
-
# 📝
|
| 43 |
|
| 44 |
> [!NOTE]
|
| 45 |
> **Hugging Face Metadata:** The automated metadata tag at the top of this page miscalculates this model as a 12B BF16/U8 model because the Hub parser cannot natively calculate the 32-expert MoE layout of `Claude-OSS`. The actual model size is **21B parameters** running natively on **MXFP4 microquantization**.
|
|
@@ -64,7 +64,7 @@ Open-Source OpenAI model powered by Claude Fable 5 Agent
|
|
| 64 |
|
| 65 |
## Transformers
|
| 66 |
|
| 67 |
-
You can use `
|
| 68 |
|
| 69 |
To get started, install the necessary dependencies to setup your environment:
|
| 70 |
|
|
@@ -78,7 +78,7 @@ Once, setup you can proceed to run the model by running the snippet below:
|
|
| 78 |
from transformers import pipeline
|
| 79 |
import torch
|
| 80 |
|
| 81 |
-
model_id = "Tesleum/
|
| 82 |
|
| 83 |
pipe = pipeline(
|
| 84 |
"text-generation",
|
|
@@ -102,7 +102,7 @@ Alternatively, you can run the model via [`Transformers Serve`](https://huggingf
|
|
| 102 |
|
| 103 |
```
|
| 104 |
transformers serve
|
| 105 |
-
transformers chat localhost:8000 --model-name-or-path Tesleum/
|
| 106 |
```
|
| 107 |
|
| 108 |
## vLLM
|
|
@@ -113,7 +113,7 @@ vLLM recommends using [uv](https://docs.astral.sh/uv/) for Python dependency man
|
|
| 113 |
curl -X POST "http://localhost:8000/v1/chat/completions" \
|
| 114 |
-H "Content-Type: application/json" \
|
| 115 |
--data '{
|
| 116 |
-
"model": "Tesleum/
|
| 117 |
"messages": [
|
| 118 |
{
|
| 119 |
"role": "user",
|
|
@@ -122,13 +122,13 @@ curl -X POST "http://localhost:8000/v1/chat/completions" \
|
|
| 122 |
]
|
| 123 |
}'
|
| 124 |
|
| 125 |
-
vllm serve "Tesleum/
|
| 126 |
```
|
| 127 |
|
| 128 |
## Docker
|
| 129 |
|
| 130 |
```bash
|
| 131 |
-
docker model run hf.co/Tesleum/
|
| 132 |
```
|
| 133 |
## Ollama
|
| 134 |
|
|
@@ -152,7 +152,7 @@ The reasoning level can be set in the system prompts, e.g., "Reasoning: high".
|
|
| 152 |
|
| 153 |
# Tool use
|
| 154 |
|
| 155 |
-
The
|
| 156 |
* Agentic operations like browser tasks
|
| 157 |
* Function calling with defined schemas
|
| 158 |
* Web browsing (using built-in browsing tools)
|
|
|
|
| 23 |
|
| 24 |
# This structures your data into Hugging Face's official widget database
|
| 25 |
model-index:
|
| 26 |
+
- name: 0xCoder
|
| 27 |
results:
|
| 28 |
- task:
|
| 29 |
type: text-generation
|
|
|
|
| 39 |
value: "MXFP4 (Microscaling 4-bit)"
|
| 40 |
---
|
| 41 |
|
| 42 |
+
# 📝 0xCoder (Fable 5)
|
| 43 |
|
| 44 |
> [!NOTE]
|
| 45 |
> **Hugging Face Metadata:** The automated metadata tag at the top of this page miscalculates this model as a 12B BF16/U8 model because the Hub parser cannot natively calculate the 32-expert MoE layout of `Claude-OSS`. The actual model size is **21B parameters** running natively on **MXFP4 microquantization**.
|
|
|
|
| 64 |
|
| 65 |
## Transformers
|
| 66 |
|
| 67 |
+
You can use `0xCoder` with Transformers. If you use the Transformers chat template, it will automatically apply the [harmony response format](https://github.com/openai/harmony). If you use `model.generate` directly, you need to apply the harmony format manually using the chat template or use our [openai-harmony](https://github.com/openai/harmony) package.
|
| 68 |
|
| 69 |
To get started, install the necessary dependencies to setup your environment:
|
| 70 |
|
|
|
|
| 78 |
from transformers import pipeline
|
| 79 |
import torch
|
| 80 |
|
| 81 |
+
model_id = "Tesleum/0xCoder"
|
| 82 |
|
| 83 |
pipe = pipeline(
|
| 84 |
"text-generation",
|
|
|
|
| 102 |
|
| 103 |
```
|
| 104 |
transformers serve
|
| 105 |
+
transformers chat localhost:8000 --model-name-or-path Tesleum/0xCoder
|
| 106 |
```
|
| 107 |
|
| 108 |
## vLLM
|
|
|
|
| 113 |
curl -X POST "http://localhost:8000/v1/chat/completions" \
|
| 114 |
-H "Content-Type: application/json" \
|
| 115 |
--data '{
|
| 116 |
+
"model": "Tesleum/0xCoder",
|
| 117 |
"messages": [
|
| 118 |
{
|
| 119 |
"role": "user",
|
|
|
|
| 122 |
]
|
| 123 |
}'
|
| 124 |
|
| 125 |
+
vllm serve "Tesleum/0xCoder"
|
| 126 |
```
|
| 127 |
|
| 128 |
## Docker
|
| 129 |
|
| 130 |
```bash
|
| 131 |
+
docker model run hf.co/Tesleum/0xCoder
|
| 132 |
```
|
| 133 |
## Ollama
|
| 134 |
|
|
|
|
| 152 |
|
| 153 |
# Tool use
|
| 154 |
|
| 155 |
+
The 0xCoder models are excellent for:
|
| 156 |
* Agentic operations like browser tasks
|
| 157 |
* Function calling with defined schemas
|
| 158 |
* Web browsing (using built-in browsing tools)
|