Instructions to use philipjohnbasile/wisp-coder-110m with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use philipjohnbasile/wisp-coder-110m with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="philipjohnbasile/wisp-coder-110m")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("philipjohnbasile/wisp-coder-110m")
model = AutoModelForCausalLM.from_pretrained("philipjohnbasile/wisp-coder-110m", device_map="auto")

MLX

How to use philipjohnbasile/wisp-coder-110m with MLX:

# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm
# if on a CUDA device, also pip install mlx[cuda]

# Generate text with mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("philipjohnbasile/wisp-coder-110m")

prompt = "Once upon a time in"
text = generate(model, tokenizer, prompt=prompt, verbose=True)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

vLLM

How to use philipjohnbasile/wisp-coder-110m with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "philipjohnbasile/wisp-coder-110m"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "philipjohnbasile/wisp-coder-110m",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/philipjohnbasile/wisp-coder-110m

SGLang

How to use philipjohnbasile/wisp-coder-110m with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "philipjohnbasile/wisp-coder-110m" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "philipjohnbasile/wisp-coder-110m",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "philipjohnbasile/wisp-coder-110m" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "philipjohnbasile/wisp-coder-110m",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

MLX LM

How to use philipjohnbasile/wisp-coder-110m with MLX LM:

Generate or start a chat session

# Install MLX LM
uv tool install mlx-lm
# Generate some text
mlx_lm.generate --model "philipjohnbasile/wisp-coder-110m" --prompt "Once upon a time"

Docker Model Runner
How to use philipjohnbasile/wisp-coder-110m with Docker Model Runner:
```
docker model run hf.co/philipjohnbasile/wisp-coder-110m
```

wisp-coder-110m / export_manifest.json

philipjohnbasile

Publish audited Wisp Coder 110M release

818282c verified 9 days ago

Raw

History Blame Contribute Delete

2.94 kB

	{
	"evaluation_sources": {
	"acceptance_comparison": {
	"sha256": "39a3fc77d85d3e87b3c9353358b05b93e4d5b841012a6f6b4655a66e5a16c0c9"
	},
	"format_ablation": {
	"sha256": "3a31107246bec500025a38079fd0b7f9deb61f5b8c3720056fc650108ee9ceb5"
	},
	"rollout": {
	"sha256": "d0a3cd9e49732efce187466875d5ec6524e537e9c1f05ba88f1070a4cc1b2088"
	},
	"validation": {
	"sha256": "ec286ba1fabbc4263546a1d8fd61bc8a0bfdae2fbed2f7d9020652d2c62b5198"
	}
	},
	"files": {
	"LICENSE": {
	"bytes": 11357,
	"sha256": "c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4"
	},
	"NOTICE": {
	"bytes": 1614,
	"sha256": "f0fae8d2534e7ec7fd5511c94be7946e8c3f8db2845ed3c5853c7f02eaf5b270"
	},
	"README.md": {
	"bytes": 12533,
	"sha256": "40f2d209cb06604959af29779eebbff7d0e7c7d7b9c99188000a7310a2c5e80f"
	},
	"config.json": {
	"bytes": 537,
	"sha256": "5724ce36c7bea70cd7eb5e2c68bb042aed9c906d2635f903d3c3229525996ea8"
	},
	"generation_config.json": {
	"bytes": 99,
	"sha256": "3516faf6a1b98622647372f68b6c31828411902aaf6d86729e6fabfcbebda784"
	},
	"model.safetensors": {
	"bytes": 201377177,
	"sha256": "5432d5cdc52b1b07e5c1f6e253ae03d03a2788ab9ba6f70081225948b83b79a0"
	},
	"mtp.safetensors": {
	"bytes": 14949508,
	"sha256": "e61bdaf9209c944c8bcdc6a5a9103cf192a0c2ed6737b9e072d8f0640e97ae60"
	},
	"mtp_config.json": {
	"bytes": 831,
	"sha256": "8f1e3e54ad13a84ce3d266e66d3e6709269af1b9cf4d8078365e4f9fb3eb41fd"
	},
	"special_tokens_map.json": {
	"bytes": 205,
	"sha256": "6f47ab7c3894d566066e28248f694e19c9227d21d2200f1d952004436f2a476a"
	},
	"tokenizer.json": {
	"bytes": 2275434,
	"sha256": "401a28c1f079050c48f6438830ca772d161d897e3cf2f30588d9ddc587dc6081"
	},
	"tokenizer_config.json": {
	"bytes": 364,
	"sha256": "b0d524cea38409f153a1247c9e22374c4e38b6eabc20ae919cbac645cb657601"
	},
	"wisp_mtp_model.py": {
	"bytes": 6448,
	"sha256": "89e1ef29cb2ed7ebb4206002f0ecdd670859964b3b7466ec3f3087f61d4e88d8"
	},
	"wisp_mtp_reference.py": {
	"bytes": 58085,
	"sha256": "6aedf83bcfdefab63ba59c89609b4f3cdaa287468b66a6ad0e211d0127e8e630"
	}
	},
	"model_card_template_sha256": "ecd9611c82d8a05da30f36ef41b5ec0642ec7a4e6137c20f5951d84a51d55d9f",
	"mtp_parameters_excluding_shared_embedding_and_head": 7474176,
	"portable_evidence_bundle_required": true,
	"release_complete": true,
	"repo_id": "philipjohnbasile/wisp-coder-110m",
	"schema_version": 3,
	"source_checkpoint": {
	"master_sha256": "89e81fb899d054cefaeca89443c20e4d4636167f43cfbc3f47579f79f5f27f22",
	"meta_sha256": "e313c82a3cc153902fe29fce8fe1c9b334bc48d20fcdd81b3bf69a3ccfc4f4eb",
	"optimizer_sha256": "bab7d8b72e22565b0be52bbe8262955247b0442afe277030f2e6aadba55534eb",
	"step": 19073
	},
	"trunk_parameters": 100682496
	}