Instructions to use npc-worldwide/tinytim-v2-1b-it with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use npc-worldwide/tinytim-v2-1b-it with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="npc-worldwide/tinytim-v2-1b-it", filename="tinytim-v2-1b-it-q4_k_m.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use npc-worldwide/tinytim-v2-1b-it with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M # Run inference directly in the terminal: llama-cli -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M # Run inference directly in the terminal: llama-cli -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M
Use Docker
docker model run hf.co/npc-worldwide/tinytim-v2-1b-it:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use npc-worldwide/tinytim-v2-1b-it with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "npc-worldwide/tinytim-v2-1b-it" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "npc-worldwide/tinytim-v2-1b-it", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/npc-worldwide/tinytim-v2-1b-it:Q4_K_M
- Ollama
How to use npc-worldwide/tinytim-v2-1b-it with Ollama:
ollama run hf.co/npc-worldwide/tinytim-v2-1b-it:Q4_K_M
- Unsloth Studio new
How to use npc-worldwide/tinytim-v2-1b-it with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for npc-worldwide/tinytim-v2-1b-it to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for npc-worldwide/tinytim-v2-1b-it to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for npc-worldwide/tinytim-v2-1b-it to start chatting
- Docker Model Runner
How to use npc-worldwide/tinytim-v2-1b-it with Docker Model Runner:
docker model run hf.co/npc-worldwide/tinytim-v2-1b-it:Q4_K_M
- Lemonade
How to use npc-worldwide/tinytim-v2-1b-it with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull npc-worldwide/tinytim-v2-1b-it:Q4_K_M
Run and chat with the model
lemonade run user.tinytim-v2-1b-it-Q4_K_M
List all available models
lemonade list
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M# Run inference directly in the terminal:
llama-cli -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_MUse pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M# Run inference directly in the terminal:
./llama-cli -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_MBuild from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M# Run inference directly in the terminal:
./build/bin/llama-cli -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_MUse Docker
docker model run hf.co/npc-worldwide/tinytim-v2-1b-it:Q4_K_MTinyTim v2 1B IT
A reasoning model fine-tuned to produce Joycean-styled reasoning traces constrained to Finnegans Wake vocabulary, while maintaining factual correctness on standard benchmarks.
What it does
TinyTim takes questions and produces reasoning traces where the thinking process is expressed using vocabulary drawn from James Joyce's Finnegans Wake, while the final answers remain factually correct. It demonstrates that linguistic style and factual reasoning are separable โ a model can reason in any register.
Training
- Base model: google/gemma-3-1b-it
- Method: SFT using npcpy's
run_sftwith LoRA (r=128, alpha=256) - Data generation: Reasoning traces from multiple models (GPT-OSS 20B, Qwen3 4B Thinking, DeepSeek-R1 32B) were "Joyceanized" โ rewritten constrained to Wake vocabulary using a converter model
- Training data: TruthfulQA questions with Wake-styled reasoning traces
- Evaluation: AI2-ARC, with LLM-judge correctness scoring
Architecture
Follows the tinytim-r1 pipeline:
- Generate native reasoning trace from a question
- Rewrite the trace constrained to Finnegans Wake vocabulary
- SFT on (question, wake-trace) pairs
- Evaluate factual correctness despite stylistic constraint
Usage
from npcpy.ft.sft import load_sft_model, predict_sft
model, tokenizer = load_sft_model("npc-worldwide/tinytim-v2-1b-it")
response = predict_sft(model, tokenizer, "What is the capital of France?", max_new_tokens=300)
print(response)
Or via Ollama:
ollama run hf.co/npc-worldwide/tinytim-v2-1b-it
Part of the NPC Worldwide ecosystem
- Downloads last month
- 24
Install from brew
# Start a local OpenAI-compatible server with a web UI: llama-server -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M# Run inference directly in the terminal: llama-cli -hf npc-worldwide/tinytim-v2-1b-it:Q4_K_M