Instructions to use North-ML1/proto-mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use North-ML1/proto-mini with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf North-ML1/proto-mini # Run inference directly in the terminal: llama cli -hf North-ML1/proto-mini
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf North-ML1/proto-mini # Run inference directly in the terminal: llama cli -hf North-ML1/proto-mini
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf North-ML1/proto-mini # Run inference directly in the terminal: ./build/bin/llama cli -hf North-ML1/proto-mini
Use Docker
docker model run hf.co/North-ML1/proto-mini
- Llama new
- LM Studio
- Jan
- vLLM
How to use North-ML1/proto-mini with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "North-ML1/proto-mini" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "North-ML1/proto-mini", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/North-ML1/proto-mini
- Ollama
How to use North-ML1/proto-mini with Ollama:
ollama run hf.co/North-ML1/proto-mini
- Unsloth Desktop
- Docker Model Runner
How to use North-ML1/proto-mini with Docker Model Runner:
docker model run hf.co/North-ML1/proto-mini
- Lemonade
How to use North-ML1/proto-mini with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull North-ML1/proto-mini
Run and chat with the model
lemonade run user.proto-mini-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Proto Mini - Random models that output text
Proto-mini are small GGUF files that output text - without needing to be trained on huge corpus'. Via lite pretraining - random init - and more, we have achieved quality that beats init models. If you cpt on these GGUF's via Unsloth Studio, you get sequence level text generations.
It reaches speeds on 640 tok/s on the content in init.txt, random tokens with c at the start.
It already has the vocab - it just needs to know what to use.
Part of North ML - open weights, honest numbers.
- Downloads last month
- 168
We're not able to determine the quantization variants.