Text Generation
GGUF
English
named-entity-recognition
ner
nlp
information-extraction
person
organization
location
miscellaneous
llama
minibase
small-model
2048-context
Eval Results (legacy)
Instructions to use Minibase/NER-Small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Minibase/NER-Small with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Minibase/NER-Small # Run inference directly in the terminal: llama cli -hf Minibase/NER-Small
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Minibase/NER-Small # Run inference directly in the terminal: llama cli -hf Minibase/NER-Small
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Minibase/NER-Small # Run inference directly in the terminal: ./build/bin/llama cli -hf Minibase/NER-Small
Use Docker
docker model run hf.co/Minibase/NER-Small
- Llama new
- LM Studio
- Jan
- vLLM
How to use Minibase/NER-Small with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Minibase/NER-Small" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Minibase/NER-Small", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Minibase/NER-Small
- Ollama
How to use Minibase/NER-Small with Ollama:
ollama run hf.co/Minibase/NER-Small
- Unsloth Desktop
- Docker Model Runner
How to use Minibase/NER-Small with Docker Model Runner:
docker model run hf.co/Minibase/NER-Small
- Lemonade
How to use Minibase/NER-Small with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Minibase/NER-Small
Run and chat with the model
lemonade run user.NER-Small-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Commit History
-
Update README.md
Verified signature37cfd07 -
Upload README.md with huggingface_hub
Verified signature821d465 -
Upload README.md with huggingface_hub
Verified signature3e8c0b4 -
Upload generation_config.json with huggingface_hub
Verified signature5d71857 -
Upload tokenizer_config.json with huggingface_hub
Verified signature7518c71 -
Upload config.json with huggingface_hub
Verified signature9ea45af -
Upload run_benchmarks.py with huggingface_hub
Verified signature6561522 -
Upload benchmark_config.yaml with huggingface_hub
Verified signatured7c73a3 -
Upload benchmark_results.json with huggingface_hub
Verified signature88401ca -
Upload benchmarks.txt with huggingface_hub
Verified signature4fcfaab -
Upload .gitattributes with huggingface_hub
Verified signature4173f9b -
Upload requirements.txt with huggingface_hub
Verified signature06c8155 -
Upload ner_inference.py with huggingface_hub
Verified signature827270e -
Upload README.md with huggingface_hub
Verified signaturec9881c6 -
Upload generation_config.json with huggingface_hub
Verified signatured40f610 -
Upload tokenizer_config.json with huggingface_hub
Verified signature92dfa57 -
Upload config.json with huggingface_hub
Verified signaturec01603d -
Upload model.gguf with huggingface_hub
Verified signature349e77a -
initial commit
Verified signature9ae8e5e