Instructions to use LumiOpen/Viking-13B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use LumiOpen/Viking-13B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="LumiOpen/Viking-13B")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("LumiOpen/Viking-13B") model = AutoModelForCausalLM.from_pretrained("LumiOpen/Viking-13B") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use LumiOpen/Viking-13B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "LumiOpen/Viking-13B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LumiOpen/Viking-13B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/LumiOpen/Viking-13B
- SGLang
How to use LumiOpen/Viking-13B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "LumiOpen/Viking-13B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LumiOpen/Viking-13B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "LumiOpen/Viking-13B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "LumiOpen/Viking-13B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use LumiOpen/Viking-13B with Docker Model Runner:
docker model run hf.co/LumiOpen/Viking-13B
Commit History
Upload config.json cf2a794 verified
Elaine commited on
Delete config.json 42d8ff3 verified
Elaine commited on
update readme b9b3e0f
jonabur commited on
2000B 8f2c8dd
jonabur commited on
1900B a2f41ca
jonabur commited on
1800B 36bd66b
jonabur commited on
Update README.md 9ac9294 verified
update checkpoint list a4690c9
jonabur commited on
1700B a3641fb
jonabur commited on
1600B 1a43d8a
jonabur commited on
1500B 331c0c0
jonabur commited on
1400B 5e88855
jonabur commited on
1300B 88bd365
jonabur commited on
1200B d3f2fd0
jonabur commited on
1100B 9217577
jonabur commited on
add readme dc614ca
jonabur commited on
1000B 13f9afd
jonabur commited on
900B a78f982
jonabur commited on
800B b17cd2b
jonabur commited on
update readme b347d80
jonabur commited on
700B 6f773b6
jonabur commited on
600B 3567d35
jonabur commited on
500B 64eab29
jonabur commited on
400B 62ff72c
jonabur commited on
300B f67a177
jonabur commited on
200B c9d420b
jonabur commited on
100B 6011515
jonabur commited on