Instructions to use Blockway/Agens-Volundr-tiny-random with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Blockway/Agens-Volundr-tiny-random with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Blockway/Agens-Volundr-tiny-random") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("Blockway/Agens-Volundr-tiny-random", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Blockway/Agens-Volundr-tiny-random with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Blockway/Agens-Volundr-tiny-random" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Blockway/Agens-Volundr-tiny-random", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Blockway/Agens-Volundr-tiny-random
- SGLang
How to use Blockway/Agens-Volundr-tiny-random with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Blockway/Agens-Volundr-tiny-random" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Blockway/Agens-Volundr-tiny-random", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Blockway/Agens-Volundr-tiny-random" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Blockway/Agens-Volundr-tiny-random", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Blockway/Agens-Volundr-tiny-random with Docker Model Runner:
docker model run hf.co/Blockway/Agens-Volundr-tiny-random
Download generation_config.json from Blockway/Agens-Volundr-tiny-random: direct link, hf CLI and curl.
- Browser
- Download file 2.62 kB
-
https://huggingface.co/Blockway/Agens-Volundr-tiny-random/resolve/main/generation_config.json
- Command line
-
hf download hf://Blockway/Agens-Volundr-tiny-random/generation_config.json
-
curl -L -o generation_config.json https://huggingface.co/Blockway/Agens-Volundr-tiny-random/resolve/main/generation_config.json
2.62 kB
| { | |
| "bos_token_id": 248044, | |
| "do_sample": true, | |
| "eos_token_id": [ | |
| 248046, | |
| 248044 | |
| ], | |
| "pad_token_id": 248044, | |
| "temperature": 1.0, | |
| "top_k": 20, | |
| "top_p": 0.95, | |
| "suppress_tokens": [ | |
| 248077, | |
| 248078, | |
| 248079, | |
| 248080, | |
| 248081, | |
| 248082, | |
| 248083, | |
| 248084, | |
| 248085, | |
| 248086, | |
| 248087, | |
| 248088, | |
| 248089, | |
| 248090, | |
| 248091, | |
| 248092, | |
| 248093, | |
| 248094, | |
| 248095, | |
| 248096, | |
| 248097, | |
| 248098, | |
| 248099, | |
| 248100, | |
| 248101, | |
| 248102, | |
| 248103, | |
| 248104, | |
| 248105, | |
| 248106, | |
| 248107, | |
| 248108, | |
| 248109, | |
| 248110, | |
| 248111, | |
| 248112, | |
| 248113, | |
| 248114, | |
| 248115, | |
| 248116, | |
| 248117, | |
| 248118, | |
| 248119, | |
| 248120, | |
| 248121, | |
| 248122, | |
| 248123, | |
| 248124, | |
| 248125, | |
| 248126, | |
| 248127, | |
| 248128, | |
| 248129, | |
| 248130, | |
| 248131, | |
| 248132, | |
| 248133, | |
| 248134, | |
| 248135, | |
| 248136, | |
| 248137, | |
| 248138, | |
| 248139, | |
| 248140, | |
| 248141, | |
| 248142, | |
| 248143, | |
| 248144, | |
| 248145, | |
| 248146, | |
| 248147, | |
| 248148, | |
| 248149, | |
| 248150, | |
| 248151, | |
| 248152, | |
| 248153, | |
| 248154, | |
| 248155, | |
| 248156, | |
| 248157, | |
| 248158, | |
| 248159, | |
| 248160, | |
| 248161, | |
| 248162, | |
| 248163, | |
| 248164, | |
| 248165, | |
| 248166, | |
| 248167, | |
| 248168, | |
| 248169, | |
| 248170, | |
| 248171, | |
| 248172, | |
| 248173, | |
| 248174, | |
| 248175, | |
| 248176, | |
| 248177, | |
| 248178, | |
| 248179, | |
| 248180, | |
| 248181, | |
| 248182, | |
| 248183, | |
| 248184, | |
| 248185, | |
| 248186, | |
| 248187, | |
| 248188, | |
| 248189, | |
| 248190, | |
| 248191, | |
| 248192, | |
| 248193, | |
| 248194, | |
| 248195, | |
| 248196, | |
| 248197, | |
| 248198, | |
| 248199, | |
| 248200, | |
| 248201, | |
| 248202, | |
| 248203, | |
| 248204, | |
| 248205, | |
| 248206, | |
| 248207, | |
| 248208, | |
| 248209, | |
| 248210, | |
| 248211, | |
| 248212, | |
| 248213, | |
| 248214, | |
| 248215, | |
| 248216, | |
| 248217, | |
| 248218, | |
| 248219, | |
| 248220, | |
| 248221, | |
| 248222, | |
| 248223, | |
| 248224, | |
| 248225, | |
| 248226, | |
| 248227, | |
| 248228, | |
| 248229, | |
| 248230, | |
| 248231, | |
| 248232, | |
| 248233, | |
| 248234, | |
| 248235, | |
| 248236, | |
| 248237, | |
| 248238, | |
| 248239, | |
| 248240, | |
| 248241, | |
| 248242, | |
| 248243, | |
| 248244, | |
| 248245, | |
| 248246, | |
| 248247, | |
| 248248, | |
| 248249, | |
| 248250, | |
| 248251, | |
| 248252, | |
| 248253, | |
| 248254, | |
| 248255, | |
| 248256, | |
| 248257, | |
| 248258, | |
| 248259, | |
| 248260, | |
| 248261, | |
| 248262, | |
| 248263, | |
| 248264, | |
| 248265, | |
| 248266, | |
| 248267, | |
| 248268, | |
| 248269, | |
| 248270, | |
| 248271, | |
| 248272, | |
| 248273, | |
| 248274, | |
| 248275, | |
| 248276, | |
| 248277, | |
| 248278, | |
| 248279, | |
| 248280, | |
| 248281, | |
| 248282, | |
| 248283, | |
| 248284, | |
| 248285, | |
| 248286, | |
| 248287, | |
| 248288, | |
| 248289, | |
| 248290, | |
| 248291, | |
| 248292, | |
| 248293, | |
| 248294, | |
| 248295, | |
| 248296, | |
| 248297, | |
| 248298, | |
| 248299, | |
| 248300, | |
| 248301, | |
| 248302, | |
| 248303, | |
| 248304, | |
| 248305, | |
| 248306, | |
| 248307, | |
| 248308, | |
| 248309, | |
| 248310, | |
| 248311, | |
| 248312, | |
| 248313, | |
| 248314, | |
| 248315, | |
| 248316, | |
| 248317, | |
| 248318, | |
| 248319 | |
| ] | |
| } |