Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
joshuaeric
/
vllm-tool-calling-guide
like
0
Text Generation
HERMES
English
vllm
tool-calling
function-calling
inference
guide
llama
qwen
mistral
fp8
blackwell
rtx-6000
open-source
multi-step-workflow
prompt-engineering
quantization
deployment
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Use this model
main
vllm-tool-calling-guide
/
configs
11.2 kB
2 contributors
History:
2 commits
Joshua Odmark
Mistral acquired by RedHat, updating references
2e4500a
2 days ago
README.md
1.34 kB
Initial release: VLLM tool calling guide for open source models
2 days ago
hermes3_llama31_70b_fp8.sh
3 kB
Initial release: VLLM tool calling guide for open source models
2 days ago
llama33_70b_fp8.sh
2.38 kB
Initial release: VLLM tool calling guide for open source models
2 days ago
mistral_nemo_12b_fp8.sh
2.29 kB
Mistral acquired by RedHat, updating references
2 days ago
qwen2_72b_fp8.sh
2.14 kB
Mistral acquired by RedHat, updating references
2 days ago