Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

joshuaeric
/
vllm-tool-calling-guide

Text Generation
HERMES
English
vllm
tool-calling
function-calling
inference
guide
llama
qwen
mistral
fp8
blackwell
rtx-6000
open-source
multi-step-workflow
prompt-engineering
quantization
deployment
Model card Files Files and versions
xet
Community
vllm-tool-calling-guide / configs
11.2 kB
  • 2 contributors
History: 2 commits
Joshua Odmark
Mistral acquired by RedHat, updating references
2e4500a 2 days ago
  • README.md
    1.34 kB
    Initial release: VLLM tool calling guide for open source models 2 days ago
  • hermes3_llama31_70b_fp8.sh
    3 kB
    Initial release: VLLM tool calling guide for open source models 2 days ago
  • llama33_70b_fp8.sh
    2.38 kB
    Initial release: VLLM tool calling guide for open source models 2 days ago
  • mistral_nemo_12b_fp8.sh
    2.29 kB
    Mistral acquired by RedHat, updating references 2 days ago
  • qwen2_72b_fp8.sh
    2.14 kB
    Mistral acquired by RedHat, updating references 2 days ago