Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

joshuaeric
/
vllm-tool-calling-guide

Text Generation
HERMES
English
vllm
tool-calling
function-calling
inference
guide
llama
qwen
mistral
fp8
blackwell
rtx-6000
open-source
multi-step-workflow
prompt-engineering
quantization
deployment
Model card Files Files and versions
xet
Community
vllm-tool-calling-guide / guides
34.3 kB
  • 2 contributors
History: 2 commits
Joshua Odmark
Mistral acquired by RedHat, updating references
2e4500a 2 days ago
  • CONTEXT_LENGTH_FIX.md
    3.63 kB
    Initial release: VLLM tool calling guide for open source models 2 days ago
  • MODEL_COMPARISON.md
    3.72 kB
    Mistral acquired by RedHat, updating references 2 days ago
  • MULTI_STEP_WORKFLOWS.md
    6 kB
    Initial release: VLLM tool calling guide for open source models 2 days ago
  • OPEN_WEBUI_COMPATIBILITY.md
    2.58 kB
    Initial release: VLLM tool calling guide for open source models 2 days ago
  • PROMPT_ENGINEERING_LESSONS.md
    8.85 kB
    Initial release: VLLM tool calling guide for open source models 2 days ago
  • TOOL_CALL_FORMATS.md
    3.76 kB
    Initial release: VLLM tool calling guide for open source models 2 days ago
  • TROUBLESHOOTING.md
    5.82 kB
    Initial release: VLLM tool calling guide for open source models 2 days ago