Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

joshuaeric
/
vllm-tool-calling-guide

Text Generation
HERMES
English
vllm
tool-calling
function-calling
inference
guide
llama
qwen
mistral
fp8
blackwell
rtx-6000
open-source
multi-step-workflow
prompt-engineering
quantization
deployment
Model card Files Files and versions
xet
Community

Instructions to use joshuaeric/vllm-tool-calling-guide with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • HERMES

    How to use joshuaeric/vllm-tool-calling-guide with HERMES:

    # No code snippets available yet for this library.
    
    # To use this model, check the repository files and the library's documentation.
    
    # Want to help? PRs adding snippets are welcome at:
    # https://github.com/huggingface/huggingface.js
  • Notebooks
  • Google Colab
  • Kaggle
vllm-tool-calling-guide / guides
34.3 kB
Ctrl+K
Ctrl+K
  • 2 contributors
History: 2 commits
Joshua Odmark
Mistral acquired by RedHat, updating references
2e4500a 3 months ago
  • CONTEXT_LENGTH_FIX.md
    3.63 kB
    Initial release: VLLM tool calling guide for open source models 3 months ago
  • MODEL_COMPARISON.md
    3.72 kB
    Mistral acquired by RedHat, updating references 3 months ago
  • MULTI_STEP_WORKFLOWS.md
    6 kB
    Initial release: VLLM tool calling guide for open source models 3 months ago
  • OPEN_WEBUI_COMPATIBILITY.md
    2.58 kB
    Initial release: VLLM tool calling guide for open source models 3 months ago
  • PROMPT_ENGINEERING_LESSONS.md
    8.85 kB
    Initial release: VLLM tool calling guide for open source models 3 months ago
  • TOOL_CALL_FORMATS.md
    3.76 kB
    Initial release: VLLM tool calling guide for open source models 3 months ago
  • TROUBLESHOOTING.md
    5.82 kB
    Initial release: VLLM tool calling guide for open source models 3 months ago