Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

jabbatheduck
/
ninfer-ext-models

Image-Text-to-Text
Trellis
NInfer
English
Chinese
code
ninfer-ext
exl3
nvfp4
Mixture of Experts
expert-offload
blackwell
quantization
cuda
text-generation
vision
speculative-decoding
Model card Files Files and versions
xet
Community

Instructions to use jabbatheduck/ninfer-ext-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • Trellis

    How to use jabbatheduck/ninfer-ext-models with Trellis:

    # No code snippets available yet for this library.
    
    # To use this model, check the repository files and the library's documentation.
    
    # Want to help? PRs adding snippets are welcome at:
    # https://github.com/huggingface/huggingface.js
  • NInfer

    How to use jabbatheduck/ninfer-ext-models with NInfer:

    # No code snippets available yet for this library.
    
    # To use this model, check the repository files and the library's documentation.
    
    # Want to help? PRs adding snippets are welcome at:
    # https://github.com/huggingface/huggingface.js
  • Notebooks
  • Google Colab
  • Kaggle
ninfer-ext-models
343 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 28 commits
jabbatheduck's picture
jabbatheduck
Card: add Qwen3.8-Flash-Next EXL3 4.0 and 3.5 bpw
b20a34d verified 1 day ago
  • qwen3.8-flash-next-exl3-3p5bpw
    Add qwen3.8-flash-next-exl3-3p5bpw (EXL3 routed experts, Text + MTP) 2 days ago
  • qwen3.8-flash-next-exl3-4bpw
    Add qwen3.8-flash-next-exl3-4bpw (EXL3 routed experts, Text + MTP) 1 day ago
  • qwen3.8-flash-next
    Qwen3.8-Flash-Next: label prefill with ngram residency; note mapped is ~1.7x faster 4 days ago
  • .gitattributes
    2.79 kB
    Add qwen3.8-flash-next-exl3-4bpw (EXL3 routed experts, Text + MTP) 1 day ago
  • README.md
    13.1 kB
    Card: add Qwen3.8-Flash-Next EXL3 4.0 and 3.5 bpw 1 day ago
  • qwen3_8_27b_exl3_3p5bpw.ninfer
    15.3 GB
    xet
    Rebuild with the indexed draft head and the fork chat template 7 days ago
  • qwen3_8_27b_exl3_3p5bpw.ninfer.conversion.json
    491 kB
    Rebuild with the indexed draft head and the fork chat template 7 days ago
  • qwen3_8_27b_exl3_4bpw.ninfer
    16.8 GB
    xet
    Rebuild with the indexed draft head and the fork chat template 7 days ago
  • qwen3_8_27b_exl3_4bpw.ninfer.conversion.json
    491 kB
    Rebuild with the indexed draft head and the fork chat template 7 days ago