Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

xThr45hx
/
TensorRT-LLM-Windows-RTX40

TensorRT
tensorrt-llm
windows
native
rtx-4000
ada
sm89
cuda
llm-inference
qwen3
Model card Files Files and versions
xet
Community

Instructions to use xThr45hx/TensorRT-LLM-Windows-RTX40 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • TensorRT

    How to use xThr45hx/TensorRT-LLM-Windows-RTX40 with TensorRT:

    # No code snippets available yet for this library.
    
    # To use this model, check the repository files and the library's documentation.
    
    # Want to help? PRs adding snippets are welcome at:
    # https://github.com/huggingface/huggingface.js
  • Notebooks
  • Google Colab
  • Kaggle
TensorRT-LLM-Windows-RTX40
3.84 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 6 commits
xThr45hx's picture
xThr45hx
Add prebuilt INT4 engine (Josiefied-Qwen3-4B, 16k ctx)
f442a98 verified 2 days ago
  • dll
    Add import library 2 days ago
  • engine
    Add prebuilt INT4 engine (Josiefied-Qwen3-4B, 16k ctx) 2 days ago
  • patches
    Add source, patches, scripts, build notes, README, LICENSE 2 days ago
  • scripts
    Add source, patches, scripts, build notes, README, LICENSE 2 days ago
  • .gitattributes
    1.69 kB
    Add prebuilt INT4 engine (Josiefied-Qwen3-4B, 16k ctx) 2 days ago
  • BUILD_README.md
    6.45 kB
    Add source, patches, scripts, build notes, README, LICENSE 2 days ago
  • LICENSE
    11.4 kB
    Add source, patches, scripts, build notes, README, LICENSE 2 days ago
  • README.md
    4.52 kB
    Fix base_model to Josiefied-Qwen3-4B-abliterated-v1 + note uncensored engine 2 days ago