Fix base_model to Josiefied-Qwen3-4B-abliterated-v1 + note uncensored engine
Browse files
README.md
CHANGED
|
@@ -12,7 +12,7 @@ tags:
|
|
| 12 |
- llm-inference
|
| 13 |
- qwen3
|
| 14 |
base_model:
|
| 15 |
-
-
|
| 16 |
---
|
| 17 |
|
| 18 |
# TensorRT-LLM — Native Windows Build for RTX 40-Series (Ada / SM89)
|
|
@@ -64,7 +64,9 @@ TensorRT-LLM normally needs WSL2 or Linux on Windows. This is a **from-source na
|
|
| 64 |
|
| 65 |
## Using the prebuilt engine
|
| 66 |
|
| 67 |
-
`engine/rank0.engine` is a ready-to-serve TensorRT-LLM engine for Josiefied-Qwen3-4B (INT4, 16k context). Point a TensorRT-LLM runtime built against the included `tensorrt_llm.dll` at it. See `scripts/` for serving examples.
|
|
|
|
|
|
|
| 68 |
|
| 69 |
## Building from source
|
| 70 |
|
|
|
|
| 12 |
- llm-inference
|
| 13 |
- qwen3
|
| 14 |
base_model:
|
| 15 |
+
- Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v1
|
| 16 |
---
|
| 17 |
|
| 18 |
# TensorRT-LLM — Native Windows Build for RTX 40-Series (Ada / SM89)
|
|
|
|
| 64 |
|
| 65 |
## Using the prebuilt engine
|
| 66 |
|
| 67 |
+
`engine/rank0.engine` is a ready-to-serve TensorRT-LLM engine for **[Josiefied-Qwen3-4B-abliterated-v1](https://huggingface.co/Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v1)** (INT4, 16k context, batch 1). Point a TensorRT-LLM runtime built against the included `tensorrt_llm.dll` at it. See `scripts/` for serving examples.
|
| 68 |
+
|
| 69 |
+
> ⚠️ **This engine is an abliterated (uncensored) model.** It's built from Josiefied-Qwen3-4B-abliterated-v1, not stock Qwen3-4B. If you want a stock/aligned model, build your own engine from the base weights using the `patches/` + `BUILD_README.md`.
|
| 70 |
|
| 71 |
## Building from source
|
| 72 |
|