Instructions to use numen-tech/DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLC-LLM
How to use numen-tech/DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4 with MLC-LLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Fix README
Browse files
README.md
CHANGED
|
@@ -8,4 +8,4 @@ library_name: mlc-llm
|
|
| 8 |
pipeline_tag: text-generation
|
| 9 |
---
|
| 10 |
|
| 11 |
-
4-bit
|
|
|
|
| 8 |
pipeline_tag: text-generation
|
| 9 |
---
|
| 10 |
|
| 11 |
+
4-bit GPTQ quantized version of [DeepSeek-R1-Distill-Qwen-7B](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B) for inference with the [Private LLM](http://privatellm.app) app.
|