How to use mindw96/DeepSeek-R1-Distill-Qwen-7B-4Bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mindw96/DeepSeek-R1-Distill-Qwen-7B-4Bit", dtype="auto")
The community tab is the place to discuss and collaborate with the HF community!