How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("feature-extraction", model="xtc2023/qm3_model_7B_q4bit_normal")
# Load model directly
from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("xtc2023/qm3_model_7B_q4bit_normal")
model = AutoModel.from_pretrained("xtc2023/qm3_model_7B_q4bit_normal", device_map="auto")
Quick Links

Uploaded finetuned model

  • Developed by: xtc2023
  • License: apache-2.0
  • Finetuned from model : unsloth/Qwen3-8B-unsloth-bnb-4bit

This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for xtc2023/qm3_model_7B_q4bit_normal

Finetuned
Qwen/Qwen3-8B
Finetuned
(298)
this model