How to use NorthernTribe-Research/UMSR-Reasoner-7B-INT8 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("NorthernTribe-Research/UMSR-Reasoner-7B-INT8", dtype="auto")
