How to use aspctu/llama31-70b-engine-4gpu-basic with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("aspctu/llama31-70b-engine-4gpu-basic", dtype="auto")
