update 1aa5747
syx commited on
How to use Tiiny/ReluLLaMA-70B-PowerInfer-GGUF with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("Tiiny/ReluLLaMA-70B-PowerInfer-GGUF", dtype="auto")