How to use aspctu/llama31-70b-tllm_checkpoint_4gpu_basic with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("aspctu/llama31-70b-tllm_checkpoint_4gpu_basic", dtype="auto")
aspctu commited on 