How to use baseten/bloo-560m0-h100-basic-for-testing with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("baseten/bloo-560m0-h100-basic-for-testing", dtype="auto")