How to use baseten/bloom-560m-a100-for-testing with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("baseten/bloom-560m-a100-for-testing", dtype="auto")
