How to use baseten/bloom-560-tp2-default with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("baseten/bloom-560-tp2-default", dtype="auto")
