How to use facebook/llm-compiler-7b-ftd with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("facebook/llm-compiler-7b-ftd", dtype="auto")
SFconvertbot 
tjstavenger