How to use ldhldh/8b_chat with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ldhldh/8b_chat", dtype="auto")