How to use ZhankuiHe/gpt8gen with Transformers:
# Load model directly from transformers import Switch4GenModule model = Switch4GenModule.from_pretrained("ZhankuiHe/gpt8gen", dtype="auto")
