How to use Atotti/llm-jp-4-8b-speech-chat with Transformers:
# Load model directly from transformers import LlamaForSpeechLM model = LlamaForSpeechLM.from_pretrained("Atotti/llm-jp-4-8b-speech-chat", dtype="auto")
