allbilly/mistral-7b-instruct-fp16-yalm

Mistral-7B-Instruct FP16 (yalm format)

Converted checkpoint for yalm.

• Source: mistralai/Mistral-7B-Instruct-v0.2
• Format: .yalm (safetensors + embedded tokenizer)
• dtype: fp16
• License: Apache 2.0 (derived from Mistral weights)

Usage

git clone https://github.com/andrewkchan/yalm.git
cd yalm && make
hf download allbilly/mistral-7b-instruct-fp16-yalm mistral-7b-instruct-fp16.yalm
./build/main mistral-7b-instruct-fp16.yalm -d cuda -i "Q: What is the meaning of life?" -n 32