EXL3 models
Collection
55 items • Updated • 51
How to use turboderp/HyperCLOVAX-SEED-Think-14B-exl3 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("turboderp/HyperCLOVAX-SEED-Think-14B-exl3", dtype="auto")EXL3 quants of HyperCLOVAX-SEED-Think-14B
⚠️ Requires ExLlamaV3 v0.0.19 (or v0.0.18 dev branch)
Base bitrates:
Base model
naver-hyperclovax/HyperCLOVAX-SEED-Think-14B
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("turboderp/HyperCLOVAX-SEED-Think-14B-exl3", dtype="auto")