head: make models query-aware (last-token readout) + trainer update d9fbc8a
Throstur commited on
How to use throsturx/bihmoe-poc with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("throsturx/bihmoe-poc", dtype="auto")