How to use treehugg3/dbrx-base-tokenizer-llamacpp with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("treehugg3/dbrx-base-tokenizer-llamacpp", dtype="auto")
How to use treehugg3/dbrx-base-tokenizer-llamacpp with Transformers.js:
// ⚠️ Unknown pipeline tag
