Spaces:

Xanthius
/

llama-token-counter

Running

Token count for BERT

by sushant-nair - opened Oct 10, 2024

Hey!
Can the llama token counter be used to count the number of tokens for BERT and BART as well?
Thanks.

@Xanthius can you please help me?

sushant-nair changed discussion status to closed Feb 13, 2025

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment