YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
git clone git@github.com:yohei-kobashi/crypto_llm.git
cd crypto_llm
pip install -r requirements.txt
huggingface-cli download yoheikobashi/suffix_array_fineweb-edu-10BT-0.1 --local-dir ./index_10BT
python script/preprocess/suffix_array_search.py --index-dir ./index_10BT --input [dirname including txt or jsonl files] --window 35

Querying 2,000 texts takes about 3-10 seconds.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support