YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
git clone git@github.com:yohei-kobashi/crypto_llm.git
cd crypto_llm
pip install -r requirements.txt
huggingface-cli download yoheikobashi/suffix_array_fineweb-edu-10BT-0.1 --local-dir ./index_10BT
python script/preprocess/suffix_array_search.py --index-dir ./index_10BT --input [dirname including txt or jsonl files] --window 35
Querying 2,000 texts takes about 3-10 seconds.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support