how to load model-000x-of-0010.safetensors files from a given path instead of from_hf_hub ?

#17
by xuhao79 - opened

just curious how to load a pre downloaded .safetensors files ?

it seems from_model() will do, but it is not recommended. It is recommended to use from_model instead, but i don't have tokenizer folder under my download. I don't want to put download files in cache.

Mistral AI_ org

Hi, from_hf_hub is only for loading the tokenizer. The safetensors file are automatically downloaded when instantiating the model architecture.

juliendenize changed discussion status to closed

Sign up or log in to comment