Buckets:
| # utils/hub | |
| Utility functions to interact with the Hugging Face Hub (https://huggingface.co/models) | |
| ## Type Definitions | |
| ### ExternalData | |
| Specifies whether to load the model using the external data format. | |
| - `false`: Do not use external data format | |
| - `true`: Use external data format with 1 chunk | |
| - `number`: Use external data format with the specified number of chunks | |
| _Type:_ `boolean` | `number` | |
| ### PretrainedOptions | |
| Options for loading a pretrained model. | |
| **Properties** | |
| - `progress_callback` ([`ProgressCallback`](./core#module_utils/core.ProgressCallback)) _optional_ — defaults to `null` — If specified, this function is called during model construction with progress updates. | |
| - `config` ([`PretrainedConfig`](../configs#module_configs.PretrainedConfig)) _optional_ — defaults to `null` — Configuration to use for the model instead of an automatically loaded configuration. Configuration can be automatically loaded when: | |
| - The model is provided by the library and loaded with the *model ID* string of a pretrained model. | |
| - The model is loaded by supplying a local directory as `pretrained_model_name_or_path` and a configuration JSON file named *config.json* is found in the directory. | |
| - `cache_dir` (`string`) _optional_ — defaults to `null` — Path to a directory where downloaded model files should be cached if the standard cache should not be used. | |
| - `local_files_only` (`boolean`) _optional_ — defaults to `false` — Whether to only look at local files (e.g., not try downloading the model). | |
| - `revision` (`string`) _optional_ — defaults to `'main'` — The model revision to use. This can be a branch name, tag name, or commit ID. | |
| Because the Hub uses Git-based storage, `revision` can be any identifier accepted by Git. Ignored for local requests. | |
| ### ModelSpecificPretrainedOptions | |
| Options for loading a pretrained model. | |
| **Properties** | |
| - `subfolder` (`string`) _optional_ — defaults to `'onnx'` — In case the relevant files are located inside a subfolder of the model repo on huggingface.co, | |
| you can specify the folder name here. | |
| - `model_file_name` (`string`) _optional_ — defaults to `null` — Override the base ONNX model file name, excluding dtype and `.onnx` suffixes. This is most useful for single-session models. | |
| - `device` ([`DeviceType`](../transformers#module_transformers.DeviceType) | `Record`<`string`, [`DeviceType`](../transformers#module_transformers.DeviceType)>) _optional_ — defaults to `null` — The device to run the model on. If not specified, the device will be chosen from the environment settings. | |
| - `dtype` ([`DataType`](../transformers#module_transformers.DataType) | `Record`<`string`, [`DataType`](../transformers#module_transformers.DataType)>) _optional_ — defaults to `null` — The data type to use for the model. If not specified, the data type will be chosen from the environment settings. | |
| - `use_external_data_format` ([`ExternalData`](./hub#module_utils/hub.ExternalData) | `Record`<`string`, [`ExternalData`](./hub#module_utils/hub.ExternalData)>) _optional_ — defaults to `null` — Whether to load external data files. `null` uses the model configuration; `false` disables external data; `true` uses one chunk; a number selects the chunk count. | |
| - `session_options` (`InferenceSession.SessionOptions`) _optional_ — defaults to `{}` — User-specified ONNX Runtime session options. Suitable defaults are filled in when omitted. | |
| ### PretrainedModelOptions | |
| Options for loading a pretrained model. | |
| _Type:_ [`PretrainedOptions`](./hub#module_utils/hub.PretrainedOptions) & [`ModelSpecificPretrainedOptions`](./hub#module_utils/hub.ModelSpecificPretrainedOptions) | |
Xet Storage Details
- Size:
- 3.67 kB
- Xet hash:
- b4133e88e4641d4a5cfb230a259c662ef355099f69694f515e2da6ea2d67b832
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.