Buckets:
utils/model_registry
Model registry for cache and file operations
Provides static methods for:
- Discovering which files a model needs
- Detecting available quantization levels (dtypes)
- Getting file metadata
- Checking cache status
Example: Get all files needed for a model
const files = await ModelRegistry.get_files(
"onnx-community/all-MiniLM-L6-v2-ONNX",
{ dtype: "fp16" },
);
console.log(files); // [ 'config.json', 'onnx/model_fp16.onnx', 'onnx/model_fp16.onnx_data', 'tokenizer.json', 'tokenizer_config.json' ]
Example: Get all files needed for a specific pipeline task
const files = await ModelRegistry.get_pipeline_files(
"text-generation",
"onnx-community/Qwen3-0.6B-ONNX",
{ dtype: "q4" },
);
console.log(files); // [ 'config.json', 'onnx/model_q4.onnx', 'generation_config.json', 'tokenizer.json', 'tokenizer_config.json' ]
Example: Get specific component files
const modelFiles = await ModelRegistry.get_model_files("onnx-community/all-MiniLM-L6-v2-ONNX", { dtype: "q4" });
const tokenizerFiles = await ModelRegistry.get_tokenizer_files("onnx-community/all-MiniLM-L6-v2-ONNX");
const processorFiles = await ModelRegistry.get_processor_files("onnx-community/all-MiniLM-L6-v2-ONNX");
console.log(modelFiles); // [ 'config.json', 'onnx/model_q4.onnx', 'onnx/model_q4.onnx_data' ]
console.log(tokenizerFiles); // [ 'tokenizer.json', 'tokenizer_config.json' ]
console.log(processorFiles); // [ ]
Example: Detect available quantization levels for a model
const dtypes = await ModelRegistry.get_available_dtypes("onnx-community/all-MiniLM-L6-v2-ONNX");
console.log(dtypes); // [ 'fp32', 'fp16', 'int8', 'uint8', 'q8', 'q4' ]
// Use the result to pick the best available dtype
const preferredDtype = dtypes.includes("q4") ? "q4" : "fp32";
const files = await ModelRegistry.get_files("onnx-community/all-MiniLM-L6-v2-ONNX", { dtype: preferredDtype });
Example: Check file metadata without downloading
const metadata = await ModelRegistry.get_file_metadata(
"onnx-community/Qwen3-0.6B-ONNX",
"config.json"
);
console.log(metadata); // { exists: true, size: 912, contentType: 'application/json', fromCache: true }
Example: Model cache management
const modelId = "onnx-community/Qwen3-0.6B-ONNX";
const options = { dtype: "q4" };
// Quickly check if the model is cached (probably false)
let cached = await ModelRegistry.is_cached(modelId, options);
console.log(cached); // false
// Get per-file cache detail
let cacheStatus = await ModelRegistry.is_cached_files(modelId, options);
console.log(cacheStatus);
// {
// allCached: false,
// files: [ { file: 'config.json', cached: true }, { file: 'onnx/model_q4.onnx', cached: false }, { file: 'generation_config.json', cached: false }, { file: 'tokenizer.json', cached: false }, { file: 'tokenizer_config.json', cached: false } ]
// }
// Download the model by instantiating a pipeline
const generator = await pipeline("text-generation", modelId, options);
const output = await generator(
[{ role: "user", content: "What is the capital of France?" }],
{ max_new_tokens: 256, do_sample: false },
);
console.log(output[0].generated_text.at(-1).content); // ...\n\nThe capital of France is **Paris**.
// Check if the model is cached (should be true now)
cached = await ModelRegistry.is_cached(modelId, options);
console.log(cached); // true
// Clear the cache
const clearResult = await ModelRegistry.clear_cache(modelId, options);
console.log(clearResult);
// {
// filesDeleted: 5,
// filesCached: 5,
// files: [ { file: 'config.json', deleted: true, wasCached: true }, { file: 'onnx/model_q4.onnx', deleted: true, wasCached: true }, { file: 'generation_config.json', deleted: true, wasCached: true }, { file: 'tokenizer.json', deleted: true, wasCached: true }, { file: 'tokenizer_config.json', deleted: true, wasCached: true } ]
// }
// Check if the model is cached (should be false again)
cached = await ModelRegistry.is_cached(modelId, options);
console.log(cached); // false
- utils/model_registry
- .ModelRegistry
.get_files(modelId, [options])⇒ Promise.<Array>.get_pipeline_files(task, modelId, [options])⇒ Promise.<Array>.get_model_files(modelId, [options])⇒ Promise.<Array>.get_tokenizer_files(modelId)⇒ Promise.<Array>.get_processor_files(modelId)⇒ Promise.<Array>.get_available_dtypes(modelId, [options])⇒ Promise.<Array>.is_cached(modelId, [options])⇒ Promise.<boolean>.is_cached_files(modelId, [options])⇒ Promise.<CacheCheckResult>.is_pipeline_cached(task, modelId, [options])⇒ Promise.<boolean>.is_pipeline_cached_files(task, modelId, [options])⇒ Promise.<CacheCheckResult>.get_file_metadata(path_or_repo_id, filename, [options])⇒ Promise.<{exists: boolean, size: number, contentType: string, fromCache: boolean}>.clear_cache(modelId, [options])⇒ Promise.<CacheClearResult>.clear_pipeline_cache(task, modelId, [options])⇒ Promise.<CacheClearResult>
- .ModelRegistry
utils/model_registry.ModelRegistry
Static class for cache and file management operations.
Kind: static class of utils/model_registry
- .ModelRegistry
.get_files(modelId, [options])⇒ Promise.<Array>.get_pipeline_files(task, modelId, [options])⇒ Promise.<Array>.get_model_files(modelId, [options])⇒ Promise.<Array>.get_tokenizer_files(modelId)⇒ Promise.<Array>.get_processor_files(modelId)⇒ Promise.<Array>.get_available_dtypes(modelId, [options])⇒ Promise.<Array>.is_cached(modelId, [options])⇒ Promise.<boolean>.is_cached_files(modelId, [options])⇒ Promise.<CacheCheckResult>.is_pipeline_cached(task, modelId, [options])⇒ Promise.<boolean>.is_pipeline_cached_files(task, modelId, [options])⇒ Promise.<CacheCheckResult>.get_file_metadata(path_or_repo_id, filename, [options])⇒ Promise.<{exists: boolean, size: number, contentType: string, fromCache: boolean}>.clear_cache(modelId, [options])⇒ Promise.<CacheClearResult>.clear_pipeline_cache(task, modelId, [options])⇒ Promise.<CacheClearResult>
ModelRegistry.get_files(modelId, [options]) ⇒ Promise.<Array>
Get all files (model, tokenizer, processor) needed for a model.
Kind: static method of ModelRegistry
Returns: Promise.<Array> - Array of file paths
ParamTypeDefaultDescription
modelIdstringThe model id (e.g., "onnx-community/bert-base-uncased-ONNX")
[options]ObjectOptional parameters
[options.config]PretrainedConfigPre-loaded config
[options.dtype]DataType | Record.<string, DataType>Override dtype
[options.device]DeviceType | Record.<string, DeviceType>Override device
[options.model_file_name]stringnullOverride the model file name (excluding .onnx suffix)
[options.include_tokenizer]booleantrueWhether to check for tokenizer files
[options.include_processor]booleantrueWhether to check for processor files
Example
const files = await ModelRegistry.get_files('onnx-community/gpt2-ONNX');
console.log(files); // ['config.json', 'tokenizer.json', 'onnx/model_q4.onnx', ...]
ModelRegistry.get_pipeline_files(task, modelId, [options]) ⇒ Promise.<Array>
Get all files needed for a specific pipeline task. Automatically determines which components are needed based on the task.
Kind: static method of ModelRegistry
Returns: Promise.<Array> - Array of file paths
ParamTypeDefaultDescription
taskstringThe pipeline task (e.g., "text-generation", "background-removal")
modelIdstringThe model id (e.g., "onnx-community/bert-base-uncased-ONNX")
[options]ObjectOptional parameters
[options.config]PretrainedConfigPre-loaded config
[options.dtype]DataType | Record.<string, DataType>Override dtype
[options.device]DeviceType | Record.<string, DeviceType>Override device
[options.model_file_name]stringnullOverride the model file name (excluding .onnx suffix)
Example
const files = await ModelRegistry.get_pipeline_files('text-generation', 'onnx-community/gpt2-ONNX');
console.log(files); // ['config.json', 'tokenizer.json', 'onnx/model_q4.onnx', ...]
ModelRegistry.get_model_files(modelId, [options]) ⇒ Promise.<Array>
Get model files needed for a specific model.
Kind: static method of ModelRegistry
Returns: Promise.<Array> - Array of model file paths
ParamTypeDefaultDescription
modelIdstringThe model id
[options]ObjectOptional parameters
[options.config]PretrainedConfigPre-loaded config
[options.dtype]DataType | Record.<string, DataType>Override dtype
[options.device]DeviceType | Record.<string, DeviceType>Override device
[options.model_file_name]stringnullOverride the model file name (excluding .onnx suffix)
Example
const files = await ModelRegistry.get_model_files('onnx-community/bert-base-uncased-ONNX');
console.log(files); // ['config.json', 'onnx/model_q4.onnx', 'generation_config.json']
ModelRegistry.get_tokenizer_files(modelId) ⇒ Promise.<Array>
Get tokenizer files needed for a specific model.
Kind: static method of ModelRegistry
Returns: Promise.<Array> - Array of tokenizer file paths
ParamTypeDescription
modelIdstringThe model id
Example
const files = await ModelRegistry.get_tokenizer_files('onnx-community/gpt2-ONNX');
console.log(files); // ['tokenizer.json', 'tokenizer_config.json']
ModelRegistry.get_processor_files(modelId) ⇒ Promise.<Array>
Get processor files needed for a specific model.
Kind: static method of ModelRegistry
Returns: Promise.<Array> - Array of processor file paths
ParamTypeDescription
modelIdstringThe model id
Example
const files = await ModelRegistry.get_processor_files('onnx-community/vit-base-patch16-224-ONNX');
console.log(files); // ['preprocessor_config.json']
ModelRegistry.get_available_dtypes(modelId, [options]) ⇒ Promise.<Array>
Detects which quantization levels (dtypes) are available for a model by checking which ONNX files exist on the hub or locally.
A dtype is considered available if all required model session files exist for that dtype.
Kind: static method of ModelRegistry
Returns: Promise.<Array> - Array of available dtype strings (e.g., ['fp32', 'fp16', 'q4', 'q8'])
ParamTypeDefaultDescription
modelIdstringThe model id (e.g., "onnx-community/all-MiniLM-L6-v2-ONNX")
[options]ObjectOptional parameters
[options.config]PretrainedConfigPre-loaded config
[options.model_file_name]stringnullOverride the model file name (excluding .onnx suffix)
[options.revision]string"'main'"Model revision
[options.cache_dir]stringnullCustom cache directory
[options.local_files_only]booleanfalseOnly check local files
Example
const dtypes = await ModelRegistry.get_available_dtypes('onnx-community/all-MiniLM-L6-v2-ONNX');
console.log(dtypes); // ['fp32', 'fp16', 'int8', 'uint8', 'q8', 'q4']
ModelRegistry.is_cached(modelId, [options]) ⇒ Promise.<boolean>
Quickly checks if a model is fully cached by verifying config.json is present,
then confirming all required files are cached.
Returns a plain boolean — use is_cached_files if you need per-file detail.
Kind: static method of ModelRegistry
Returns: Promise.<boolean> - Whether all required files are cached
ParamTypeDefaultDescription
modelIdstringThe model id
[options]ObjectOptional parameters
[options.cache_dir]stringCustom cache directory
[options.revision]stringModel revision (default: 'main')
[options.config]PretrainedConfigPre-loaded config
[options.dtype]DataType | Record.<string, DataType>Override dtype
[options.device]DeviceType | Record.<string, DeviceType>Override device
Example
const cached = await ModelRegistry.is_cached('onnx-community/bert-base-uncased-ONNX');
console.log(cached); // true or false
ModelRegistry.is_cached_files(modelId, [options]) ⇒ Promise.<CacheCheckResult>
Checks if all files for a given model are already cached, with per-file detail. Automatically determines which files are needed using get_files().
Kind: static method of ModelRegistry
Returns: Promise.<CacheCheckResult> - Object with allCached boolean and files array with cache status
ParamTypeDefaultDescription
modelIdstringThe model id
[options]ObjectOptional parameters
[options.cache_dir]stringCustom cache directory
[options.revision]stringModel revision (default: 'main')
[options.config]PretrainedConfigPre-loaded config
[options.dtype]DataType | Record.<string, DataType>Override dtype
[options.device]DeviceType | Record.<string, DeviceType>Override device
Example
const status = await ModelRegistry.is_cached_files('onnx-community/bert-base-uncased-ONNX');
console.log(status.allCached); // true or false
console.log(status.files); // [{ file: 'config.json', cached: true }, ...]
ModelRegistry.is_pipeline_cached(task, modelId, [options]) ⇒ Promise.<boolean>
Quickly checks if all files for a specific pipeline task are cached by verifying
config.json is present, then confirming all required files are cached.
Returns a plain boolean — use is_pipeline_cached_files if you need per-file detail.
Kind: static method of ModelRegistry
Returns: Promise.<boolean> - Whether all required files are cached
ParamTypeDefaultDescription
taskstringThe pipeline task (e.g., "text-generation", "background-removal")
modelIdstringThe model id
[options]ObjectOptional parameters
[options.cache_dir]stringCustom cache directory
[options.revision]stringModel revision (default: 'main')
[options.config]PretrainedConfigPre-loaded config
[options.dtype]DataType | Record.<string, DataType>Override dtype
[options.device]DeviceType | Record.<string, DeviceType>Override device
Example
const cached = await ModelRegistry.is_pipeline_cached('text-generation', 'onnx-community/gpt2-ONNX');
console.log(cached); // true or false
ModelRegistry.is_pipeline_cached_files(task, modelId, [options]) ⇒ Promise.<CacheCheckResult>
Checks if all files for a specific pipeline task are already cached, with per-file detail. Automatically determines which components are needed based on the task.
Kind: static method of ModelRegistry
Returns: Promise.<CacheCheckResult> - Object with allCached boolean and files array with cache status
ParamTypeDefaultDescription
taskstringThe pipeline task (e.g., "text-generation", "background-removal")
modelIdstringThe model id
[options]ObjectOptional parameters
[options.cache_dir]stringCustom cache directory
[options.revision]stringModel revision (default: 'main')
[options.config]PretrainedConfigPre-loaded config
[options.dtype]DataType | Record.<string, DataType>Override dtype
[options.device]DeviceType | Record.<string, DeviceType>Override device
Example
const status = await ModelRegistry.is_pipeline_cached_files('text-generation', 'onnx-community/gpt2-ONNX');
console.log(status.allCached); // true or false
console.log(status.files); // [{ file: 'config.json', cached: true }, ...]
ModelRegistry.get_file_metadata(path_or_repo_id, filename, [options]) ⇒ Promise.<{exists: boolean, size: number, contentType: string, fromCache: boolean}>
Get metadata for a specific file without downloading it.
Kind: static method of ModelRegistry
Returns: Promise.<{exists: boolean, size: number, contentType: string, fromCache: boolean}> - File metadata
ParamTypeDescription
path_or_repo_idstringModel id or path
filenamestringThe file name
[options]PretrainedOptionsOptional parameters
Example
const metadata = await ModelRegistry.get_file_metadata('onnx-community/gpt2-ONNX', 'config.json');
console.log(metadata.exists, metadata.size); // true, 665
ModelRegistry.clear_cache(modelId, [options]) ⇒ Promise.<CacheClearResult>
Clears all cached files for a given model. Automatically determines which files are needed and removes them from the cache.
Kind: static method of ModelRegistry
Returns: Promise.<CacheClearResult> - Object with deletion statistics and file status
ParamTypeDefaultDescription
modelIdstringThe model id (e.g., "onnx-community/gpt2-ONNX")
[options]ObjectOptional parameters
[options.cache_dir]stringCustom cache directory
[options.revision]stringModel revision (default: 'main')
[options.config]PretrainedConfigPre-loaded config
[options.dtype]DataType | Record.<string, DataType>Override dtype
[options.device]DeviceType | Record.<string, DeviceType>Override device
[options.include_tokenizer]booleantrueWhether to clear tokenizer files
[options.include_processor]booleantrueWhether to clear processor files
Example
const result = await ModelRegistry.clear_cache('onnx-community/bert-base-uncased-ONNX');
console.log(`Deleted ${result.filesDeleted} of ${result.filesCached} cached files`);
ModelRegistry.clear_pipeline_cache(task, modelId, [options]) ⇒ Promise.<CacheClearResult>
Clears all cached files for a specific pipeline task. Automatically determines which components are needed based on the task.
Kind: static method of ModelRegistry
Returns: Promise.<CacheClearResult> - Object with deletion statistics and file status
ParamTypeDescription
taskstringThe pipeline task (e.g., "text-generation", "image-classification")
modelIdstringThe model id (e.g., "onnx-community/gpt2-ONNX")
[options]ObjectOptional parameters
[options.cache_dir]stringCustom cache directory
[options.revision]stringModel revision (default: 'main')
[options.config]PretrainedConfigPre-loaded config
[options.dtype]DataType | Record.<string, DataType>Override dtype
[options.device]DeviceType | Record.<string, DeviceType>Override device
Example
const result = await ModelRegistry.clear_pipeline_cache('text-generation', 'onnx-community/gpt2-ONNX');
console.log(`Deleted ${result.filesDeleted} of ${result.filesCached} cached files`);
Xet Storage Details
- Size:
- 22.8 kB
- Xet hash:
- 2800e68bd9736152b09ee8822ae054b8095f2646e316ac0d273fb49efd97e010
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.