Hugging Face's logo

Xenova
/
bloom-560m

Text Generation
Transformers.js
ONNX
bloom
Model card Files
xet
Community
2

Add/update the quantized ONNX model files and README.md for Transformers.js v3

#2
by whitphx HF Staff - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+37
-0
whitphx

Applied Quantizations

❌ Based on decoder_model.onnx with slimming 

None

↳ ❌ fp16: decoder_model_fp16.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmp86lzawnp/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ int8: decoder_model_int8.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmp86lzawnp/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ uint8: decoder_model_uint8.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmp86lzawnp/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ q4: decoder_model_q4.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmp86lzawnp/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ q4f16: decoder_model_q4f16.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmp86lzawnp/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ bnb4: decoder_model_bnb4.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmp86lzawnp/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

❌ Based on decoder_with_past_model.onnx with slimming 

None

↳ ❌ fp16: decoder_with_past_model_fp16.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmpy5kossov/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ int8: decoder_with_past_model_int8.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmpy5kossov/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ uint8: decoder_with_past_model_uint8.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmpy5kossov/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ q4: decoder_with_past_model_q4.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmpy5kossov/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ q4f16: decoder_with_past_model_q4f16.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmpy5kossov/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

↳ ❌ bnb4: decoder_with_past_model_bnb4.onnx (added but JS-based E2E test failed)

dtype not specified for "model". Using the default dtype (fp32) for this device (cpu).
file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853
                    throw Error(`\`local_files_only=true\` or \`env.allowRemoteModels=false\` and file was not found locally at "${localPath}".`);
                          ^

Error: `local_files_only=true` or `env.allowRemoteModels=false` and file was not found locally at "/tmp/tmpy5kossov/115f9242bc5d2dc3b6b3b78e53277e028cb90d65/onnx/model.onnx".
    at getModelFile (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:30853:27)
    at async getSession (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7132:28)
    at async file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7149:73
    at async Promise.all (index 0)
    at async constructSessions (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7147:31)
    at async Promise.all (index 0)
    at async BloomForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:7946:20)
    at async AutoModelForCausalLM.from_pretrained (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:14326:20)
    at async Promise.all (index 1)
    at async loadItems (file:///home/ubuntu/src/tjsmigration/node_modules/.pnpm/@huggingface+transformers@3.5.2/node_modules/@huggingface/transformers/dist/transformers.node.mjs:23881:5)

Node.js v22.16.0

✅ Based on decoder_model_merged.onnx with slimming

The base model decoder_model_merged.onnx has been renamed to model.onnx.

↳ ✅ fp16: model_fp16.onnx (added)
↳ ✅ int8: model_int8.onnx (added)
↳ ✅ uint8: model_uint8.onnx (added)
↳ ✅ q4: model_q4.onnx (added)
↳ ✅ q4f16: model_q4f16.onnx (added)
↳ ✅ bnb4: model_bnb4.onnx (added)

 Add/update the quantized ONNX model files and README.md for Transformers.js v3259509f5
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment