chopratejas
/

kompress-small

Token Classification

token-compression

context-optimization

Eval Results (legacy)

Model card Files Files and versions

747 MB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

chopratejas's picture

Add model card: 70M distilled model, 7.4/10 quality, 13ms ONNX

eacbdc5 verified 17 days ago

.gitattributes

1.57 kB
kompress-small: distilled 6-layer model, 70M params, 7.4/10 quality, 13-29ms ONNX 17 days ago
README.md

4.37 kB
Add model card: 70M distilled model, 7.4/10 quality, 13ms ONNX 17 days ago
model.onnx

532 kB
xet

kompress-small: distilled 6-layer model, 70M params, 7.4/10 quality, 13-29ms ONNX 17 days ago
model.onnx.data

275 MB
xet

kompress-small: distilled 6-layer model, 70M params, 7.4/10 quality, 13-29ms ONNX 17 days ago
model.safetensors

279 MB
xet

kompress-small: distilled 6-layer model, 70M params, 7.4/10 quality, 13-29ms ONNX 17 days ago
model_int8.pt
Detected Pickle imports (9)
- "torch._utils._rebuild_tensor_v2",
- "torch.LongStorage",
- "torch.QInt8Storage",
- "torch.FloatStorage",
- "torch.per_tensor_affine",
- "collections.OrderedDict",
- "torch._utils._rebuild_parameter",
- "torch.qint8",
- "torch._utils._rebuild_qtensor"
How to fix it?
189 MB
xet

kompress-small: distilled 6-layer model, 70M params, 7.4/10 quality, 13-29ms ONNX 17 days ago
tokenizer.json

3.58 MB
kompress-small: distilled 6-layer model, 70M params, 7.4/10 quality, 13-29ms ONNX 17 days ago
tokenizer_config.json

351 Bytes
kompress-small: distilled 6-layer model, 70M params, 7.4/10 quality, 13-29ms ONNX 17 days ago