vtx-embed-1M / config.json
Abhaykoul's picture
Initial release of vtx-embed-1M (Pure Data-Free Distilled 1.05M Model)
df56cdf verified
Raw
History Blame Contribute Delete
252 Bytes
{
"vocab_size": 16384,
"embedding_dim": 64,
"block_size": 16,
"num_blocks": 4,
"model_type": "vortex-embed",
"architectures": [
"VortexEmbedV4_5"
],
"quantization": "lf4",
"bits": 4,
"sif_a": 0.01,
"sif_pc": 1.0,
"pc_k": 1
}