Sentence Similarity
ONNX
Safetensors
English
ogma
embeddings
dense-retrieval
matryoshka
rag
agents
mteb
semantic-search
text-embeddings
text-embedding
vector-search
document-retrieval
similarity-search
classification
clustering
edge-ai
on-device
local-inference
efficient-ai
rag-retrieval
custom_code
Eval Results (legacy)
File size: 672 Bytes
6efaeab d43f72a 6efaeab d43f72a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 | {
"architectures": [
"OgmaModel"
],
"model_type": "ogma",
"auto_map": {
"AutoConfig": "configuration_ogma.OgmaConfig",
"AutoModel": "ogma_model.OgmaModel"
},
"variant": "transformer",
"d_embed": 64,
"d_model": 128,
"d_output": 128,
"n_layers": 2,
"n_heads": 2,
"vocab_size": 30000,
"max_seq_len": 1024,
"matryoshka_dims": [
32,
64,
128
],
"pooling": "mean",
"ffn_mult": 2.6666666666666665,
"conv_kernel_size": 7,
"spatial_rank": 32,
"n_random_features": 128,
"dropout": 0.0,
"pad_id": 0,
"unk_id": 1,
"bos_id": 2,
"eos_id": 3,
"qry_id": 4,
"doc_id": 5,
"sym_id": 6,
"n_special_tokens": 7
}
|