canter / text_encoder /canter_text_config.json
levzalt's picture
Duplicate from data-archetype/canter
66ab0dd
Raw
History Blame Contribute Delete
294 Bytes
{
"architecture": "CanterTextEncoder",
"caption_max_tokens": 512,
"layers": 24,
"padding": "eos",
"source_model": "HuggingFaceTB/SmolLM2-360M",
"source_revision": "f8027fd0eaeea54caa13c31d31b9fdc459c38b49",
"tap_layers": [
8,
16,
24
],
"torch_dtype": "bfloat16"
}