👁️ Eyelock v0.1 (~350M)

GQA · SwiGLU · RoPE · RMSNorm · bfloat16

Параметры ~350M
Слои 24
d_model 1024
GQA 16Q/4KV
Контекст 2048
Словарь 40,000 BPE

Диалог: <user>вопрос<assistant>ответ<eos>

Downloads last month
25
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support