Architecture:
Vocab: 64,000 N_LAYER: 26 N_HEAD: 32 D_EMBED: 3072 D_INTER: 8192 CONTEXT_LEN: 2048
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Architecture:
Vocab: 64,000 N_LAYER: 26 N_HEAD: 32 D_EMBED: 3072 D_INTER: 8192 CONTEXT_LEN: 2048