nanoprot v0.5 — protein LM scaling suite 36 protein LMs: 3 archs x 4 scales x 3 seeds on UniRef50, compute-optimal. Transformers out-scale Mamba SSMs. Code: github.com/ygzdvr/nanoprot yagizdevre/nanoprot-gpt2-XS Text Generation • Updated Jun 11 • 13 yagizdevre/nanoprot-gpt2-S Text Generation • Updated Jun 11 • 3 yagizdevre/nanoprot-gpt2-M Text Generation • Updated Jun 11 • 1 yagizdevre/nanoprot-gpt2-L Text Generation • Updated Jun 11 • 13
nanoprot v0.5 — protein LM scaling suite 36 protein LMs: 3 archs x 4 scales x 3 seeds on UniRef50, compute-optimal. Transformers out-scale Mamba SSMs. Code: github.com/ygzdvr/nanoprot yagizdevre/nanoprot-gpt2-XS Text Generation • Updated Jun 11 • 13 yagizdevre/nanoprot-gpt2-S Text Generation • Updated Jun 11 • 3 yagizdevre/nanoprot-gpt2-M Text Generation • Updated Jun 11 • 1 yagizdevre/nanoprot-gpt2-L Text Generation • Updated Jun 11 • 13
