AFAICT the hidden size of the model is 640 so the pooling dimension would also be 640 https://huggingface.co/codefuse-ai/F2LLM-v2-160M/blob/main/config.json#L12

Geralt-Targaryen changed pull request status to merged

Hi @Geralt-Targaryen , thanks for the merge! I'd really appreciate it if you could also merge the other PRs I made for all other F2LLM v2 models that have the same problem. We'd love to build on your models after this fix.

CodeFuse AI org

@BramVanroy Sorry, I was on a business trip yesterday. The PRs are now all merged.

Thanks a lot for your work, and the models!! @Geralt-Targaryen

Sign up or log in to comment