Request for Llama 3.1-8B Transcoders or Training Resources

#1
by MALISZEWSKI2 - opened

Hello, and thank you very much for your outstanding work — I truly appreciate the contributions you’ve made to the community.

I would like to ask whether there are any plans to release transcoders for Llama 3.1-8B in the future. I am currently in urgent need of such transcoders.

If they are not planned for release, could you please share the training code, dataset, and recommended hyperparameters so that I can train them myself?

Thank you again for your time and support.

Sign up or log in to comment