@davidmezzetti on Hugging Face: "Tired of paying a bunch of money for large LLMs? Then read this notebook…"

Join the community of Machine Learners and AI enthusiasts.

davidmezzetti

posted an update 10 days ago

Post

1180

Tired of paying a bunch of money for large LLMs? Then read this notebook and/or watch this video on how to distill knowledge into tiny LLMs.

Notebook: https://github.com/neuml/txtai/blob/master/examples/80_Distilling_Knowledge_into_Tiny_LLMs.ipynb
Video: https://www.youtube.com/watch?v=Ol560ktgkf0

8 days ago

Good work!

8 days ago

Thank you!

8 days ago

The train dataset comes from the parent model. Mentioning that would be helpful... @davidmezzetti

8 days ago

6 days ago

is there a way to use txtai training pipeline also only using CPU?

6 days ago

There is nothing inherent about it that requires a GPU. Did you run into an issue?

In this post