Spaces:
Running
Let's Talk about AI
Hello, here is an open space for everyone to talk, share, ask and show anything about AI.
Has anyone pre-trained LLM model from scratch ? If yes then share your experience, things to consider while training, notes, tips etc.
Hi i am also intrested into LLM Model , i am about to start this reserach from next week please give any inputs
Hi i am also intrested into LLM Model , i am about to start this reserach from next week please give any inputs
Hey @Shashank2k3 , if you want your own LLM model, first you need huge data. You can start with fine tuning already available good LLM models like Gemma, Phi, LLAMA, mistral etc with your dataset. Start with small models of sizes like 4 to 7B parameters. For pre-training LLM from scratch you need enormous data, good resources like heavy duty GPUs and CPUs and also have knowledge of training techniques, NLP, etc . You can always brainstorm with ChatGPT to get more knowledge.
Hey @kalashshah19 , thanks for the input! I already have a solid foundation in these areas from my Bachelor's degree in AIML, and now Iโm looking to dive deeper into the world of LLMs.
Hey @kalashshah19 , thanks for the input! I already have a solid foundation in these areas from my Bachelor's degree in AIML, and now Iโm looking to dive deeper into the world of LLMs.
Great !
Yupp so what you guys do, i mean profession!!!
Yupp so what you guys do, i mean profession!!!
I am an Associate Data Scientist at Casepoint.
What about you ?
Very soon my HF account will complete the firsr year. So, will it retain the 100 GB private storage, zero-GPU access, and inference capabilities after completing my first year as a user?
Don't know, haven't completed 1 year yet.
hey everyone,
read my blog on NPU and openVINO toolkit
Happy New year
hey everyone,
read my blog on NPU and openVINO toolkit
Sure !
Happy New year
Happy New Year !
@JDhruv14
Amazing work brother
https://tatva.info/ is just amazing. Would love to work on something together ๐ค
@JDhruv14 Amazing work brother
https://tatva.info/ is just amazing. Would love to work on something together ๐ค
Woahhh thanks. I had forgotten about sharing about my latest project tatva. How did you found about it? Also, if possible please vote for me on Peerlist. I want to make tatva better that's the aim.
@JDhruv14 Amazing work brother
https://tatva.info/ is just amazing. Would love to work on something together ๐คWoahhh thanks. I had forgotten about sharing about my latest project tatva. How did you found about it? Also, if possible please vote for me on Peerlist. I want to make tatva better that's the aim.
i forgot from where i found it but yesterday i noticed the developer name and saw the posts on X, thought i should promote it. i upvoted tatva on producthunt & peerlist