5 1 7

Jacob Maximillian Miesner

miesnerjacob

miesnerjacob

AI & ML interests

None yet

Recent Activity

updated a Space 13 days ago

miesnerjacob/text-processor-mcp

published a Space 13 days ago

miesnerjacob/text-processor-mcp

updated a Space over 1 year ago

miesnerjacob/Multi-task-NLP

View all activity

Organizations

updated a Space 13 days ago

Text Processor Mcp

🐢

Analyze text for stats, sentiment, language, keywords and more

published a Space 13 days ago

Text Processor Mcp

🐢

Analyze text for stats, sentiment, language, keywords and more

updated a Space over 1 year ago

Multi Task NLP

🤖

Analyze text for sentiment, keywords, POS, emotions, and entities

reacted to s3nh's post with 👍 over 2 years ago

Post

GPU Poor POV: Dont be Afraid :D

Sometimes we dont want to do something because of low self esteem,
I ofter hear 'its to hard for me','i am not an expert','i do not know how to do it', etc. These words are never the truth, we should not be afraid and try to build something because there is no additive value without a failure.

Same things comes in LLMs, there is a lot of fancy words happening, but whats is more important is that there are also people who are constantly building so other can build. Diving into finetuning LLMs is incredibly simple if we assume using axolotl library and pretrains stored on huggingface.

All we need is an idea, our GPU Poor desktop or colab notebooks and these steps:

git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl

pip3 install packaging
pip3 install -e '.[flash-attn,deepspeed]'

After installation process we can go to examples, and modify configs to our own needs.
Lets jump into

axolotl\examples\llama-2\qlora.yml

and change

base_model: NousResearch/Llama-2-7b-hf

base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0

choose dataset from huge amounts of dataset that are possible to use from hf.co/datasets and tweak additional params like batch_size, number of epochs, how often do we want to save our model and many more (which I wont focus on rn).
Then,

accelerate launch -m axolotl.cli.train examples/llama-2/qlora.yml

Will allow to start the finetuning process on structure defined strictly by you. After finetuning, model will be saved in path provided in config, and you can check out if it performs better than the base one. Or even you can put it on llm Leaderboard to check if we do not have new SOTA :)
Have fun and have a great day <3