Hoang Phu

hoangphu7122002ai

hoangphu7122002

AI & ML interests

None yet

Recent Activity

updated a dataset about 2 months ago

hoangphu7122002ai/xosc_script

published a dataset 3 months ago

hoangphu7122002ai/xosc_script

updated a dataset over 1 year ago

hoangphu7122002ai/bert_embedding_alpaca

View all activity

Organizations

updated a dataset about 2 months ago

hoangphu7122002ai/xosc_script

Viewer • Updated Dec 1, 2025 • 84 • 1

published a dataset 3 months ago

hoangphu7122002ai/xosc_script

Viewer • Updated Dec 1, 2025 • 84 • 1

updated a dataset over 1 year ago

hoangphu7122002ai/bert_embedding_alpaca

Viewer • Updated Oct 23, 2024 • 52k • 3

reacted to merve's post with 🔥 over 1 year ago

Post

6139

Fine-tune Florence-2 on any task 🔥

Today we release a notebook and a walkthrough blog on fine-tuning Florence-2 on DocVQA dataset @andito @SkalskiP

Blog: https://huggingface.co/blog 📕
Notebook: https://colab.research.google.com/drive/1hKDrJ5AH_o7I95PtZ9__VlCTNAo1Gjpf?usp=sharing 📖
Florence-2 is a great vision-language model thanks to it's massive dataset and small size!

This model requires conditioning through task prefixes and it's not as generalist, requiring fine-tuning on a new task, such as DocVQA 📝

We have fine-tuned the model on A100 (and one can also use a smaller GPU with smaller batch size) and saw that model picks up new tasks 🥹

See below how it looks like before and after FT 🤩
Play with the demo here andito/Florence-2-DocVQA 🏄‍♀️