Pranav Upadhyaya
pranavupadhyaya52
AI & ML interests
None yet
Organizations
None yet
replied to their post 8 months ago
posted an
update 9 months ago
Post
199
Here are my complete project notebooks hosted to my project titled "Multimodal Custom Finetuned LLM for Virtual Healthcare Consultations" at OSF - https://osf.io/ne2zh/
reacted to celinah's post with 🚀 10 months ago
Post
2755
✨ Today we’re releasing Tiny Agents in Python — an MCP-powered Agent in ~70 lines of code 🐍
Inspired by Tiny Agents in JS from @julien-c , we ported the idea to Python and integrated it directly into
TL;DR: With MCP (Model Context Protocol), you can expose tools like web search or image generation and connect them directly to LLMs. It’s simple — and surprisingly powerful.
We wrote a blog post where we show how to run Tiny Agents, and dive deeper into how they work and how to build your own.
👉 https://huggingface.co/blog/python-tiny-agents
Inspired by Tiny Agents in JS from @julien-c , we ported the idea to Python and integrated it directly into
huggingface_hub — with a built-in MCP Client and a Tiny Agents CLI.TL;DR: With MCP (Model Context Protocol), you can expose tools like web search or image generation and connect them directly to LLMs. It’s simple — and surprisingly powerful.
pip install "huggingface_hub[mcp]>=0.32.0"We wrote a blog post where we show how to run Tiny Agents, and dive deeper into how they work and how to build your own.
👉 https://huggingface.co/blog/python-tiny-agents
- 1 reply
replied to their post 10 months ago
Hi. I'll be uploading my notebooks to GitHub soon. I'll update here.
I'm currently working on my code, it will be up shortly.
replied to their post 10 months ago
Thank you! I will be making my notebooks related to the model fine-tuning and the application public soon.
I have made this as a research project for an upcoming conference. If you would like to collaborate on the paper, please send me a DM on Instagram. My username on there is pranavupd44
posted an
update 10 months ago
Post
2248
Hello everyone. I've built a medical AI assistant application.
pranavupadhyaya52/MediWiki_Medical_Assistant
It is a multimodal chatbot and can accept text, radiology images, prescription and lab reports (currently it only accepts one image per chat.) and audio files (wav and MP3 extension files).
It is built on top of a finetuned Llama 3.2 11B vision instruct. It also uses a 41000 medically related question answer pair stored in the form of chromadb embedding for Retrieval Augmented Generation (RAG).
Please let me know your thoughts on my project and how I can improve it further. Thank you.
pranavupadhyaya52/MediWiki_Medical_Assistant
It is a multimodal chatbot and can accept text, radiology images, prescription and lab reports (currently it only accepts one image per chat.) and audio files (wav and MP3 extension files).
It is built on top of a finetuned Llama 3.2 11B vision instruct. It also uses a 41000 medically related question answer pair stored in the form of chromadb embedding for Retrieval Augmented Generation (RAG).
Please let me know your thoughts on my project and how I can improve it further. Thank you.
-
- 5 replies