AI Deadlines
⚡
625
Discover and manage important project deadlines and milestones
Pavel AI
pavel-ai
·
AI & ML interests
AI tools development
Recent Activity
liked
a Space
9 days ago
huggingface/ai-deadlines
upvoted
a
collection
27 days ago
Transformers.js demos
liked
a Space
27 days ago
Xenova/remove-background-web
Organizations
liked
a
Space
9 days ago
upvoted
a
collection
27 days ago
liked
a
Space
27 days ago
reacted to
Xenova's
post with 🔥
about 2 months ago
Post
15235
Okay this is insane... WebGPU-accelerated semantic video tracking, powered by DINOv3 and Transformers.js! 🤯
Demo (+ source code): webml-community/DINOv3-video-tracking
This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍
How does it work? 🤔
1️⃣ Generate and cache image features for each frame
2️⃣ Create a list of embeddings for selected patch(es)
3️⃣ Compute cosine similarity between each patch and the selected patch(es)
4️⃣ Highlight those whose score is above some threshold
... et voilà! 🥳
You can also make selections across frames to improve temporal consistency! This is super useful if the object changes its appearance slightly throughout the video.
Excited to see what the community builds with it!
Demo (+ source code): webml-community/DINOv3-video-tracking
This will revolutionize AI-powered video editors... which can now run 100% locally in your browser, no server inference required (costs $0)! 😍
How does it work? 🤔
1️⃣ Generate and cache image features for each frame
2️⃣ Create a list of embeddings for selected patch(es)
3️⃣ Compute cosine similarity between each patch and the selected patch(es)
4️⃣ Highlight those whose score is above some threshold
... et voilà! 🥳
You can also make selections across frames to improve temporal consistency! This is super useful if the object changes its appearance slightly throughout the video.
Excited to see what the community builds with it!
- 3 replies
commented on
Holo1: New family of GUI automation VLMs powering GUI agent Surfer-H
8 months ago
The result is pretty impressive! Here are some examples with queries (the results presented as small red circles):
Query #1
Where to click to upload a file?
Query #2
Where the result of the request would be presented as an image?
Worth noting, the points are located at the logical centers of the UI components (not at the titles or visual centers).
I'd also want to add information about license in the article, it took some time to figure out where it's at HF. For those who are curious it's Apache 2.0 (very permissive).
liked
a
dataset
8 months ago
upvoted
an
article
8 months ago
Article
Holo1: New family of GUI automation VLMs powering GUI agent Surfer-H
•
71
liked
a
model
about 1 year ago
liked
9
Spaces
about 1 year ago
TRELLIS
🏢
4.78k
Scalable and Versatile 3D Generation from images
WebLLM Structured Generation Playground
🏗
48
Generate structured output from text prompts
Github Issue Generator
🧑
55
Generate structured GitHub issues
SmolVLM
📊
144
Generate text from images and queries
MTEB Leaderboard
🥇
6.93k
Embedding Leaderboard
Judge Arena
💻
110
Compare and rank AI models through human voting
OminiControl
🌍
931
Generate an edited image based on a prompt and input image
SmolLM WebGPU
🤏
41
A powerful AI chatbot that runs locally in your browser
Image Preferences - Argilla annotation space
🖼
38
A community project to create an image preferences dataset.
liked
a
model
about 1 year ago
upvoted
a
paper
about 1 year ago
liked
a
Space
about 1 year ago