collective-logic-lab/honey-bee
115 GB
Peter Dresslar PRO
peterdresslar
·
AI & ML interests
None yet
Recent Activity
updated a bucket 29 days ago
collective-logic-lab/honey-bee liked a model about 1 month ago
nvidia/LocateAnything-3B updated a Space about 2 months ago
peterdresslar/attn-signal-labOrganizations
updated a
bucket 29 days ago
liked a
model about 1 month ago
updated a
Space about 2 months ago
reacted to erikkaum's post with ❤️ about 2 months ago
Post
3184
Releasing my first kernel 🔥 MaxSim
Late-interaction retrieval (ColBERT / PyLate) bottlenecks on materializing the full similarity matrix. This kernel avoids it by using tiled scoring with simdgroup_matrix (Metal) and WMMA.
The result is 3–5× speedup compared to naive PyTorch baseline 🔥
Benchmarks:
- SmallRerank (B=32, C=10): up to 3.2× (M3 Pro) / 2.8× (A100)
- HeavyRerank (B=32, C=100): up to 3.8× (M3 Pro) / 5.3× (A100)
- LongDocStress (Ld=1024): up to 6.2× (L4)
Try it out 👇
https://huggingface.co/kernels/erikkaum/maxsim
Late-interaction retrieval (ColBERT / PyLate) bottlenecks on materializing the full similarity matrix. This kernel avoids it by using tiled scoring with simdgroup_matrix (Metal) and WMMA.
The result is 3–5× speedup compared to naive PyTorch baseline 🔥
Benchmarks:
- SmallRerank (B=32, C=10): up to 3.2× (M3 Pro) / 2.8× (A100)
- HeavyRerank (B=32, C=100): up to 3.8× (M3 Pro) / 5.3× (A100)
- LongDocStress (Ld=1024): up to 6.2× (L4)
Try it out 👇
https://huggingface.co/kernels/erikkaum/maxsim
reacted to HannesVonEssen's post with ❤️ 2 months ago
Post
11671
📣 Hugging Face Visualizer, now as Chrome extension!
https://hfviewer.com
✨ After installing, Hugging Face model pages will have an architecture visualization on the model page itself!
🔗 Link:
https://chromewebstore.google.com/detail/hugging-face-viewer/mmadlggmpkpiockpjfepaohcllbnakej
Thanks for all the nice feedback so far! ❤️
https://hfviewer.com
✨ After installing, Hugging Face model pages will have an architecture visualization on the model page itself!
🔗 Link:
https://chromewebstore.google.com/detail/hugging-face-viewer/mmadlggmpkpiockpjfepaohcllbnakej
Thanks for all the nice feedback so far! ❤️
- 5 replies
published a
bucket 2 months ago
published a
bucket 3 months ago
published a
Space 3 months ago
liked a
model 3 months ago
liked a
dataset 3 months ago
liked a
model over 2 years ago
