AI & ML interests

None defined yet.

fffiloniย 
posted an update 2 days ago
view post
Post
170
Iโ€™ve been building IDOL Commons ๐Ÿ—ฟ

A place to create, share and explore 3D Gaussian splats, powered by IDOL from Sperid Labs.

Start with an image, or generate one from a prompt. Inspect the result in 3D, choose its thumbnail, add a description and credits, then decide whether to publish it to the community collection.

Browse what others have shared and download the original PLY files, with attribution and per-object licensing.

Iโ€™d love to see what you contribute โ€” and hear what would make this useful in your workflow.

Try it:
fffiloni/idol-commons

Community dataset:
fffiloni/idol-community-assets
fffiloniย 
posted an update 11 days ago
view post
Post
2,793
Carbon-X brings DNA and language together: it reads sequences and answers questions about them ๐Ÿงฌ

To accompany the release article, I put together Carbon-X Playground: five experiments exploring sequence completion, single-letter changes, regulatory roles, DNA origins and motif finding.

Try curated samples or your own sequences, ask questions and compare answers with references when available.

Built with Gradio, running on ZeroGPU.

๐Ÿ“– HuggingFaceBio/Carbon-X-Release
๐Ÿงฌ fffiloni/Carbon-X-Playground
Nymboย 
posted an update 18 days ago
view post
Post
3,781
Introducing Live Subtitles, a Windows tray app that captions anything your PC is playing and isn't butt ugly. live and fully local. It runs NVIDIA's Parakeet-unified 0.6B on your GPU, puts words on screen about 0.36 s after they're spoken, and uses less than one CPU core while it does it.

I built a benchmark for it out of real TV, podcasts, earnings calls and a short film. Parakeet-unified scores 12.1% WER there, close to Nemotron streaming's 11.4%, but with much better punctuation and lower worst-case delay. Once a caption is on screen it never gets rewritten or jumps lines, and the overlay disappears when nobody's talking.

No NVIDIA GPU? It falls back to Nemotron on the CPU, which also covers 30 other languages. It can also write SRT/ASS/VTT files for videos on disk.

Windows only. The GPU engine needs an NVIDIA card with ~3.2 GB of free VRAM. MIT.

Edit: the first version of this post said 13.8% vs 17.0%. The replies caught a scoring bug (numbers weren't normalized), so the benchmark now uses Whisper's English normalizer and the numbers above are re-scored.

Get it here:
https://github.com/Nymbo/Live-Subtitles

Models:
nvidia/parakeet-unified-en-0.6b
nvidia/nemotron-speech-streaming-en-0.6b
  • 7 replies
ยท
fffiloniย 
posted an update 23 days ago
view post
Post
458
๐Ÿ“– A gamebook you can play in your own words, powered by local Decision Models.

Traditional gamebooks offer explicit branches: โ€œTo enter the forest, turn to page 42.โ€ In Choose your own adventure, you can describe an action, question a character, or ask what you already know before deciding. Clickable choices remain available.

The storyโ€™s branches and consequences are authored. Natural language adds a flexible way to interact with them, with conversations between actions.

I built this project to explore a concrete role for Decision Models in an interactive application:

โ€ข Kev-4B makes structured decisions: matching intentions to available actions and distinguishing acting from discussing.
โ€ข Ink manages story progression, discoveries, inventory and endings.
โ€ข Qwen3-8B selects dialogue responses from authored content available in the current state.

Both models run locally inside the Space through llama.cpp, using quantized GGUFs. You can inspect the model calls, scores and routing decisions directly in the interface.

The current release includes three adventures in French and English, with a pack format for adding new stories without changing the engine.

Itโ€™s still experimental, and interpretations can go wrong. Iโ€™d love feedback on how it feels to playโ€”and on this use of Decision Models to connect natural language with explicit game logic.

Try and play here: fffiloni/choose-your-own-adventure-dm ๐Ÿค—
  • 1 reply
ยท
fffiloniย 
posted an update about 2 months ago
view post
Post
686
Been pushing Viggle Animate a bit further ๐Ÿ‘€

Viggle Mine is my take on longer, harder character replacement shots โ€” crowds, distance changes, characters turning their back and reappearing.

Still experimental, but itโ€™s getting surprisingly robust.

Try it : fffiloni/Viggle-Mine ๐Ÿค—
fffiloniย 
posted an update 2 months ago
view post
Post
2,220
If an agent can build the obvious demo, the obvious demo probably isnโ€™t worth building anymore.
For years, turning a research repo into something people could actually try was valuable by itself.
That part is becoming automated โ€” and thatโ€™s a good thing.

Which means the interesting work moves elsewhere: finding the weird use case, the right interaction, the unexpected model combination โ€” or simply knowing which paper is worth anyoneโ€™s attention.

The demo used to be the product. Now it needs a point of view.
  • 1 reply
ยท
Nymboย 
posted an update 3 months ago
view post
Post
2,628
Anthropic gave me six months of Claude Max 20x through the Claude for Open Source program, granted based on my Hugging Face work. Thank you
Anthropic
for supporting open source.

So far I've been pointing it at Markdown Minimap, an Obsidian plugin that adds a scrollable IDE-style minimap to your notes. This week I've been clearing a backlog of user-reported issues on it, with Claude often handling them end to end.

https://github.com/Nymbo/Markdown-Minimap โ€” issues and PRs welcome.
Nymboย 
posted an update 3 months ago
view post
Post
6,210
Introducing Inflect-v2, two exceptionally small, open-weight English TTS models at just 3.9M and 9.3M parameters. Both generate speech multiple times faster than real-time on CPU. Despite their size, Inflect-v2 delivers quality that is competitive with much larger lightweight TTS systems, including KittenTTS, Piper, and Supertonic-3.

CPU, CUDA, PyTorch, and ONNX are supported. Apache 2.0.

See it for yourselves:
owensong/Inflect-Micro-v2
owensong/Inflect-Nano-v2

Try the Demos:
Nymbo/Inflect-TTS (unlimited CPU usage)
owensong/Inflect-v2 (ultra-fast ZeroGPU usage)
  • 6 replies
ยท
fffiloniย 
posted an update 4 months ago
fffiloniย 
posted an update 4 months ago
view post
Post
1,925
I made a Hugging Face Space for SCAIL-2 ๐Ÿค—

Reference character + driving motion โ†’ animated result.

A simple demo to explore the paperโ€™s core workflow with curated examples.

๐Ÿ‘‰ fffiloni/SCAIL-2
  • 1 reply
ยท
fffiloniย 
posted an update 4 months ago
view post
Post
874
โฑ๏ธ Built a small Space for Visual Chronometer / Pulse of Motion.

Upload a video and estimate its Physical FPS: the frame rate implied by visual motion, independent of metadata.
Useful to inspect โ€œchronometric hallucinationโ€ in generated videos: clips that look smooth, but move with the wrong physical time scale.

Try it here: fffiloni/Pulse-of-Motion
  • 1 reply
ยท
fffiloniย 
posted an update 4 months ago
view post
Post
1,710
A few weeks ago, @victor opened the door: coding agents can now ship Hugging Face Spaces autonomously.

I pulled on that thread.

As someone who builds and ships Gradio demos regularly, I didnโ€™t just want to reproduce the loop. I wanted to see what happens when that loop is plugged into the whole Hugging Face stack.

The interesting part is not only that an agent can ship a Space.

Itโ€™s what happens when Space generation becomes a first-class Hugging Face workflow.

That became Agentic Space Factory.

More soon. ๐Ÿค—
  • 1 reply
ยท
victorย 
posted an update 5 months ago
view post
Post
6,871
Sharing how I built the LongCat-Video-Avatar 1.5 Space (+500k views on X) in one agent session. Gave a coding agent its own AI lab on ZeroGPU, framed the goal, walked away. It designed, deployed, tested against the live API, fixed, shipped.

Full recipe with the copy-paste prompt: https://huggingface.co/blog/victor/building-zerogpu-spaces-autonomously
  • 1 reply
ยท
fffiloniย 
posted an update 6 months ago
view post
Post
3,884
I built HF Radio on Hugging Face Spaces ๐Ÿ“ป
fffiloni/HF-Radio

A live community radio for AI-generated songs, powered by tracks created with ACE-Step.

You can tune in, discover community-made songs in many languages, vote on what sounds good, and mark your real favorites as Bangers.

The more people listen, vote, and create, the better the station gets.

Under the hood, it connects a few Hugging Face pieces together:

Spaces for the live app, HF buckets for community tracks, OAuth for signed-in listeners, server-side streaming with ffmpeg, hourly playlist refreshes, moderation, jingles, and community feedback loops.

Itโ€™s not just a playlist.

Itโ€™s a shared taste experiment:
new songs get a shot every hour, and the community helps decide what deserves another spin.

Come listen.
Find weird gems.
Support the Bangers.
Shape the radio.

โ€”> fffiloni/HF-Radio
fffiloniย 
posted an update 6 months ago
view post
Post
535
Great technical guide by Nico Martin on the Hugging Face blog, showing how to use Transformers.js inside a Chrome extension and run ONNX models from the Hub locally with WebGPU inside a Manifest V3 extension.

The interesting part: this is not just a chatbot in a side panel.

The article walks through the architecture behind a browser agent that can read open tabs, query webpages, search history, and highlight elements directly on the page โ€” with models downloaded from the Hugging Face Hub, cached under the extension origin, and executed locally instead of being called through a remote API for every prompt.

A strong blueprint for building local-first web copilots, reading assistants, and AI-powered browsing workflows.

Article: https://huggingface.co/blog/transformersjs-chrome-extension
fffiloniย 
posted an update 6 months ago
view post
Post
371
Iโ€™ve been reading โ€œWhat if AI systems werenโ€™t chatbots?โ€
What if AI systems weren't chatbots? (2605.07896) ๐Ÿ‘€

The paper asks a simple but important question: what if the chatbot interface is not just a neutral wrapper around AI models, but part of the problem?

A chatbot can make a system feel more capable, more certain, and more โ€œhumanโ€ than it really is. That matters, because interfaces shape how we trust, use, and delegate to AI systems.

When everything becomes: ask โ†’ answer
we can lose sight of the actual workflow:
- parameters
- alternatives
- uncertainty
- intermediate steps
- failure modes
- human control

For creative AI especially โ€” image, video, editing, animation โ€” Iโ€™m not sure โ€œchatโ€ should always be the default interface.

Sometimes we need a conversation.
But often we need a canvas, a timeline, sliders, masks, previews, comparisons, and visible pipelines.

This is also why I find many open ML demos interesting: Spaces, Gradio apps, visual tools, small focused interfaces.

They often explore another direction โ€” not just better assistants, but better tools. ๐Ÿค—
  • 2 replies
ยท
fffiloniย 
posted an update 7 months ago
fffiloniย 
posted an update 7 months ago
view post
Post
1,843
๐Ÿš€ RB-Modulation is back on Hugging Face Spaces!

This is an older project that recently broke due to dependency changes, but itโ€™s now fixed and running again โœ…

๐Ÿ‘‰ Whatโ€™s fixed:
- GroundingDINO & LangSAM installation
- compatibility with recent environments
- GPU inference running smoothly again

๐Ÿ‘‰ Try it here:
fffiloni/RB-Modulation

Feel free to give it a try again โ€” feedback welcome!
victorย 
posted an update 7 months ago
view post
Post
6,382
Want to share my enthusiasm for zai-org/GLM-5.1 here too ๐Ÿ”ฅ

I think we have it: our open source Claude Code = GLM-5.1 + Pi (https://pi.dev/) - Built a Three.js racing game to eval and it's extremely impressive. Thoughts:

- One-shot car physics with real drift mechanics (this is hard)

- My fav part: Awesome at self iterating (with no vision!) created 20+ Bun.WebView debugging tools to drive the car programmatically and read game state. Proved a winding bug with vector math without ever seeing the screen

- 531-line racing AI in a single write: 4 personalities, curvature map, racing lines, tactical drifting. Built telemetry tools to compare player vs AI speed curves and data-tuned parameters

- All assets from scratch: 3D models, procedural textures, sky shader, engine sounds, spatial AI audio!

- Can do hard math: proved road normals pointed DOWN via vector cross products, computed track curvature normalized by arc length to tune AI cornering speed

You are going to hear about this model a lot in the next months - open source let's go - and thanks z-ai๐Ÿš€๐Ÿš€
  • 5 replies
ยท
fffiloniย 
posted an update 7 months ago
view post
Post
3,211
โœจ PASD Magnify is back on Hugging Face Spaces

fffiloni/PASD

PASD isnโ€™t recent, but still delivers strong results โ€” worth restoring rather than replacing.

Getting it to run again wasnโ€™t a simple dependency issue.
It relied on parts of diffusers that no longer exist, while moving to Gradio 6 forced a much newer HF stack โ€” and I couldnโ€™t modify the original source directly.

Recreating the old environment wasnโ€™t practical.
So I patched the downloaded code at runtime before import and made it compatible with todayโ€™s stack.

That ended up being the only approach that held without forking or freezing everything to outdated versions.

If youโ€™ve used it before (or are curious), feel free to give it another try.