AI & ML interests

ML for animation, cinema, art

fffiloniΒ 
posted an update 1 day ago
view post
Post
1723
I built HF Radio on Hugging Face Spaces πŸ“»
fffiloni/HF-Radio

A live community radio for AI-generated songs, powered by tracks created with ACE-Step.

You can tune in, discover community-made songs in many languages, vote on what sounds good, and mark your real favorites as Bangers.

The more people listen, vote, and create, the better the station gets.

Under the hood, it connects a few Hugging Face pieces together:

Spaces for the live app, HF buckets for community tracks, OAuth for signed-in listeners, server-side streaming with ffmpeg, hourly playlist refreshes, moderation, jingles, and community feedback loops.

It’s not just a playlist.

It’s a shared taste experiment:
new songs get a shot every hour, and the community helps decide what deserves another spin.

Come listen.
Find weird gems.
Support the Bangers.
Shape the radio.

β€”> fffiloni/HF-Radio
fffiloniΒ 
posted an update 7 days ago
view post
Post
452
Great technical guide by Nico Martin on the Hugging Face blog, showing how to use Transformers.js inside a Chrome extension and run ONNX models from the Hub locally with WebGPU inside a Manifest V3 extension.

The interesting part: this is not just a chatbot in a side panel.

The article walks through the architecture behind a browser agent that can read open tabs, query webpages, search history, and highlight elements directly on the page β€” with models downloaded from the Hugging Face Hub, cached under the extension origin, and executed locally instead of being called through a remote API for every prompt.

A strong blueprint for building local-first web copilots, reading assistants, and AI-powered browsing workflows.

Article: https://huggingface.co/blog/transformersjs-chrome-extension
fffiloniΒ 
posted an update 8 days ago
view post
Post
316
I’ve been reading β€œWhat if AI systems weren’t chatbots?”
What if AI systems weren't chatbots? (2605.07896) πŸ‘€

The paper asks a simple but important question: what if the chatbot interface is not just a neutral wrapper around AI models, but part of the problem?

A chatbot can make a system feel more capable, more certain, and more β€œhuman” than it really is. That matters, because interfaces shape how we trust, use, and delegate to AI systems.

When everything becomes: ask β†’ answer
we can lose sight of the actual workflow:
- parameters
- alternatives
- uncertainty
- intermediate steps
- failure modes
- human control

For creative AI especially β€” image, video, editing, animation β€” I’m not sure β€œchat” should always be the default interface.

Sometimes we need a conversation.
But often we need a canvas, a timeline, sliders, masks, previews, comparisons, and visible pipelines.

This is also why I find many open ML demos interesting: Spaces, Gradio apps, visual tools, small focused interfaces.

They often explore another direction β€” not just better assistants, but better tools. πŸ€—
  • 2 replies
Β·
fffiloniΒ 
posted an update 26 days ago
fffiloniΒ 
posted an update 27 days ago
view post
Post
1815
πŸš€ RB-Modulation is back on Hugging Face Spaces!

This is an older project that recently broke due to dependency changes, but it’s now fixed and running again βœ…

πŸ‘‰ What’s fixed:
- GroundingDINO & LangSAM installation
- compatibility with recent environments
- GPU inference running smoothly again

πŸ‘‰ Try it here:
fffiloni/RB-Modulation

Feel free to give it a try again β€” feedback welcome!
fffiloniΒ 
posted an update about 1 month ago
view post
Post
3177
✨ PASD Magnify is back on Hugging Face Spaces

fffiloni/PASD

PASD isn’t recent, but still delivers strong results β€” worth restoring rather than replacing.

Getting it to run again wasn’t a simple dependency issue.
It relied on parts of diffusers that no longer exist, while moving to Gradio 6 forced a much newer HF stack β€” and I couldn’t modify the original source directly.

Recreating the old environment wasn’t practical.
So I patched the downloaded code at runtime before import and made it compatible with today’s stack.

That ended up being the only approach that held without forking or freezing everything to outdated versions.

If you’ve used it before (or are curious), feel free to give it another try.
fffiloniΒ 
posted an update about 2 months ago
view post
Post
2870
βœ… Back up and running!

My TIGER app is now fully working again, with fixes and full compatibility with Gradio 6 πŸš€

It lets you:
- πŸŽ™οΈ Separate multiple speakers from an audio file
- 🎬 Extract each speaker directly from a video
- 🎧 Split audio into dialog, music, and sound effects (DnR)
- πŸŽ₯ Apply DnR separation directly on videos

All powered by lightweight TIGER models for fast and efficient speech separation.

Try it here πŸ‘‰ fffiloni/TIGER-audio-extraction
fffiloniΒ 
posted an update about 2 months ago
view post
Post
2287
AniDoc is back πŸŽ‰

I’ve fixed the Space and brought it back to life:
- βœ… Working again after being broken for a while
- βœ… Updated to Gradio 6
- βœ… Compatible with ZeroGPU
- βœ… Output videos now preserve original resolution and FPS

I also added advanced controls so you can experiment more (tracking, seed, motion, sketch).

Try it here: fffiloni/AniDoc
fffiloniΒ 
posted an update 2 months ago
view post
Post
4137
I brought DALLΒ·E mini back to life πŸ€–πŸŽ¨

You can try it here:
fffiloni/dalle-mini-reboot

And I also built a batch version using Hugging Face Jobs (up to 50 images per prompt):
fffiloni/dalle-mini-via-jobs

The goal was to stay close to the original JAX/Flax pipeline, while integrating it with modern tooling (Gradio + Jobs).

It ended up being a fun way to revisit this model β€” still weird, still fun πŸ˜„
  • 4 replies
Β·
fffiloniΒ 
posted an update 2 months ago
view post
Post
502
A clearer demo for TADA (now multilingual) πŸ”ŠπŸŒ

I improved the public demo for TADA β€” a generative framework for speech modeling via text–acoustic dual alignment.

TADA models speech as a joint sequence of text tokens and acoustic tokens, using a transformer backbone to keep text and audio synchronized during generation.

The original demo already exposed these mechanisms, but the workflow made the pipeline hard to understand.

This updated demo makes the process clearer:

β€’ load the model
β€’ prepare a reference voice (optionally with transcript or Whisper auto-transcription)
β€’ generate speech conditioned on that reference

It also adds multilingual support.

Presets are included for a few languages, but the model supports more:

English, French, Spanish, German, Arabic, Mandarin Chinese, Italian, Japanese, Polish, Portuguese

Feel free to try different voices, accents, or languages and see how the alignment behaves.

πŸ‘‰ fffiloni/tada-dual-alignment-tts-demo

Paper
TADA: A Generative Framework for Speech Modeling via Text-Acoustic Dual Alignment (2602.23068)
fffiloniΒ 
posted an update over 1 year ago
fffiloniΒ 
posted an update over 1 year ago
view post
Post
3606
Explain like i'm 5 the last take from @thomwolf on X about Dario's essay on DeepSeek:

β€”β€Ί Open-source AI is like a big cookbook that everyone can read and improve. Instead of a few chefs keeping their recipes secret, anyone can cook, test, and invent new things.

If only one company controls AI, everything stops if they have a problemβ€”like when the internet goes down. With open-source, many people can help, making sure it keeps running smoothly.

AI isn’t just a race between two countries; it’s a team effort around the world. By sharing, we move faster and create safer technology for everyone.
β€”
πŸ€—
fffiloniΒ 
posted an update over 1 year ago
fffiloniΒ 
posted an update over 1 year ago
view post
Post
20040
Visionary Walter Murch (editor for Francis Ford Coppola), in 1999:

β€œ So let's suppose a technical apotheosis some time in the middle of the 21st century, when it somehow becomes possible for one person to make an entire feature film, with virtual actors. Would this be a good thing?

If the history of oil painting is any guide, the broadest answer would be yes, with the obvious caution to keep a wary eye on the destabilizing effect of following too intently a hermetically personal vision. One need only look at the unraveling of painting or classical music in the 20th century to see the risks.

Let's go even further, and force the issue to its ultimate conclusion by supposing the diabolical invention of a black box that could directly convert a single person's thoughts into a viewable cinematic reality. You would attach a series of electrodes to various points on your skull and simply think the film into existence.

And since we are time-traveling, let us present this hypothetical invention as a Faustian bargain to the future filmmakers of the 21st century. If this box were offered by some mysterious cloaked figure in exchange for your eternal soul, would you take it?

The kind of filmmakers who would accept, even leap, at the offer are driven by the desire to see their own vision on screen in as pure a form as possible. They accept present levels of collaboration as the evil necessary to achieve this vision. Alfred Hitchcock, I imagine, would be one of them, judging from his description of the creative process: "The film is already made in my head before we start shooting."”
β€”
Read "A Digital Cinema of the Mind? Could Be" by Walter Murch: https://archive.nytimes.com/www.nytimes.com/library/film/050299future-film.html

  • 1 reply
Β·
fffiloniΒ 
posted an update almost 2 years ago
view post
Post
19573
πŸ‡«πŸ‡·
Quel impact de l’IA sur les filiΓ¨res du cinΓ©ma, de l’audiovisuel et du jeu vidΓ©o?
Etude prospective Γ  destination des professionnels
β€” CNC & BearingPoint | 09/04/2024

Si l’Intelligence Artificielle (IA) est utilisΓ©e de longue date dans les secteurs du cinΓ©ma, de l’audiovisuel et du jeu vidΓ©o, les nouvelles applications de l’IA gΓ©nΓ©rative bousculent notre vision de ce dont est capable une machine et possΓ¨dent un potentiel de transformation inΓ©dit. Elles impressionnent par la qualitΓ© de leurs productions et suscitent par consΓ©quent de nombreux dΓ©bats, entre attentes et apprΓ©hensions.

Le CNC a donc dΓ©cider de lancer un nouvel Observatoire de l’IA Afin de mieux comprendre les usages de l’IA et ses impacts rΓ©els sur la filiΓ¨re de l’image. Dans le cadre de cet Observatoire, le CNC a souhaitΓ© dresser un premier Γ©tat des lieux Γ  travers la cartographie des usages actuels ou potentiels de l’IA Γ  chaque Γ©tape du processus de crΓ©ation et de diffusion d’une Ε“uvre, en identifiant les opportunitΓ©s et risques associΓ©s, notamment en termes de mΓ©tiers et d’emploi. Cette Γ©tude CNC / Bearing Point en a prΓ©sentΓ© les principaux enseignements le 6 mars, lors de la journΓ©e CNC Β« CrΓ©er, produire, diffuser Γ  l’heure de l’intelligence artificielle Β».

Le CNC publie la version augmentΓ©e de la cartographie des usages de l’IA dans les filiΓ¨res du cinΓ©ma, de l’audiovisuel et du jeu vidΓ©o.

Lien vers la cartographie complète: https://www.cnc.fr/documents/36995/2097582/Cartographie+des+usages+IA_rapport+complet.pdf/96532829-747e-b85e-c74b-af313072cab7?t=1712309387891
  • 4 replies
Β·
fffiloniΒ 
updated a Space almost 2 years ago
fffiloniΒ 
posted an update about 2 years ago
view post
Post
"The principle of explainability of ai and its application in organizations"
Louis Vuarin, VΓ©ronique Steyer
β€”β€ΊΒ πŸ“” https://doi.org/10.3917/res.240.0179

ABSTRACT: The explainability of Artificial Intelligence (AI) is cited in the literature as a pillar of AI ethics, yet few studies explore its organizational reality. This study proposes to remedy this shortcoming, based on interviews with actors in charge of designing and implementing AI in 17 organizations. Our results highlight: the massive substitution of explainability by the emphasis on performance indicators; the substitution of the requirement of understanding by a requirement of accountability; and the ambiguous place of industry experts within design processes, where they are employed to validate the apparent coherence of β€˜black-box’ algorithms rather than to open and understand them. In organizational practice, explainability thus appears sufficiently undefined to reconcile contradictory injunctions. Comparing prescriptions in the literature and practices in the field, we discuss the risk of crystallizing these organizational issues via the standardization of management tools used as part of (or instead of) AI explainability.

Vuarin, Louis, et VΓ©ronique Steyer. Β« Le principe d’explicabilitΓ© de l’IA et son application dans les organisations Β», RΓ©seaux, vol. 240, no. 4, 2023, pp. 179-210.

#ArtificialIntelligence #AIEthics #Explainability #Accountability
fffiloniΒ 
posted an update over 2 years ago
view post
Post
I'm happy to announce that ✨ Image to Music v2 ✨ is ready for you to try and i hope you'll like it too ! 😌

This new version has been crafted with transparency in mind,
so you can understand the process of translating an image to a musical equivalent.

How does it works under the hood ? πŸ€”

First, we get a very literal caption from microsoft/kosmos-2-patch14-224; this caption is then given to a LLM Agent (currently HuggingFaceH4/zephyr-7b-beta )which task is to translate the image caption to a musical and inspirational prompt for the next step.

Once we got a nice musical text from the LLM, we can send it to the text-to-music model of your choice:
MAGNet, MusicGen, AudioLDM-2, Riffusion or Mustango

Instead of the previous version of Image to Music which used Mubert API, and could output curious and obscure combinations, we only provide open sourced models available on the hub, called via the gradio API.

Also i guess the music result should be more accurate to the atmosphere of the image input, thanks to the LLM Agent step.

Pro tip, you can adjust the inspirational prompt to match your expectations, according to the chosen model and specific behavior of each one πŸ‘Œ

Try it, explore different models and tell me which one is your favorite πŸ€—
β€”β€Ί fffiloni/image-to-music-v2
  • 11 replies
Β·
fffiloniΒ 
posted an update over 2 years ago
view post
Post
InstantID-2V is out ! ✨

It's like InstantID, but you get a video instead. Nothing crazy here, it's simply a shortcut between two demos.

Let's see how it does work with gradio API:

1. We call InstantX/InstantID with a conditional pose from cinematic camera shot (example provided in the demo)
2. Then we send the previous generated image to ali-vilab/i2vgen-xl

Et voilΓ  πŸ€— Try it : fffiloni/InstantID-2V

β€”
Note that generation can be quite long, so take the opportunity to brew you some coffee 😌
If you want to skip the queue, you can of course reproduce this pipeline manually
  • 2 replies
Β·
fffiloniΒ 
posted an update over 2 years ago
view post
Post
Quick build of the day: LCM Supa Fast Image Variation
β€”
We take the opportunity to combine moondream1 vision and LCM SDXL fast abilities to generate a variation from the subject of the image input.
All that thanks to gradio APIs πŸ€—

Try the space: https://huggingface.co/spaces/fffiloni/lcm-img-variations
  • 3 replies
Β·