Demo for this model on Spaces

#1
by multimodalart - opened

Hi @autotrust πŸ€—

I'm Apolinario, from the open-source team at Hugging Face. Congrats and thanks for open-sourcing autotrust/JEV-9B on the Hub! We were excited about this work and built with an agent an interactive demo app of it on Hugging Face Spaces, running on a free ZeroGPU infrastructure.

Here's a link to the demo: https://huggingface.co/spaces/hugging-apps/jev-9b-decision-demo

We would love to transfer this demo to you or your organization. Would you like this demo to live under your own account or organization? If so just let me know here which username to transfer to, and we'll transfer the Space over to you, we hope it can give your work more visibility, discoverability and allows folks to try it out.

(If you have any questions or just want to chat more about this, you can find me on Twitter, LinkedIn or apolinario @ huggingface.co)

Cheers,

Poli

AutoTrust AI Lab org

https://huggingface.co/autotrust/JEV-27B is more powerful; enjoy it!

AutoTrust AI Lab org

Hi Poli @multimodalart πŸ€—

Wow, thank you, Poli, and the whole Hugging Face open-source team! Seeing JEV running as a live, interactive demo on ZeroGPU is a real thrill for us.

Yes please, we'd love to have the Space transferred to our organization: autotrust (https://huggingface.co/autotrust).

And great timing: we've just released the upgrade, JEV-27B πŸ‘‰ https://huggingface.co/autotrust/JEV-27B

Same recipe and API as the 9B, now on a Qwen3.8-27B backbone:
β€’ Mean KL to the teacher 0.019, noul AUROC 0.996, calibration ECE 0.0009
β€’ Out-of-distribution KL halved vs. the 9B (0.234 β†’ 0.104)
β€’ 96–98% of the teacher's accuracy on an independent, human-labelled benchmark it never saw in training
β€’ Generation head untouched: HumanEval 78.0%, byte-identical to the base model
β€’ Apache-2.0, runs on vLLM, ~140 ms per request on a single B200

If ZeroGPU can host the 27B as well, we'd love to add it to the demo so people can try both sizes side by side.

Thanks again for the support, it means a lot to a small lab like ours! πŸš€

Cheers,
Josh Liu
AutoTrust AI

AutoTrust AI Lab org

Hi Poli @multimodalart πŸ€—

Quick follow-up with some exciting news! Our team just ran JEV-27B through all the relevant benchmarks, and the results are in (chart and a short demo reel attached πŸ“Š):

β€’ Across six benchmarks (JevBench, Kev, OpenJev text, Nimble, VitaminC, MASSIVE-en), our open-weights JEV-27B averages 84.07%. That's ahead of the closed TypeSafe Jev 1.13 teacher itself (83.85%), and it beats the teacher on 4 of the 6.
β€’ It also leads every other notable open-source JEV-style model we compared: NeoHorse-Jev, Open-Jev, Kev and Laya English. Its average is 6+ points clear of the closest one.

We're really proud that an open, Apache-2.0 student now edges past its own closed teacher on average!

We've also put up a live demo so anyone can try it πŸ‘‰ https://huggingface.co/spaces/autotrust/JEV-27B-Demo
Model: https://huggingface.co/autotrust/JEV-27B

Please check it out, we'd love to hear what you think! And whenever it's convenient, the JEV-9B Space can go to our autotrust org as mentioned.

Thanks again for all the support πŸš€

Cheers,
Josh Liu
AutoTrust AI

Hey @autotrustailab !

Thank you for open sourcing JEV-9B!

Transferred to: https://huggingface.co/spaces/autotrust/jev-9b-decision-demo with a ZeroGPU grant
Free to post about, put the demo on the project page, reference it on repos, etc. as you wish

Also feel more than free to take ownership and make modifications as you see fit. For future releases from you, would be great if they already came with a demos! You can use this one as a blueprint to build by yourself or with the help of an agent, you can load the huggingface-spaces skill on Claude Code, Codex, Hermes, Pi, etc.

Cheers,
Poli

Sign up or log in to comment