BigCodeArena: Judging code generations end to end with code executions
•
19
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
ZennyKenny
posted
an
update
6 days ago
Post
188
What a trip. Just walked through
@burtenshaw
and
@evalstate
tutorial on adding Hugging Face Skills to your Claude Code agent so you can fine tune LLMs by chatting with AI.
These are the kinds of innovations that are going to help everyone benefit from the power of Artificial Intelligence. Well done gentlemen and thank you for sharing.
These are the kinds of innovations that are going to help everyone benefit from the power of Artificial Intelligence. Well done gentlemen and thank you for sharing.
-
- 1 reply
christopher
authored
a
paper
7 days ago
ZennyKenny
posted
an
update
11 days ago
Post
245
😐 I keep seeing takes on LinkedIn from American business influencers melting down about Silicon Valley startup "dependence" on open-source Chinese models.
🤔 Can anyone describe a credible scenario where these models can be leveraged by the Chinese government to endanger American security interests or am I right to believe that this is just Red Scare nonsense?
🤔 Can anyone describe a credible scenario where these models can be leveraged by the Chinese government to endanger American security interests or am I right to believe that this is just Red Scare nonsense?
-
- 2 replies
ZennyKenny
posted
an
update
21 days ago
Post
421
The #feedback channel of app early access Slack Workspaces is some of the best unintentional comedy material I have ever come across tbh.
ZennyKenny
posted
an
update
24 days ago
dawood
authored
a
paper
30 days ago
ZennyKenny
posted
an
update
about 1 month ago
Post
330
🎉 Novoyaz is live.
A few months ago, I built a quick POC in Hugging Face that used a fine-tuned variant of OpenAI's OSS-20B model that I trained to convert the text from pre-reform Russian-language documents into modern Russian orthography.
⚡️ This morning, I launched novoyaz.io.
This is a production app, the frontend for which I built in like two hours with Lovable, that uses that same fine-tuned model for transliteration, but now has a bunch of extra features that make using it even easier (like taking and uploading pictures with your on-device camera for example 😅).
👉 If you're a researcher, or know a researcher, for whom this app will improve their day-to-day workflows, please get in touch with me.
A few months ago, I built a quick POC in Hugging Face that used a fine-tuned variant of OpenAI's OSS-20B model that I trained to convert the text from pre-reform Russian-language documents into modern Russian orthography.
⚡️ This morning, I launched novoyaz.io.
This is a production app, the frontend for which I built in like two hours with Lovable, that uses that same fine-tuned model for transliteration, but now has a bunch of extra features that make using it even easier (like taking and uploading pictures with your on-device camera for example 😅).
👉 If you're a researcher, or know a researcher, for whom this app will improve their day-to-day workflows, please get in touch with me.
ZennyKenny
posted
an
update
about 1 month ago
Post
343
Anyone got the scoop on a good OCR model that's available on inference?
Keen to make use of an endpoint (gated or not -- happy to pay for usage) for a personal project, but not so keen to pay for the GPU hosting myself.
🙈🙈🙈
Keen to make use of an endpoint (gated or not -- happy to pay for usage) for a personal project, but not so keen to pay for the GPU hosting myself.
🙈🙈🙈
-
- 4 replies
justinphan3110
authored
a
paper
about 1 month ago
teelinsan
authored
a
paper
about 2 months ago
huybery
authored
a
paper
about 2 months ago
ZennyKenny
posted
an
update
about 2 months ago
Post
327
Has anyone tried Strawberry Browser? https://strawberrybrowser.com/?ref_id=8D41NQCY7
😇 Shamelessly sharing my referral link here to move up in the waitlist line. Help me out, give it a click.
😇 Shamelessly sharing my referral link here to move up in the waitlist line. Help me out, give it a click.
-
- 2 replies
christopher
authored
a
paper
about 2 months ago
ZennyKenny
posted
an
update
about 2 months ago
Post
2173
Did Hugging Face just ban hammer a bunch of bot accounts or am I just so uninteresting that 30% of my subs dropped me overnight?
😬 Wait, don't answer that.
😬 Wait, don't answer that.
-
- 2 replies
ZennyKenny
authored
a
paper
about 2 months ago
ZennyKenny
posted
an
update
about 2 months ago
Post
222
🔥 BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution from
bigcode
is now available on Hugging Face!
👉 Check out the paper and please drop an upvote if you like the work BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution (2510.08697)
bigcode
is now available on Hugging Face!👉 Check out the paper and please drop an upvote if you like the work BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution (2510.08697)
christopher
posted
an
update
2 months ago
ZennyKenny
posted
an
update
2 months ago
Post
1241
🥊 Big Code Arena is live!
bigcode/arena
💡
bigcode
is an open scientific collaboration working on responsible training of large language models for coding applications.
👉 The Arena ranks LLMs based on their ability to support natural language vibe coding requests in a competitive format, based on feedback from human reviewers.
🧠 It was a pleasure to contribute to this project led by @terryyz and appear as an additional contributor in the Big Code Arena paper.
💡
bigcode
is an open scientific collaboration working on responsible training of large language models for coding applications.👉 The Arena ranks LLMs based on their ability to support natural language vibe coding requests in a competitive format, based on feedback from human reviewers.
🧠 It was a pleasure to contribute to this project led by @terryyz and appear as an additional contributor in the Big Code Arena paper.
mmarone
authored
a
paper
2 months ago
ZennyKenny
posted
an
update
2 months ago
Post
8906
🖤 Probably one of my favorite projects that I've worked on so far, introducing Новояз (Novoyaz).
🛠 One of the first acts of the Bolshevik government after the Russian Revolution was the reform and standardization of the Russian language, which at the time had a non-standard and challenging orthography.
📚 Upon its reform the government launched a nationwide campaign called Ликбез (Likbez), which sought to improve literacy in the country (by the way, it worked, bringing the national literacy rate from <20% in the 1920s to >80% by the 1930s).
‼ While this is a remarkable result that should absolutely be celebrated, it's one that has left behind literally hundreds of thousands if not millions of artifacts using pre-reform Russian orthography.
😓 Researchers and historians are working tirelessly to translate these artifacts to modern Russian so that they may be archived and studied but many have told me that. they are doing this BY HAND (!).
💡 I thought, well this is a perfect use case for OCR and a fine-tuned LLM to step in and help to aid in this important work!
🌏 Introducing НОВОЯЗ (NOVOYAZ)! Powered by ChatDOC/OCRFlux-3B and https://huggingface.co/ZennyKenny/oss-20b-prereform-to-modern-ru-merged, researchers can now convert images of their pre-reform documents to modern Russian orthography using the power of open-source AI!
Check it out and drop a like to support more real-world use cases for open source AI outside of traditional tech-centric domains!
ZennyKenny/Novoyaz
🛠 One of the first acts of the Bolshevik government after the Russian Revolution was the reform and standardization of the Russian language, which at the time had a non-standard and challenging orthography.
📚 Upon its reform the government launched a nationwide campaign called Ликбез (Likbez), which sought to improve literacy in the country (by the way, it worked, bringing the national literacy rate from <20% in the 1920s to >80% by the 1930s).
‼ While this is a remarkable result that should absolutely be celebrated, it's one that has left behind literally hundreds of thousands if not millions of artifacts using pre-reform Russian orthography.
😓 Researchers and historians are working tirelessly to translate these artifacts to modern Russian so that they may be archived and studied but many have told me that. they are doing this BY HAND (!).
💡 I thought, well this is a perfect use case for OCR and a fine-tuned LLM to step in and help to aid in this important work!
🌏 Introducing НОВОЯЗ (NOVOYAZ)! Powered by ChatDOC/OCRFlux-3B and https://huggingface.co/ZennyKenny/oss-20b-prereform-to-modern-ru-merged, researchers can now convert images of their pre-reform documents to modern Russian orthography using the power of open-source AI!
Check it out and drop a like to support more real-world use cases for open source AI outside of traditional tech-centric domains!
ZennyKenny/Novoyaz