Verifiable Social Reasoning for LLM Assistants
Paper • 2609.17496 • Published • 45
Oleg Lavrovsky PRO
loleg
AI & ML interests
Supporting Apertus team / Organizing hackathons / Engaged for open data
Recent Activity
upvoted a paper 1 day ago
Verifiable Social Reasoning for LLM Assistants liked a model 2 days ago
artificialy/Apertus-v1.5-8B-FP8-BLOCK liked a dataset 3 days ago
theodi/ndl-core-corpusOrganizations
upvoted a paper 1 day ago
liked a
model 2 days ago
liked a
dataset 3 days ago
liked a
model 3 days ago
Add LEXam-hard evaluation result
👍 1
1
#7 opened 11 days ago
by 
joelniklaus
Future architecture question
1
#6 opened 20 days ago
by 
Akicou
liked a
dataset 3 days ago
reacted to ginigen-ai's post with 🤗 3 days ago
Post
2919
OpenRouter Leaderboard — every model, every provider, one comparable table. Price, precision, uptime, measured latency and language quality on the same axes.
Building it turned up three things.
We graded 330 models on Korean and two axes collapsed.
Honorifics — only 8.5% earn an A
Knowledge of Korean institutions — 9.4%
Every other axis sits above 31%
Fluency hides it. A model can write clean, natural Korean and still attach an honorific to a coffee cup. Fluent and wrong at the same time is worse than obviously broken, because nobody catches it in review.
A 2023 model beats the 2026 flagships. gpt-3.5-turbo-16k scores a perfect 3.00. Korean cannot be inferred from release date, parameter count or English benchmarks — it has to be measured, per model.
Quality, value and speed are three different models. Across five axes, the same model almost never takes two columns.
425 models, latency measured on 329 on a paid API, Korean graded on 330. Three languages, three currencies, daily refresh, open API, no key.
📝 https://huggingface.co/blog/ginigen-ai/openrouter-leaderboard 🔎 ginigen-ai/open-router-leaderboard
Building it turned up three things.
We graded 330 models on Korean and two axes collapsed.
Honorifics — only 8.5% earn an A
Knowledge of Korean institutions — 9.4%
Every other axis sits above 31%
Fluency hides it. A model can write clean, natural Korean and still attach an honorific to a coffee cup. Fluent and wrong at the same time is worse than obviously broken, because nobody catches it in review.
A 2023 model beats the 2026 flagships. gpt-3.5-turbo-16k scores a perfect 3.00. Korean cannot be inferred from release date, parameter count or English benchmarks — it has to be measured, per model.
Quality, value and speed are three different models. Across five axes, the same model almost never takes two columns.
425 models, latency measured on 329 on a paid API, Korean graded on 330. Three languages, three currencies, daily refresh, open API, no key.
📝 https://huggingface.co/blog/ginigen-ai/openrouter-leaderboard 🔎 ginigen-ai/open-router-leaderboard
liked 3
models 5 days ago
upvoted 4
papers 6 days ago
Last Translation Benchmark
Paper • 2609.04173 • Published • 42
Rethinking On-Policy Distillation of Large Language Models II: One Training Example
Paper • 2609.04172 • Published • 98
LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes
Paper • 2609.03796 • Published • 183
SingProbe Technical Report
Paper • 2608.30703 • Published • 11
reacted to stefan-it's post with 🔥 7 days ago
Post
5386
Wohoo 🥳 I have finished my 2025 GPU workstation build and I am very excited to train new awesome open source models on it.
I built my last GPU workstation 5 years ago featuring an AMD Ryzen 5900X, 64GB of G.SKILL Trident Z RGB on an ASRock X570 Taichi cooled by an Alphacool Eisbär 420. GPU was a Zotac RTX 3090 AMP Extreme. Unfortunately, I was never satisfied with the case - some Fractal Define 7, as it is definitely too small, airflow is not optimal as I had to open the front door all the time and it also arrived with a partly damaged side panel.
For my new build, I've used the following components: an outstanding new AMD Ryzen 9950X3D with 64GB of Corsair Dominator Titanium (what a name). As a huge Noctua fan - warm greetings to my Austrian neighbors - I am using the brand new Noctua NH-D15 G2 on an ASRock X870E Taichi in an amazing Lian Li LANCOOL III chassis. One joke that only NVIDIA Blackwell users will understand: you definitely need a tempered glass panel to check if your GPU cables/connectors start melting 😂 And the best is yet to come: I returned my previously bought Zotac RTX 5090 Solid to the eBay seller (because of... missing ROPs, only NVIDIA Blackwell users will again understand) and bought a Zotac 5090 AMP Extreme INFINITY (yes, the long name indicates that this is the flagship model from Zotac) from a more trustworthy source (NBB in Germany).
I am so happy to start training and fine-tuning new open source models - stay tuned!!!
I built my last GPU workstation 5 years ago featuring an AMD Ryzen 5900X, 64GB of G.SKILL Trident Z RGB on an ASRock X570 Taichi cooled by an Alphacool Eisbär 420. GPU was a Zotac RTX 3090 AMP Extreme. Unfortunately, I was never satisfied with the case - some Fractal Define 7, as it is definitely too small, airflow is not optimal as I had to open the front door all the time and it also arrived with a partly damaged side panel.
For my new build, I've used the following components: an outstanding new AMD Ryzen 9950X3D with 64GB of Corsair Dominator Titanium (what a name). As a huge Noctua fan - warm greetings to my Austrian neighbors - I am using the brand new Noctua NH-D15 G2 on an ASRock X870E Taichi in an amazing Lian Li LANCOOL III chassis. One joke that only NVIDIA Blackwell users will understand: you definitely need a tempered glass panel to check if your GPU cables/connectors start melting 😂 And the best is yet to come: I returned my previously bought Zotac RTX 5090 Solid to the eBay seller (because of... missing ROPs, only NVIDIA Blackwell users will again understand) and bought a Zotac 5090 AMP Extreme INFINITY (yes, the long name indicates that this is the flagship model from Zotac) from a more trustworthy source (NBB in Germany).
I am so happy to start training and fine-tuning new open source models - stay tuned!!!
- 3 replies
upvoted a paper 7 days ago
liked 2
datasets 10 days ago
liked a
model 10 days ago
