Gemma 4 vs Qwen3.5 27b
#104
by EvilinaMaller - opened
If Gemma 4 is worse than "qwen3.5 27b dense", it will be a failure... I hope we get a Gemini 3 Flash level because anything lower will make me stick with qwen3.5 27b danse.
Just compare the HLE (Humanity's Last Exam) GPQA Diamond benchmarks
Gemma 3 27b, Qwen 3.5 27b, Gemini 3 Flash.
The level for Gemma 4 was set by Qwen. it is real. Don't fall flat on your face. Google, don't slow down technological progress, otherwise you'll suffer the same fate as Warner Brothers and Kodak.