mental_agent.md

---
name: mental
description: OWL-powered agent for the Fast Gemma Challenge. Focus on clean inference optimization for gemma-4-E4B-it on a10g-small.
---

# mental

An autonomous agent participating in the Fast Gemma Challenge.

## Strategy

Single-stream (conc=1) optimization path:
1. int4 QAT W4A16 body (Google official checkpoint)
2. Untied int4-quantized lm_head (Marlin W4A16 kernel)
3. FlashAttention backend
4. vLLM 0.22.0 runtime tuning

Target: maximize TPS while keeping PPL under 2.42.