Hugging Face's logo
Adam Kovacs's picture
šŸ¤ Open to Collab

Adam Kovacs PRO

adaamko
9 40 55
Ihor's profile picture Ash444's profile picture MAB1348's profile picture
Ā·

AI & ML interests

Explainable AI, rule-based models, hallucination detection, fact-checking LLMs

Recent Activity

updated a dataset about 3 hours ago
KRLabsOrg/lettucedetect-code-hallucination
posted an update about 5 hours ago
šŸ„¬ LettuceDetect v2 ā€” span-level hallucination detection for code, tool output, and structured documents. Hallucination detectors are trained on document QA, but agents ground their answers in source code, tool output and markdown. On code-agent answers, existing detectors reach 0.17 span-F1 and even 550B zero-shot judges at most 0.22. We built a unified span-level benchmark ā€” 74,285 newly constructed examples (145K+ with RAGTruth and 14-language PsiloQA folded in), every span typed and character-labeled ā€” and trained two detectors on it: šŸ¤– https://huggingface.co/KRLabsOrg/lettucedect-v2-qwen-2b ā€” generative, typed spans + explanations in one pass, 32K context, **0.689 span-F1** (0.60 on code-agent) āš” https://huggingface.co/KRLabsOrg/lettucedect-v2-mmbert-base ā€” 307M multilingual encoder for high-throughput setups šŸ·ļø https://huggingface.co/KRLabsOrg/lettucedect-v2-taxonomy-head ā€” types the spans of any binary detector It also reaches the best reported English PsiloQA IoU (0.724) and 81.8 RAGTruth example-F1, so specializing on code didn't cost general RAG performance. šŸ“š Dataset: https://huggingface.co/datasets/KRLabsOrg/lettucedetect-code-hallucination šŸ“„ Paper: https://arxiv.org/abs/2607.00895 The models are now integrated natively into vLLM Semantic Router ā€” joint blog post on how it works: https://vllm-sr.ai/blog/lettucedetect-v2-generative-hallucination-detection
updated a collection 1 day ago
LettuceDetect v2
View all activity

Organizations

Blog-explorers's profile picture KR Labs's profile picture