Papers
arxiv:2608.19080

SPK: Eliciting Structured Prior Knowledge for Interpretable Out-of-Distribution Detection in Real-Time Object Detection

Published on Aug 19
· Submitted by
WeichengHE
on Aug 20
Authors:
,
,

Abstract

Structured Prior Knowledge explicitly extracts latent semantic, geometric, and contextual priors from pretrained object detectors to detect out-of-distribution hallucinations via a compact interpretable representation.

Object detectors often produce over-confident predictions for objects outside their training categories, leading to so-called out-of-distribution (OoD) hallucinations. Existing approaches for detecting or mitigating such hallucinations typically either construct scoring functions directly over learned object detector representations or modify the object detector itself to suppress hallucination emergence. However, the latent priors implicitly encoded in these representations remain largely unexplored and have not been explicitly decoded for OoD detection. To uncover and exploit these latent priors, we propose Structured Prior Knowledge (SPK), a hallucination-oriented framework that explicitly elicits OoD-relevant priors from pretrained object detectors. Specifically, SPK leverages in-distribution data and hallucination-inducing samples as diagnostic supervision to elicit part-level semantic concepts underlying object detector decision-making, rather than using them merely for rejection or object detector adaptation. The elicited semantic priors are further integrated with geometric and contextual priors to form a compact five-dimensional SPK representation for OoD detection. Extensive experiments across diverse object detector architectures and multiple OoD benchmarks demonstrate that SPK achieves state-of-the-art OoD detection. Our findings reveal that pretrained object detectors already encode substantially richer latent knowledge than is typically exploited for OoD detection. More importantly, this knowledge can be explicitly elicited and organized into a compact, structured, and interpretable knowledge space for prediction reliability analysis. This suggests a promising proactive route for improving object detector reliability by explicitly uncovering and leveraging latent priors. Code and data are available at: https://gricad-gitlab.univ-grenoble-alpes.fr/dnn-safety/spk

Community

Paper author Paper submitter

Modern object detectors (e.g., YOLO, RT-DETR, and Faster R-CNN) can produce overconfident predictions for objects outside their training classes, which we refer to as out-of-distribution (OoD) objects, while the training classes are referred to as in-distribution (ID) classes. In practice, such predictions are semantically invalid: an OoD object is assigned a label from the object detector's ID classes with high confidence, even though the object falls outside the predefined label space. These failures can be viewed as instances of computer vision hallucination.

SPK addresses a complementary limitation of existing state-of-the-art OoD detection methods, especially the post-hoc ones which typically make decisions in high-dimensional and opaque representation spaces produced by the target object detector. SPK aims to construct an interpretable and effective representation space for such methods. We find that this can be achieved by eliciting and structuring three complementary priors already encoded in the object detection model and its training data: a part-level semantic prior, indicating whether the predicted region supports the known class rather than proximal or background concepts; a geometric prior, capturing the plausibility of the object's relative scale; and a contextual prior, measuring whether the predicted class appears in a familiar visual environment. This strategy yields the low-dimensional, semantically grounded SPK space for OoD detection and mitigation.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2608.19080
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2608.19080 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2608.19080 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2608.19080 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.