withstaticTai commited on
Commit
41fc0d8
·
verified ·
1 Parent(s): 9d38bec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +67 -0
README.md CHANGED
@@ -1,3 +1,70 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ language:
4
+ - en
5
+ base_model:
6
+ - Qwen/Qwen3-VL-4B-Instruct
7
+ pipeline_tag: image-text-to-text
8
  ---
9
+
10
+
11
+ # ADOPD
12
+
13
+ <p align="center">
14
+ 📄 <a href="https://arxiv.org/abs/2608.09789">Paper</a> &nbsp;|&nbsp;
15
+ 💻 <a href="https://github.com/withTai/ADOPD">Code</a> &nbsp;|&nbsp;
16
+ 🤗 <a href="https://huggingface.co/datasets/withstaticTai/ADOPD-Dataset-6K">Training Data</a> &nbsp;|&nbsp;
17
+ </p>
18
+
19
+ ## Model Summary
20
+
21
+ **ADOPD** is the released model in paper [ADOPD: Reference-Privileged On-Policy Distillation for MLLM-Based Industrial Anomaly Detection](https://arxiv.org/abs/2608.09789).
22
+
23
+ Industrial anomaly detection (IAD) requires identifying fine-grained deviations from normal visual patterns. Multimodal large language models (MLLMs) can improve recognition accuracy by comparing query images with references at inference time, but these benefits rely on additional retrieval and processing.
24
+ ADOPD is a reference-privileged on-policy distillation framework that internalizes reference comparison into query-only MLLMs for industrial anomaly detection. The central insight is that references need not remain deployment-time inputs: when used as privileged training information, they can provide both a candidate distillation direction and a reliability signal for that direction. ADOPD operationalizes this idea by evaluating student-generated rollouts with a matched reference and a mismatched control, thereby separating what the student should learn from how strongly each rollout should shape the update.
25
+
26
+
27
+ ## Quickstart
28
+
29
+ '''python
30
+ from transformers import AutoProcessor, AutoModelForMultimodalLM
31
+
32
+ model_id = "withstaticTai/ADOPD"
33
+ processor = AutoProcessor.from_pretrained(model_id)
34
+ model = AutoModelForMultimodalLM.from_pretrained(model_id, device_map="auto")
35
+ messages = [{
36
+ "role": "user",
37
+ "content": [
38
+ {"type": "image", "url": "https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-VL/assets/demo.jpeg"},
39
+ {"type": "text", "text": "What is the color of the label on the bottle in the background?"},
40
+ ],
41
+ }]
42
+ inputs = processor.apply_chat_template(
43
+ messages,
44
+ add_generation_prompt=True,
45
+ tokenize=True,
46
+ return_dict=True,
47
+ return_tensors="pt",
48
+ ).to(model.device)
49
+
50
+ outputs = model.generate(**inputs, max_new_tokens=40)
51
+ print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
52
+ '''
53
+
54
+
55
+
56
+ ## Citation
57
+
58
+ ```bibtex
59
+ @article{he2026adopd,
60
+ title={ADOPD: Reference-Privileged On-Policy Distillation for MLLM-Based Industrial Anomaly Detection},
61
+ author={He, Jingtai and Meng, Shiyuan and Meng, Wenchao and Yang, Qinmin},
62
+ journal={arXiv preprint arXiv:2608.09789},
63
+ year={2026}
64
+ }
65
+ ```
66
+
67
+ ## License
68
+
69
+ Released under Apache-2.0.
70
+