Safetensors
Jiangzhangqi commited on
Commit
b6b4c3c
·
verified ·
1 Parent(s): be66b4d

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +69 -0
README.md ADDED
@@ -0,0 +1,69 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model:
4
+ - Qwen/Qwen3-VL-8B-Instruct
5
+ ---
6
+
7
+ <h1 align="center">PVC-Judge is a state-of-the-art 8B assessment model for evaluating image editing models in visual consistency.</h1>
8
+
9
+ <p align="center">
10
+ <!-- <a href="https://arxiv.org/abs/xxxxx"><img src="https://img.shields.io/badge/Paper-arXiv%3Aedit this-b31b1b?logo=arxiv&logoColor=red"></a> -->
11
+ <a href="https://zhangqijiang07.github.io/gedit2_web/"><img src="https://img.shields.io/badge/%F0%9F%8C%90%20Project%20Page-Website-8A2BE2"></a>
12
+ <a href="https://huggingface.co/datasets/GEditBench-v2/GEditBench-v2"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20HF-GEditBench v2-blue"></a>
13
+ <a href="https://huggingface.co/datasets/GEditBench-v2/VCReward-Bench"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20HF-VCReward Bench-blue"></a>
14
+ <a href="https://huggingface.co/GEditBench-v2/PVC-Judge"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20HF-PVC Judge-blue"></a>
15
+
16
+
17
+ ## 🚀 Quick Start!
18
+ ### Clone github repo
19
+ ```bash
20
+ git clone https://github.com/ZhangqiJiang07/GEditBench_v2.git
21
+ cd GEditBench_v2
22
+ ```
23
+
24
+ ### Option 1: Packaged as an online client
25
+ - Merge LoRA weights to models, required env `torch/peft/transformers`
26
+ ```bash
27
+ python ./scripts/merge_lora.py \
28
+ --base-model-path /path/to/Qwen3/VL/8B/Instruct \
29
+ --lora-weights-path /path/to/LoRA/Weights \
30
+ --model-save-dir /path/to/save/PVC/Judge/model
31
+ ```
32
+
33
+ - Implement online server via vLLM
34
+ ```bash
35
+ python -m vllm.entrypoints.openai.api_server \
36
+ --model /path/to/save/PVC/Judge/model \
37
+ --served-model-name PVC-Judge \
38
+ --tensor-parallel-size 1 \
39
+ --mm-encoder-tp-mode data \
40
+ --limit-mm-per-prompt.video 0 \
41
+ --host 0.0.0.0 \
42
+ --port 25930 \
43
+ --dtype bfloat16 \
44
+ --gpu-memory-utilization 0.80 \
45
+ --max_num_seqs 32 \
46
+ --max-model-len 48000 \
47
+ --distributed-executor-backend mp
48
+ ```
49
+
50
+ - Use `autopipeline` for inference.
51
+
52
+ See our [repo](https://github.com/ZhangqiJiang07/GEditBench_v2/tree/main) for detailed usage!
53
+
54
+
55
+ ### Option 2: Offline Inference
56
+
57
+ ```bash
58
+ # For local judge inference
59
+ conda env create -f environments/pvc_judge.yml
60
+ conda activate pvc_judge
61
+ # or:
62
+ python3.12 -m venv .venvs/pvc_judge
63
+ source .venvs/pvc_judge/bin/activate
64
+ python -m pip install -r environments/requirements/pvc_judge.lock.txt
65
+
66
+
67
+ # Run
68
+ bash ./scripts/local_eval.sh vc_reward
69
+ ```