docs: create modelcard
Browse files
README.md
ADDED
|
@@ -0,0 +1,803 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
---
|
| 4 |
+
<p align="center">
|
| 5 |
+
<img src="./assets/logo.png" width="600"/>
|
| 6 |
+
<p>
|
| 7 |
+
<p align="center">
|
| 8 |
+
<a href="https://huggingface.co/FireRedTeam" target="_blank"><img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-FireRedTeam-ffc107?color=ffc107&logoColor=white" style="display: inline-block;"/></a>
|
| 9 |
+
<a href='https://github.com/FireRedTeam/FireRed-Image-Edit'><img src='https://img.shields.io/badge/GitHub-Code-black'></a>
|
| 10 |
+
<a href='https://www.apache.org/licenses/LICENSE-2.0'><img src="https://img.shields.io/badge/license-Apache%202.0-blue" alt="License"></a>
|
| 11 |
+
<a href="https://github.com/FireRedTeam/FireRed-Image-Edit/blob/main/assets/FireRed_Image_Edit_1_0_Techinical_Report.pdf" target="_blank"><img src="https://img.shields.io/badge/Report-b5212f.svg?logo=arxiv"></a>
|
| 12 |
+
</p>
|
| 13 |
+
<p align="center">
|
| 14 |
+
🤗 <a href="https://huggingface.co/FireRedTeam/FireRed-Image-Edit-1.0">HuggingFace</a> |
|
| 15 |
+
🖥️ <a href="https://huggingface.co/spaces/FireRedTeam/FireRed-Image-Edit-1.0"> Demo</a> |
|
| 16 |
+
<a href="https://github.com/FireRedTeam/FireRed-Image-Edit/blob/main/assets/FireRed_Image_Edit_1_0_Techinical_Report.pdf">Technical Report</a>
|
| 17 |
+
</p>
|
| 18 |
+
<p align="center">
|
| 19 |
+
<img src="./assets/teaser.png" width="800"/>
|
| 20 |
+
<p>
|
| 21 |
+
|
| 22 |
+
|
| 23 |
+
## 🔥 FireRed-Image-Edit
|
| 24 |
+
**FireRed-Image-Edit** is a general-purpose image editing model that delivers high-fidelity and consistent editing across a wide range of scenarios.
|
| 25 |
+
|
| 26 |
+
## ✨ Key Features
|
| 27 |
+
- **Strong Editing Performance**: FireRed-Image-Edit delivers leading open-source results with accurate instruction following, high image quality, and consistent visual coherence.
|
| 28 |
+
- **Native Editing Capability**: Built directly from text-to-image foundation model and endowed with editing capabilities.
|
| 29 |
+
- **Text Style Preservation**: Maintains text styles with high fidelity, achieving performance comparable to closed-source solutions.
|
| 30 |
+
- **Photo Restoration**: High-quality old photo restoration and enhancement.
|
| 31 |
+
- **Multi-Image Editing**: Flexible editing of multiple images such as virtual try-on.
|
| 32 |
+
|
| 33 |
+
|
| 34 |
+
## 📰 News
|
| 35 |
+
- 2026.02.10: We released FireRed-Image-Edit-1.0.
|
| 36 |
+
## 🎨 Showcase
|
| 37 |
+
Some real outputs produced by FireRed-Image-Edit across genearl editing.
|
| 38 |
+
<p align="center">
|
| 39 |
+
<img src="./assets/showcase.png" width="800"/>
|
| 40 |
+
<p>
|
| 41 |
+
|
| 42 |
+
## 🗂️ Model Zoo
|
| 43 |
+
|
| 44 |
+
<div style="overflow-x: auto; margin-bottom: 16px;">
|
| 45 |
+
<table style="border-collapse: collapse; width: 100%;">
|
| 46 |
+
<thead>
|
| 47 |
+
<tr>
|
| 48 |
+
<th style="white-space: nowrap; padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa;">Models</th>
|
| 49 |
+
<th style="white-space: nowrap; padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa;">Task</th>
|
| 50 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa;">Description</th>
|
| 51 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa;">Download Link</th>
|
| 52 |
+
</tr>
|
| 53 |
+
</thead>
|
| 54 |
+
<tbody>
|
| 55 |
+
<tr>
|
| 56 |
+
<td style="white-space: nowrap; padding: 8px; border: 1px solid #d0d7de;">FireRed-Image-Edit-1.0</td>
|
| 57 |
+
<td style="white-space: nowrap; padding: 8px; border: 1px solid #d0d7de;">Image-Editing</td>
|
| 58 |
+
<td style="padding: 8px; border: 1px solid #d0d7de;">General-purpose image editing model</td>
|
| 59 |
+
<td style="padding: 8px; border: 1px solid #d0d7de;">
|
| 60 |
+
<span style="white-space: nowrap;">To be released</a></span>
|
| 61 |
+
</td>
|
| 62 |
+
</tr>
|
| 63 |
+
<tr>
|
| 64 |
+
<td style="white-space: nowrap; padding: 8px; border: 1px solid #d0d7de;">FireRed-Image-Edit-1.0-Distilled</td>
|
| 65 |
+
<td style="white-space: nowrap; padding: 8px; border: 1px solid #d0d7de;">Image-Editing</td>
|
| 66 |
+
<td style="padding: 8px; border: 1px solid #d0d7de;">Distilled version of FireRed-Image-Edit-1.0 for faster inference</td>
|
| 67 |
+
<td style="padding: 8px; border: 1px solid #d0d7de;">
|
| 68 |
+
<span style="white-space: nowrap;">To be released</a></span>
|
| 69 |
+
</td>
|
| 70 |
+
</tr>
|
| 71 |
+
<tr>
|
| 72 |
+
<td style="white-space: nowrap; padding: 8px; border: 1px solid #d0d7de;">FireRed-Image</td>
|
| 73 |
+
<td style="white-space: nowrap; padding: 8px; border: 1px solid #d0d7de;">Text-to-Image</td>
|
| 74 |
+
<td style="padding: 8px; border: 1px solid #d0d7de;">High-quality text-to-image generation model</td>
|
| 75 |
+
<td style="padding: 8px; border: 1px solid #d0d7de;">
|
| 76 |
+
<span style="white-space: nowrap;">To be released</a></span>
|
| 77 |
+
</td>
|
| 78 |
+
</tr>
|
| 79 |
+
</tbody>
|
| 80 |
+
</table>
|
| 81 |
+
</div>
|
| 82 |
+
|
| 83 |
+
## 🏗️ Model Architecture
|
| 84 |
+
<p align="center">
|
| 85 |
+
<img src="./assets/architecture.png" width="800"/>
|
| 86 |
+
<p>
|
| 87 |
+
|
| 88 |
+
## ⚡️ Quick Start
|
| 89 |
+
|
| 90 |
+
1. Install the latest version of diffusers
|
| 91 |
+
```
|
| 92 |
+
pip install git+https://github.com/huggingface/diffusers
|
| 93 |
+
```
|
| 94 |
+
2. Use the following code snippets to generate or edit images.
|
| 95 |
+
```
|
| 96 |
+
python inference.py \
|
| 97 |
+
--input_image ./example/edit_example.png \
|
| 98 |
+
--prompt "在书本封面Python的下方，添加一行英文文字2nd Edition" \
|
| 99 |
+
--output_image output_edit.png \
|
| 100 |
+
--seed 43
|
| 101 |
+
```
|
| 102 |
+
|
| 103 |
+
## 📊 Benchmark
|
| 104 |
+
To better validate the capabilities of our model, we propose a benchmark called REDEdit-Bench. Our main goal is to build more diverse scenarios and editing instructions that better align with human language, enabling a more comprehensive evaluation of current editing models. We collected over 3,000 images from the internet, and after careful expert-designed selection, we constructed 1,673 bilingual (Chinese–English) editing pairs across 15 categories.
|
| 105 |
+
|
| 106 |
+
### Inference and Evaluation Code
|
| 107 |
+
We provide the inference and evaluation code for REDEdit-Bench. Please refer to the [redbench_infer.py](./src/tools/redbench_infer.py) and [redbench_eval.py](./src/tools/redbench_eval.py) scripts in the `src/tools` directory for more details.
|
| 108 |
+
|
| 109 |
+
### Benchmark Distribution
|
| 110 |
+
The REDEdit-Bench dataset will be available soon.
|
| 111 |
+
|
| 112 |
+
### Results on ImgEdit
|
| 113 |
+
|
| 114 |
+
<table style="border-collapse:collapse; width:100%; font-family:system-ui, -apple-system, Segoe UI, Roboto, Arial, sans-serif; font-size:14px;">
|
| 115 |
+
<thead>
|
| 116 |
+
<tr>
|
| 117 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:left;">Model</th>
|
| 118 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">Overall ↑</th>
|
| 119 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">Add</th>
|
| 120 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">Adjust</th>
|
| 121 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">Extract</th>
|
| 122 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">Replace</th>
|
| 123 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">Remove</th>
|
| 124 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">BG</th>
|
| 125 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">Style</th>
|
| 126 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">Hybrid</th>
|
| 127 |
+
<th style="border:1px solid #ddd; padding:8px; text-align:center;">Action</th>
|
| 128 |
+
</tr>
|
| 129 |
+
</thead>
|
| 130 |
+
<tbody><tr>
|
| 131 |
+
<td colspan="11" style="border:1px solid #ddd; padding:8px; font-weight:700; background:#f7f7f7;">
|
| 132 |
+
🔹 Proprietary Models
|
| 133 |
+
</td>
|
| 134 |
+
</tr><tr>
|
| 135 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">Nano-Banana</td>
|
| 136 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.29</td>
|
| 137 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.62</b></td>
|
| 138 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.41</td>
|
| 139 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>3.68</u></td>
|
| 140 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.34</td>
|
| 141 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.39</td>
|
| 142 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.40</b></td>
|
| 143 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.18</td>
|
| 144 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>3.72</b></td>
|
| 145 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.83</b></td>
|
| 146 |
+
</tr><tr>
|
| 147 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">Seedream4.0</td>
|
| 148 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.30</td>
|
| 149 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.33</td>
|
| 150 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.38</td>
|
| 151 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>3.89</b></td>
|
| 152 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.65</u></td>
|
| 153 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.57</u></td>
|
| 154 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.35</td>
|
| 155 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.22</td>
|
| 156 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>3.71</u></td>
|
| 157 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.61</td>
|
| 158 |
+
</tr><tr>
|
| 159 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">Seedream4.5</td>
|
| 160 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.32</u></td>
|
| 161 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.57</u></td>
|
| 162 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.65</b></td>
|
| 163 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">2.97</td>
|
| 164 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.66</b></td>
|
| 165 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.46</td>
|
| 166 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.37</u></td>
|
| 167 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.92</u></td>
|
| 168 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>3.71</u></td>
|
| 169 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.56</td>
|
| 170 |
+
</tr><tr>
|
| 171 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">Nano-Banana-Pro</td>
|
| 172 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.37</b></td>
|
| 173 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.44</td>
|
| 174 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.62</u></td>
|
| 175 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.42</td>
|
| 176 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.60</td>
|
| 177 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.63</b></td>
|
| 178 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.32</td>
|
| 179 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.97</b></td>
|
| 180 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.64</td>
|
| 181 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.69</u></td>
|
| 182 |
+
</tr><tr>
|
| 183 |
+
<td colspan="11" style="border:1px solid #ddd; padding:8px; font-weight:700; background:#f7f7f7;" >
|
| 184 |
+
🔹 Open-source Models
|
| 185 |
+
</td>
|
| 186 |
+
</tr><tr>
|
| 187 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">FLUX.1 Kontext [Dev]</td>
|
| 188 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.71</td>
|
| 189 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.99</td>
|
| 190 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.88</td>
|
| 191 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">2.19</td>
|
| 192 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.27</td>
|
| 193 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.13</td>
|
| 194 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.98</td>
|
| 195 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.51</td>
|
| 196 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.23</td>
|
| 197 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.18</td>
|
| 198 |
+
</tr><tr>
|
| 199 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">Step1X-Edit-v1.2</td>
|
| 200 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.95</td>
|
| 201 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.91</td>
|
| 202 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.04</td>
|
| 203 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">2.68</td>
|
| 204 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.48</td>
|
| 205 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.26</td>
|
| 206 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.90</td>
|
| 207 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.82</td>
|
| 208 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.23</td>
|
| 209 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.22</td>
|
| 210 |
+
</tr><tr>
|
| 211 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">Qwen-Image-Edit-2509</td>
|
| 212 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.31</td>
|
| 213 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.34</td>
|
| 214 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.27</td>
|
| 215 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.42</td>
|
| 216 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.73</td>
|
| 217 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.36</td>
|
| 218 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.37</u></td>
|
| 219 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.91</td>
|
| 220 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.56</td>
|
| 221 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.80</td>
|
| 222 |
+
</tr><tr>
|
| 223 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">FLUX.2 [Dev]</td>
|
| 224 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.35</td>
|
| 225 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.50</td>
|
| 226 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.18</td>
|
| 227 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.83</td>
|
| 228 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.65</td>
|
| 229 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.65</b></td>
|
| 230 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.31</td>
|
| 231 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.88</td>
|
| 232 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.46</td>
|
| 233 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.70</td>
|
| 234 |
+
</tr><tr>
|
| 235 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">LongCat-Image-Edit</td>
|
| 236 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.45</td>
|
| 237 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.44</td>
|
| 238 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.53</td>
|
| 239 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.83</td>
|
| 240 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.80</b></td>
|
| 241 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.60</u></td>
|
| 242 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.33</td>
|
| 243 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.92</u></td>
|
| 244 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">3.75</td>
|
| 245 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.82</b></td>
|
| 246 |
+
</tr><tr>
|
| 247 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;">Qwen-Image-Edit-2511</td>
|
| 248 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.51</u></td>
|
| 249 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.54</u></td>
|
| 250 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.57</u></td>
|
| 251 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.13</u></td>
|
| 252 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.70</td>
|
| 253 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.46</td>
|
| 254 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.36</td>
|
| 255 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.89</td>
|
| 256 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.16</b></td>
|
| 257 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.81</u></td>
|
| 258 |
+
</tr><tr>
|
| 259 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:left;"><b>FireRed-Image-Edit</b></td>
|
| 260 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.56</b></td>
|
| 261 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.55</b></td>
|
| 262 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.66</b></td>
|
| 263 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.34</b></td>
|
| 264 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.75</u></td>
|
| 265 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.58</td>
|
| 266 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.45</b></td>
|
| 267 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><b>4.97</b></td>
|
| 268 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;"><u>4.07</u></td>
|
| 269 |
+
<td style="border:1px solid #ddd; padding:8px; text-align:center;">4.71</td>
|
| 270 |
+
</tr></tbody>
|
| 271 |
+
</table>
|
| 272 |
+
|
| 273 |
+
### Results on GEdit (official public benchmark)
|
| 274 |
+
|
| 275 |
+
<div style="overflow-x: auto; margin-bottom: 16px;">
|
| 276 |
+
<table style="border-collapse: collapse; width: 100%;">
|
| 277 |
+
<thead>
|
| 278 |
+
<tr>
|
| 279 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Model</th>
|
| 280 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_SC ↑ (EN)</th>
|
| 281 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_PQ ↑ (EN)</th>
|
| 282 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_O ↑ (EN)</th>
|
| 283 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_SC ↑ (CN)</th>
|
| 284 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_PQ ↑ (CN)</th>
|
| 285 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">G_O ↑ (CN)</th>
|
| 286 |
+
</tr>
|
| 287 |
+
</thead>
|
| 288 |
+
<tbody><tr>
|
| 289 |
+
<td colspan="7" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Proprietary Models</td>
|
| 290 |
+
</tr><tr>
|
| 291 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana</td>
|
| 292 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.396</td>
|
| 293 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.454</strong></td>
|
| 294 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.291</td>
|
| 295 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.540</td>
|
| 296 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.424</strong></td>
|
| 297 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.399</td>
|
| 298 |
+
</tr><tr>
|
| 299 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.0</td>
|
| 300 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.143</u></td>
|
| 301 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.124</td>
|
| 302 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.701</td>
|
| 303 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.159</u></td>
|
| 304 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.074</td>
|
| 305 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.692</td>
|
| 306 |
+
</tr><tr>
|
| 307 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana-Pro</td>
|
| 308 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.102</td>
|
| 309 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.344</u></td>
|
| 310 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>7.738</u></td>
|
| 311 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.135</td>
|
| 312 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.306</u></td>
|
| 313 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>7.799</u></td>
|
| 314 |
+
</tr><tr>
|
| 315 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.5</td>
|
| 316 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.268</strong></td>
|
| 317 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.167</td>
|
| 318 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>7.820</strong></td>
|
| 319 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.254</strong></td>
|
| 320 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.167</td>
|
| 321 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>7.800</strong></td>
|
| 322 |
+
</tr><tr>
|
| 323 |
+
<td colspan="7" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Open-source Models</td>
|
| 324 |
+
</tr><tr>
|
| 325 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">FLUX.2 [Dev]</td>
|
| 326 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.835</td>
|
| 327 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.064</td>
|
| 328 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.413</td>
|
| 329 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.697</td>
|
| 330 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.046</td>
|
| 331 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.278</td>
|
| 332 |
+
</tr><tr>
|
| 333 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2509</td>
|
| 334 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.974</td>
|
| 335 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.714</td>
|
| 336 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.480</td>
|
| 337 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.988</td>
|
| 338 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.679</td>
|
| 339 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.467</td>
|
| 340 |
+
</tr><tr>
|
| 341 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Step1X-Edit-v1.2</td>
|
| 342 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.974</td>
|
| 343 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.714</td>
|
| 344 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.480</td>
|
| 345 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.988</td>
|
| 346 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.679</td>
|
| 347 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.467</td>
|
| 348 |
+
</tr><tr>
|
| 349 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Longcat-Image-Edit</td>
|
| 350 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.128</td>
|
| 351 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.177</td>
|
| 352 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.748</td>
|
| 353 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.141</td>
|
| 354 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">8.117</td>
|
| 355 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">7.731</td>
|
| 356 |
+
</tr><tr>
|
| 357 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2511</td>
|
| 358 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.297</u></td>
|
| 359 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.202</u></td>
|
| 360 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>7.877</u></td>
|
| 361 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.252</u></td>
|
| 362 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>8.134</u></td>
|
| 363 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>7.819</u></td>
|
| 364 |
+
</tr><tr>
|
| 365 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;"><strong>\methodname</strong></td>
|
| 366 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.363</strong></td>
|
| 367 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.245</strong></td>
|
| 368 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>7.943</strong></td>
|
| 369 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.287</strong></td>
|
| 370 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>8.227</strong></td>
|
| 371 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>7.887</strong></td>
|
| 372 |
+
</tr></tbody>
|
| 373 |
+
</table>
|
| 374 |
+
</div>
|
| 375 |
+
|
| 376 |
+
### Results on REDEdit-Bench-CN (General Dimensions)
|
| 377 |
+
|
| 378 |
+
<div style="overflow-x: auto; margin-bottom: 16px;">
|
| 379 |
+
<table style="border-collapse: collapse; width: 100%;">
|
| 380 |
+
<thead>
|
| 381 |
+
<tr>
|
| 382 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Model</th>
|
| 383 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Overall</th>
|
| 384 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Add</th>
|
| 385 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Adjust</th>
|
| 386 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">BG</th>
|
| 387 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Beauty</th>
|
| 388 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Color</th>
|
| 389 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Compose</th>
|
| 390 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Extract</th>
|
| 391 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Portrait</th>
|
| 392 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Low-level</th>
|
| 393 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Motion</th>
|
| 394 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Remove</th>
|
| 395 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Replace</th>
|
| 396 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Stylize</th>
|
| 397 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Text</th>
|
| 398 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Viewpoint</th>
|
| 399 |
+
</tr>
|
| 400 |
+
</thead>
|
| 401 |
+
<tbody><tr>
|
| 402 |
+
<td colspan="17" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Proprietary Models</td>
|
| 403 |
+
</tr><tr>
|
| 404 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.0</td>
|
| 405 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.15</td>
|
| 406 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.55</td>
|
| 407 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.11</td>
|
| 408 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.61</u></td>
|
| 409 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.83</td>
|
| 410 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.14</u></td>
|
| 411 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.16</u></td>
|
| 412 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.48</td>
|
| 413 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.77</td>
|
| 414 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.17</u></td>
|
| 415 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.68</td>
|
| 416 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.02</td>
|
| 417 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.53</td>
|
| 418 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.94</strong></td>
|
| 419 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.94</td>
|
| 420 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.29</td>
|
| 421 |
+
</tr><tr>
|
| 422 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.5</td>
|
| 423 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.18</u></td>
|
| 424 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.58</u></td>
|
| 425 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.09</td>
|
| 426 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.57</td>
|
| 427 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.97</td>
|
| 428 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
|
| 429 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.05</td>
|
| 430 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.56</td>
|
| 431 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.80</td>
|
| 432 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.99</td>
|
| 433 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.78</u></td>
|
| 434 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.12</u></td>
|
| 435 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.53</td>
|
| 436 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.94</strong></td>
|
| 437 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.07</u></td>
|
| 438 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.53</u></td>
|
| 439 |
+
</tr><tr>
|
| 440 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana</td>
|
| 441 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.13</td>
|
| 442 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.66</strong></td>
|
| 443 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.26</u></td>
|
| 444 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.63</strong></td>
|
| 445 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.37</strong></td>
|
| 446 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.13</td>
|
| 447 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.94</td>
|
| 448 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.17</u></td>
|
| 449 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.83</u></td>
|
| 450 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.05</td>
|
| 451 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.75</td>
|
| 452 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
|
| 453 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.74</u></td>
|
| 454 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.63</td>
|
| 455 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.69</td>
|
| 456 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.09</td>
|
| 457 |
+
</tr><tr>
|
| 458 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana-Pro</td>
|
| 459 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.48</strong></td>
|
| 460 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.66</strong></td>
|
| 461 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.41</strong></td>
|
| 462 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.58</td>
|
| 463 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.35</u></td>
|
| 464 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.58</strong></td>
|
| 465 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.36</strong></td>
|
| 466 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.42</strong></td>
|
| 467 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.86</strong></td>
|
| 468 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.46</strong></td>
|
| 469 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.91</strong></td>
|
| 470 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.54</strong></td>
|
| 471 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.79</strong></td>
|
| 472 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.85</u></td>
|
| 473 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.69</strong></td>
|
| 474 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.75</strong></td>
|
| 475 |
+
</tr><tr>
|
| 476 |
+
<td colspan="17" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Open-source Models</td>
|
| 477 |
+
</tr><tr>
|
| 478 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2509</td>
|
| 479 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.00</td>
|
| 480 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.45</td>
|
| 481 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.04</td>
|
| 482 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.48</td>
|
| 483 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.36</td>
|
| 484 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.20</u></td>
|
| 485 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.92</td>
|
| 486 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.64</td>
|
| 487 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.16</td>
|
| 488 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.52</td>
|
| 489 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.66</td>
|
| 490 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.27</td>
|
| 491 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.66</td>
|
| 492 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.81</td>
|
| 493 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.53</td>
|
| 494 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.32</td>
|
| 495 |
+
</tr><tr>
|
| 496 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">FLUX.2 [Dev]</td>
|
| 497 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.05</td>
|
| 498 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.31</td>
|
| 499 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.88</td>
|
| 500 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.57</u></td>
|
| 501 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.80</strong></td>
|
| 502 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.91</td>
|
| 503 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.85</td>
|
| 504 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.47</td>
|
| 505 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.50</strong></td>
|
| 506 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.43</u></td>
|
| 507 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.68</strong></td>
|
| 508 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.50</td>
|
| 509 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.47</td>
|
| 510 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.95</strong></td>
|
| 511 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.53</td>
|
| 512 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.88</strong></td>
|
| 513 |
+
</tr><tr>
|
| 514 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Longcat-Image-Edit</td>
|
| 515 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
|
| 516 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.34</td>
|
| 517 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.25</u></td>
|
| 518 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.54</td>
|
| 519 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.72</u></td>
|
| 520 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
|
| 521 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.92</td>
|
| 522 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.48</td>
|
| 523 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.49</u></td>
|
| 524 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.31</td>
|
| 525 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.67</u></td>
|
| 526 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.27</td>
|
| 527 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.61</td>
|
| 528 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.94</u></td>
|
| 529 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.83</td>
|
| 530 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.30</td>
|
| 531 |
+
</tr><tr>
|
| 532 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2511</td>
|
| 533 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.18</u></td>
|
| 534 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.50</u></td>
|
| 535 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.23</td>
|
| 536 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.52</td>
|
| 537 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.61</td>
|
| 538 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.09</td>
|
| 539 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.00</u></td>
|
| 540 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.22</u></td>
|
| 541 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.31</td>
|
| 542 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.19</td>
|
| 543 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.66</td>
|
| 544 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.41</u></td>
|
| 545 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.68</u></td>
|
| 546 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.83</td>
|
| 547 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.08</u></td>
|
| 548 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.51</u></td>
|
| 549 |
+
</tr><tr>
|
| 550 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;"><strong>FireRed-Image-Edit</strong></td>
|
| 551 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.33</strong></td>
|
| 552 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.57</strong></td>
|
| 553 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.37</strong></td>
|
| 554 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.64</strong></td>
|
| 555 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.69</td>
|
| 556 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.45</strong></td>
|
| 557 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.29</strong></td>
|
| 558 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.49</strong></td>
|
| 559 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.50</strong></td>
|
| 560 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.56</strong></td>
|
| 561 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.65</td>
|
| 562 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.47</strong></td>
|
| 563 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.81</strong></td>
|
| 564 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.93</td>
|
| 565 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.49</strong></td>
|
| 566 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.14</td>
|
| 567 |
+
</tr></tbody>
|
| 568 |
+
</table>
|
| 569 |
+
</div>
|
| 570 |
+
|
| 571 |
+
### Results on REDEdit-Bench-EN (General dimensions)
|
| 572 |
+
|
| 573 |
+
<div style="overflow-x: auto; margin-bottom: 16px;">
|
| 574 |
+
<table style="border-collapse: collapse; width: 100%;">
|
| 575 |
+
<thead>
|
| 576 |
+
<tr>
|
| 577 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Model</th>
|
| 578 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Overall</th>
|
| 579 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Add</th>
|
| 580 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Adjust</th>
|
| 581 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">BG</th>
|
| 582 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Beauty</th>
|
| 583 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Color</th>
|
| 584 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Compose</th>
|
| 585 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Extract</th>
|
| 586 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Portrait</th>
|
| 587 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Low-level</th>
|
| 588 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Motion</th>
|
| 589 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Remove</th>
|
| 590 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Replace</th>
|
| 591 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Stylize</th>
|
| 592 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Text</th>
|
| 593 |
+
<th style="padding: 8px; border: 1px solid #d0d7de; background-color: #f6f8fa; white-space: nowrap;">Viewpoint</th>
|
| 594 |
+
</tr>
|
| 595 |
+
</thead>
|
| 596 |
+
<tbody><tr>
|
| 597 |
+
<td colspan="17" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Proprietary Models</td>
|
| 598 |
+
</tr><tr>
|
| 599 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana</td>
|
| 600 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.15</td>
|
| 601 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.65</td>
|
| 602 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.23</u></td>
|
| 603 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.60</td>
|
| 604 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.37</strong></td>
|
| 605 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.08</td>
|
| 606 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.98</td>
|
| 607 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.39</strong></td>
|
| 608 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.72</td>
|
| 609 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.03</td>
|
| 610 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.63</td>
|
| 611 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
|
| 612 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.68</u></td>
|
| 613 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.68</td>
|
| 614 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.87</td>
|
| 615 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.23</td>
|
| 616 |
+
</tr><tr>
|
| 617 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.0</td>
|
| 618 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.18</td>
|
| 619 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.59</td>
|
| 620 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
|
| 621 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.63</u></td>
|
| 622 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.89</td>
|
| 623 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.10</u></td>
|
| 624 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.14</u></td>
|
| 625 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.28</td>
|
| 626 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.77</u></td>
|
| 627 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
|
| 628 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.73</td>
|
| 629 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.23</td>
|
| 630 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.56</td>
|
| 631 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.98</strong></td>
|
| 632 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.21</u></td>
|
| 633 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.42</td>
|
| 634 |
+
</tr><tr>
|
| 635 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Seedream4.5</td>
|
| 636 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.20</u></td>
|
| 637 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.66</u></td>
|
| 638 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.08</td>
|
| 639 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.64</strong></td>
|
| 640 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.12</u></td>
|
| 641 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
|
| 642 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.10</td>
|
| 643 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.23</td>
|
| 644 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.74</td>
|
| 645 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.28</u></td>
|
| 646 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.75</u></td>
|
| 647 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.24</u></td>
|
| 648 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.58</td>
|
| 649 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.97</u></td>
|
| 650 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.20</td>
|
| 651 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.44</u></td>
|
| 652 |
+
</tr><tr>
|
| 653 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Nano-Banana-Pro</td>
|
| 654 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.42</strong></td>
|
| 655 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.72</strong></td>
|
| 656 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.40</strong></td>
|
| 657 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.64</strong></td>
|
| 658 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.37</strong></td>
|
| 659 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.43</strong></td>
|
| 660 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.32</strong></td>
|
| 661 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.25</u></td>
|
| 662 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.82</strong></td>
|
| 663 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.36</strong></td>
|
| 664 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.85</strong></td>
|
| 665 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.52</strong></td>
|
| 666 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.75</strong></td>
|
| 667 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.90</td>
|
| 668 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.54</strong></td>
|
| 669 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.51</strong></td>
|
| 670 |
+
</tr><tr>
|
| 671 |
+
<td colspan="17" style="padding: 8px; border: 1px solid #d0d7de; font-weight: 600; text-align: left;">🔹 Open-source Models</td>
|
| 672 |
+
</tr><tr>
|
| 673 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2509</td>
|
| 674 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.99</td>
|
| 675 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.47</u></td>
|
| 676 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.06</td>
|
| 677 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.49</td>
|
| 678 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.13</td>
|
| 679 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.98</td>
|
| 680 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.85</td>
|
| 681 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.91</td>
|
| 682 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.30</td>
|
| 683 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.71</td>
|
| 684 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.58</td>
|
| 685 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.40</td>
|
| 686 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.67</u></td>
|
| 687 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.77</td>
|
| 688 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.77</td>
|
| 689 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.85</td>
|
| 690 |
+
</tr><tr>
|
| 691 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">FLUX.2 [Dev]</td>
|
| 692 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
|
| 693 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.37</td>
|
| 694 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.96</td>
|
| 695 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.47</td>
|
| 696 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.72</u></td>
|
| 697 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.86</td>
|
| 698 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.87</td>
|
| 699 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.36</td>
|
| 700 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.44</td>
|
| 701 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.45</u></td>
|
| 702 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.67</td>
|
| 703 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.02</td>
|
| 704 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.48</td>
|
| 705 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.87</u></td>
|
| 706 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.80</td>
|
| 707 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.84</strong></td>
|
| 708 |
+
</tr><tr>
|
| 709 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">LongCat-Image-Edit</td>
|
| 710 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.12</td>
|
| 711 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.38</td>
|
| 712 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.04</td>
|
| 713 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.49</td>
|
| 714 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.89</strong></td>
|
| 715 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.10</u></td>
|
| 716 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.93</td>
|
| 717 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.98</td>
|
| 718 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.47</u></td>
|
| 719 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.27</td>
|
| 720 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.69</u></td>
|
| 721 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.24</td>
|
| 722 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.51</td>
|
| 723 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.86</td>
|
| 724 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.83</td>
|
| 725 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.25</td>
|
| 726 |
+
</tr><tr>
|
| 727 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;">Qwen-Image-Edit-2511</td>
|
| 728 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.23</u></td>
|
| 729 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.55</strong></td>
|
| 730 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.17</u></td>
|
| 731 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.56</u></td>
|
| 732 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.49</td>
|
| 733 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.07</td>
|
| 734 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.07</u></td>
|
| 735 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>3.54</strong></td>
|
| 736 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.42</td>
|
| 737 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.52</strong></td>
|
| 738 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.72</strong></td>
|
| 739 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.42</u></td>
|
| 740 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.65</td>
|
| 741 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.85</td>
|
| 742 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>4.06</u></td>
|
| 743 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.38</u></td>
|
| 744 |
+
</tr><tr>
|
| 745 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: left; white-space: nowrap;"><strong>FireRed-Image-Edit</strong></td>
|
| 746 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.26</strong></td>
|
| 747 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.41</td>
|
| 748 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.33</strong></td>
|
| 749 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.60</strong></td>
|
| 750 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">3.55</td>
|
| 751 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.47</strong></td>
|
| 752 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.25</strong></td>
|
| 753 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><u>3.49</u></td>
|
| 754 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.50</strong></td>
|
| 755 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.44</td>
|
| 756 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">4.65</td>
|
| 757 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.46</strong></td>
|
| 758 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.70</strong></td>
|
| 759 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.94</strong></td>
|
| 760 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;"><strong>4.44</strong></td>
|
| 761 |
+
<td style="padding: 8px; border: 1px solid #d0d7de; text-align: center; white-space: nowrap;">2.78</td>
|
| 762 |
+
</tr></tbody>
|
| 763 |
+
</table>
|
| 764 |
+
</div>
|
| 765 |
+
|
| 766 |
+
## 📜 License Agreement
|
| 767 |
+
|
| 768 |
+
The code and the weights of FireRed-Image-Edit are licensed under Apache 2.0.
|
| 769 |
+
|
| 770 |
+
|
| 771 |
+
## 📝 TODO:
|
| 772 |
+
- [x] Release FireRed-Image-Edit-1.0 model.
|
| 773 |
+
- [ ] Release REDEdit-Bench, a comprehensive benchmark for image editing evaluation.
|
| 774 |
+
- [ ] Release FireRed-Image-Edit-1.0-Distilled model, a distilled version of FireRed-Image-Edit-1.0 for few-step generation.
|
| 775 |
+
- [ ] Release FireRed-Image model, a text-to-image generative model.
|
| 776 |
+
|
| 777 |
+
|
| 778 |
+
## 🖊️ Citation
|
| 779 |
+
|
| 780 |
+
We kindly encourage citation of our work if you find it useful.
|
| 781 |
+
|
| 782 |
+
```bibtex
|
| 783 |
+
@article{firered2026rededit,
|
| 784 |
+
title={FireRed-Image-Edit: A General-Purpose Image Editing Model},
|
| 785 |
+
author={Super Intelligence Team},
|
| 786 |
+
year={2026},
|
| 787 |
+
archivePrefix={arXiv},
|
| 788 |
+
primaryClass={cs.CV},
|
| 789 |
+
url={https://arxiv.org/abs/xxxx.xxxxx},
|
| 790 |
+
}
|
| 791 |
+
```
|
| 792 |
+
|
| 793 |
+
## ⚠️ Ethics Statement
|
| 794 |
+
FireRed-Image-Edit has not been specifically designed or comprehensively evaluated for every possible downstream application. Users should be aware of the potential risks and ethical considerations when using this project, and should use it responsibly and in compliance with all applicable laws and regulations.
|
| 795 |
+
|
| 796 |
+
- **Prohibited Use**: This project must not be used to generate content that is illegal, defamatory, pornographic, harmful, or that violates the privacy, rights, or interests of individuals or organizations.
|
| 797 |
+
- **User Responsibility**: Users are solely responsible for any content generated using this project. The authors and contributors assume no responsibility or liability for any misuse of the codebase or for any consequences resulting from its use.
|
| 798 |
+
|
| 799 |
+
|
| 800 |
+
|
| 801 |
+
## 🤝 Acknowledgements
|
| 802 |
+
|
| 803 |
+
We would like to thank the developers of the amazing open-source projects, including [Qwen-Image](https://github.com/QwenLM/Qwen-Image), [Diffusers](https://github.com/huggingface/diffusers) and [HuggingFace](https://huggingface.co)
|