ByteDance/EvoQuality

1---2license: apache-2.03library_name: transformers4pipeline_tag: image-text-to-text5tags:6  - evoquality7  - image-quality-assessment8  - vlm9  - multimodal10---11 12# EvoQuality13 14## 1. Model Overview15 16- **Model Name**: EvoQuality (Self-Evolving VLM for Image Quality Assessment)17- **Task**: No-Reference Image Quality Assessment (NR-IQA), supporting both single-image quality scoring and pairwise quality comparison (ranking)18- **Core Idea**: Without relying on any human-annotated quality scores or distortion-type labels, EvoQuality generates pseudo-ranking labels via **pairwise majority voting**, and converts them into an optimizable reward signal through **GRPO** to iteratively self-evolve its quality perception capability19- **Paper**: [Self-Evolving Vision-Language Models for Image Quality Assessment via Voting and Ranking](https://openreview.net/forum?id=INOi0YqI8p) (ICLR 2026, arXiv:2509.25787)20 21## 2. Model and Framework Details22 23- **Backbone Model (paper setting)**: `Qwen2.5-VL-7B` (used as the baseline policy)24- **Training Paradigm**: Two-stage cycle, supports multi-round iteration (`T=2` in the paper)25  - **Offline Stage (Pseudo-label)**: Perform `K` comparisons on randomly sampled image pairs, then derive pseudo-preferences `p*(xi, xj)` via majority voting26  - **Online Stage (RL)**: Convert pseudo-preferences into a fidelity reward and update the policy via **Group Relative Policy Optimization (GRPO)** (full fine-tuning of the VLM)27 28## 3. Prompts29 30- **Offline Comparison** **`c_compare`**:31  - `<image><image> You are performing an image quality assessment task. Compare the two images and decide which one has better perceptual quality. Answer strictly with the index of the better image: 0 if the first image is better, or 1 if the second image is better.`32- **Online Scoring** **`c_score`**:33  - `<image> You are doing the image quality assessment task. Here is the question: What is your overall rating on the quality of this picture? The rating should be a float between 1 and 5, rounded to two decimal places, with 1 representing very poor quality and 5 representing excellent quality.`34- **Reasoning Suffix (for self-consistency sampling)**:35  - `You FIRST think about the reasoning process as an internal monologue and then provide the final answer. The reasoning process MUST BE enclosed within <think> </think> tags. The final answer MUST BE put in boxed{}.`36 37## 4. Training38 39- **Number of Iterations**: `T = 1` (the open-sourced model weights are the result of the first round of self-evolution)40- **Training Data**: No additional synthetic distortion data and no extra annotated labels were added when producing the released weights41- **Offline Stage**:42  - Sample `K=32` responses per pair, then derive pseudo-labels via majority voting43  - Randomly swap image order to mitigate positional bias44- **Online Stage (GRPO)**:45  - Sample `K=32` responses per sample (`c_score`)46  - Optimizer: AdamW, initial learning rate `3e-7`, with linear decay47  - KL coefficient: `beta = 0.05`48  - Resources (as reported in the paper): 8x NVIDIA A100, per-GPU batch size = 4, ~12 hours/epoch49 50## 5. Evaluation Metrics51 52- **Evaluation Setting**: zero-shot (no training on the target test sets)53- **Metrics**: PLCC, SRCC (consistency with human subjective quality)54 55## 6. Main Results56 57- **Improvement over the Backbone Model (Qwen2.5-VL-7B)**: weighted average (WA VG.) over multiple benchmarks58  - PLCC: `0.615 -> 0.770` (+31.8%)59  - SRCC: `0.570 -> 0.726` (+33.7%)60- **Generalization**: Achieves significant improvements across diverse distortion types and AI-generated content, matching or surpassing several supervised VLM-IQA approaches on multiple benchmarks (see the paper for detailed tables)61 62## 7. Intended Use and Usage Guidelines63 64- **Recommended Use**65  - Research and evaluation: NR-IQA, cross-dataset generalization comparison, quality ranking/filtering, auxiliary signals for data cleaning66  - Pre-production assessment: as a perceptual quality proxy, but should be combined with business data and manual spot-check validation67- **Not Recommended Use**68  - As the sole quality criterion for high-stakes decisions (content moderation, medical imaging diagnostic conclusions, legal evidence adjudication, etc.)69  - Treating model outputs as "absolute objective ground truth" (IQA is inherently subjective and correlated with population preferences)70- **Output Notes**71  - The paper's prompts require outputs in the form of `<think>...</think>` with `boxed{score}`; for actual integration, it is recommended to parse only the value inside `boxed{}` and consider how temperature/sampling strategies affect consistency72 73## 8. Limitations and Known Risks74 75- **Self-supervised Pseudo-label Bias**: Pseudo-rankings are derived from the model's own votes, which may amplify the systematic preferences or blind spots of the backbone model76- **Domain Shift**: May fail on images from specific domains (medical, remote sensing, industrial inspection)77- **Subjectivity and Population Differences**: Different cultural/aesthetic preferences and task objectives (aesthetics vs. clarity) can change the definition of "quality"78- **Prompt Sensitivity**: Variations in prompts, sampling count K, and decoding strategies can affect self-consistency voting and final performance79 80<br />81 82<br />83 84## 9. Citation85 86```bibtex87@article{wen2025selfevolving,88  title={Self-Evolving Vision-Language Models for Image Quality Assessment via Voting and Ranking},89  author={Wen, Wen and Zhi, Tianwu and Fan, Kanglong and Li, Yang and Peng, Xinge and Zhang, Yabin and Liao, Yiting and Li, Junlin and Zhang, Li},90  journal={arXiv preprint arXiv:2509.25787},91  year={2025}92}93```94