IMG.LY GenAI Benchmarks

Benchmark GenAI image models

The same prompt, every model, side by side. We run identical prompts across the leading image generation models and score the results on what production design work actually needs: typography, brand-color fidelity, transparency, composition, consistency, cost and latency. When a new model drops, the whole suite re-runs.

26

Models benchmarked

37

Canonical prompts

2883

Images generated

Oct 22, 2026

Last benchmark run

Logo wordmark for a company called "Aurelia", geometric sans-serif, flat black on white, perfectly spelled, centered.

What are you building?

Start from the job, not the model. Each path weights the same measurements for what actually decides success in that use case. And if the model choice is delegated to an AI design agent, these are still the numbers the choice should rest on.

“I want to generate print-ready files”

“I want to create merch and stickers”

“I want designs with real text”

“I want to generate product ads”

“I want my users to create designs in my app”

“I want to personalize creatives at scale”

“I want to generate product imagery”

Same prompt. Every model. Side by side.

Identical text, default parameters, a fixed seed where the API takes one, no per-model tuning. Every result ships with its seed, latency, cost and native resolution, so you compare models, not prompt engineering.

Rankings

Which model should you build on?

Every model side by side: cost per image, latency, native resolution and per-criterion scores, with a full result gallery and per-category breakdown on every model profile.

Prompts

The canonical prompt suite

Typography, vector style, brand color, transparency, composition and spatial adherence: each prompt stresses a criterion that decides whether an asset ships, and each has a result grid across all models.

Compare

Head to head

Pick two or three models and see every canonical prompt side by side, with per-criterion winners marked.

Full 26-model run: suite pilot-0, methodology pilot-1, last run Oct 22, 2026, scores computed Oct 22, 2026. Quality criteria are scored by an automated Claude vision tier; scores stay provisional until the expert-reviewed suite freeze.

What the data says

The findings that matter if you are integrating AI imagery into a product: where models fall short of production requirements, measured.

Transparency

23 of 26 models fail at transparency

We asked every model for transparent PNGs and measured the alpha channel of what came back. Almost none of it survives contact with a real sticker, merch or cut-out pipeline.

Brand color

No model hits your exact hex

Measured with CIEDE2000 against required brand colors, the best model scores 4.11 of 5 and 16 of 26 land below 3. Close-enough color is not the color in your brand book.

Text

Rendered text: close is not shippable

Eleven models render every required string exactly and misspellings have become rare, while the model famous for text lands twenty-third of 26. Baked-in words still mean regenerating the whole image for a one-word change, unless they are editable layers.

Consistency

No model holds a character across scenes

The same described character drifts between scenes on every model we tested. Series work needs identity as a reusable asset, not a regeneration lottery.

How we score, and why you can trust it

Every criterion is scored by the cheapest tier that is reliable for it. Numbers a machine can measure are measured; judgments that need eyes get them. Methodology is published in full, models get zero special treatment, and scores are never silently restated.

Auto

Measured

Resolution, latency, cost, alpha-channel quality and brand-color drift (CIEDE2000 against the requested hex values): computed from every generation, reproducible from the recorded originals.

VLM

Judged

Prompt adherence checklists and composition checks run through a vision-language judge, calibrated against the expert panel. Pending in the pilot dataset and always labeled as such.

Expert

Rated

Design-readiness and aesthetics come from a blind expert panel: model names hidden, three raters per cell, agreement reported. Arrives with the frozen suite.

AI Editor

No model on this page scores 5/5. Your product still has to.

The IMG.LY AI Editor closes the gap: your users refine whatever a model generates into production quality, with background removal, brand kits and editable text on a real canvas.

IMG.LY AI Editor: generative image tools next to manual editing controls on a canvas