Benchmark prompts
Typography & Text Rendering

Poster Headline

A concert poster is text-as-content: two exact strings set at two sizes in a real layout. It tests whether a model can render a multi-line headline and subheading correctly and place them in a clean grid, the everyday job behind posters, flyers and social headers.

The exact prompt, sent to every model:
Minimalist concert poster. Large serif headline "MIDNIGHT BLOOM", subheading "Live at The Roxy — June 21", clean grid layout, off-white background, two-color design.
Suite pilot-0 · identical prompt and default parameters for every model · seeds 1111, 2222, 3333 (or repeated samples for seedless APIs)

Results

Click any image to enlarge. Checkerboard backing shows true transparency; a rendered checkerboard pattern inside the image is a model faking it.

FLUX.2

FLUX.2 [pro]

FLUX.2 [dev] Turbo

Gemini 2.5 Flash Image

GPT Image 1.5

Ideogram 3.0

Luma Photon

Nano Banana 2

Nano Banana 2 Lite

Nano Banana Pro

Qwen-Image

Recraft V3

Seedream 4.5

Seedream 5.0 Lite

Stable Diffusion 1.5

What the models actually wrote

Expected text vs the rendered result, character by character. Transcribed by a human reviewer in the pilot; the OCR tier automates this at full-suite scale.

Expected

MIDNIGHT BLOOM Live at The Roxy — June 21

Rendered

  • FLUX.2 · seed 1111 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text strings are rendered exactly and legibly, including the em dash in the subheading. Spelling and punctuation match the prompt precisely with the headline on two stacked lines.
  • FLUX.2 · seed 2222 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y J u n e   2 1 96% match · 4/5 All required text is rendered legibly and accurately. The headline wraps across two lines but spells "MIDNIGHT BLOOM" correctly, and the subheading matches exactly including the em dash.
  • FLUX.2 · seed 3333 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both text elements are legible and spelled exactly as required, including the em dash in the subheading. The headline wraps naturally across two lines but retains the correct wording.
  • FLUX.2 [pro] · seed 1111 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 All required text is rendered legibly and correctly spelled. The headline naturally wraps onto two lines, and the subheading matches exactly including the em dash.
  • FLUX.2 [pro] · seed 2222 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 The rendered text matches the required strings exactly, including the em dash in the subheading. The headline wraps across two lines but reads correctly as "MIDNIGHT BLOOM", and all text is crisply legible.
  • FLUX.2 [pro] · seed 3333 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 All required text is legible and spelled correctly, including the em dash in the subheading. The headline is split across two lines as is typical, and the subheading matches exactly.
  • FLUX.2 [dev] Turbo · seed 1111 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text strings are rendered exactly and legibly, including the em dash in the subheading. Spelling and line breaks match the prompt precisely.
  • FLUX.2 [dev] Turbo · seed 2222 M I D N I G H T B L O O M B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 The subheading matches exactly, including the em dash. The headline is broken: "BLOOM" appears twice (once in black, once overlapping in gold), producing an extra unwanted repetition that deviates from the required "MIDNIGHT BLOOM".
  • FLUX.2 [dev] Turbo · seed 3333 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 The rendered text matches the required text exactly, including the em dash in the subheading. The headline wraps naturally across two lines but spells "MIDNIGHT BLOOM" correctly, and all text is fully legible.
  • Gemini 2.5 Flash Image · sample 1 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text strings are rendered exactly and legibly, including the em dash in the subheading. Spelling and punctuation match the prompt precisely.
  • Gemini 2.5 Flash Image · sample 2 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text strings are rendered exactly and legibly, including the em dash in the subheading. Spelling and punctuation match the prompt precisely.
  • Gemini 2.5 Flash Image · sample 3 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 The headline is rendered exactly as required, wrapping across two lines which is acceptable. The subheading matches exactly including the em dash and correct date. All text is crisp and legible.
  • GPT Image 1.5 · sample 1 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text strings are rendered exactly and legibly, including the em dash in the subheading. Spelling and punctuation match the prompt precisely with no errors.
  • GPT Image 1.5 · sample 2 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 The text is rendered exactly as required with correct spelling and the em dash intact. Both the headline and subheading are fully legible and match the specification.
  • GPT Image 1.5 · sample 3 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 D O O R S   8 P M           T I C K E T S   $ 2 0 100% match · 5/5 The required headline and subheading are rendered exactly and legibly, including the em dash. Additional supporting text ("DOORS 8PM", "TICKETS $20") appears but does not conflict with the required text.
  • Ideogram 3.0 · seed 1111 M i d n i g h t   B l o o m L i v e   a t   t h e   R o x y     J u n e   2 1 100% match · 5/5 The text is fully legible and matches the required strings in content, though the headline is rendered in mixed case ("Midnight Bloom") rather than all-caps, and the subheading uses lowercase "the" instead of "The". Spelling and the em dash are otherwise correct.
  • Ideogram 3.0 · seed 2222 M i d n i g h t B l o o m L i v e   a t   t h e   R o x y     J u n e   2 1 98% match · 4/5 The headline text matches "Midnight Bloom" though rendered in title case rather than all-caps, and it breaks across two lines. The subheading matches "Live at the Roxy – June 21" accurately. All text is legible and spelled correctly.
  • Ideogram 3.0 · seed 3333 M i d n i g h t   B l o o m L i v e   a t   t h e   R o x y     J u n e   2 1 100% match · 5/5 All required words are rendered legibly and spelled correctly, including the em dash and date. The text uses mixed-case serif styling rather than the all-caps requested for the headline, but the wording matches exactly.
  • Luma Photon · seed 1111 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text strings are rendered exactly and legibly, including the em dash in the subheading. Spelling and punctuation match the prompt with no errors.
  • Luma Photon · seed 2222 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text elements are rendered exactly and legibly, including the em dash in the subheading. Spelling and punctuation match the prompt precisely.
  • Luma Photon · seed 3333 M I D N I G H T B I O O M B L O O I L i v e   a t   T h e   R o x y   J u n e   2 1 95% match · 4/5 The subheading 'Live at The Roxy — June 21' is rendered accurately and legibly. The headline is badly distorted and duplicated across rows, producing garbled fragments instead of a clean 'MIDNIGHT BLOOM'.
  • Nano Banana 2 · sample 1 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 D O O R S   8 : 0 0   P M   |   S H O W   9 : 0 0   P M   |   A L L   A G E S T H E   R O X Y   T H E A T R E   |   9 0 0 9   S U N S E T   B L V D   |   W E S T   H O L L Y W O O D ,   C A 100% match · 5/5 Both required text strings render exactly: "MIDNIGHT BLOOM" and "Live at The Roxy — June 21" with the correct em dash. Additional legible details (doors/show times, venue, address) are consistent and correctly spelled.
  • Nano Banana 2 · sample 2 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 T H E   R O X Y   T H E A T R E ,   L O S   A N G E L E S ,   C A D O O R S   8   P M     S H O W   9   P M S P E C I A L   G U E S T S :   T H E   N I G H T I N G A L E S   &   L U N A   W A V E S T I C K E T S :   $ 3 5   A D V   /   $ 4 0   D O S     A L L   A G E S T I C K E T S   A V A I L A B L E   A T   T H E   R O X Y   B O X   O F F I C E   &   A X S . C O M D E S I G N E D   B Y   C O L L E C T I V E   E C H O M I D N I G H T   B L O O M   ©   2 0 2 4 100% match · 5/5 Both required text strings are rendered exactly and legibly, including the em dash in the subheading. Spelling and punctuation match the prompt precisely, with additional supporting text rendered cleanly.
  • Nano Banana 2 · sample 3 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 D a t e / T i m e J u n e   2 1 8 : 0 0   P M V e n u e T h e   R o x y 9 0 0 9   S u n s e t   B l v d , W e s t   H o l l y w o o d T i c k e t s T i c k e t s $ 2 5   A d v   /   $ 3 0   D a y   o f m i d n i g h t b l o o m . c o m 100% match · 5/5 Both required text strings render exactly and legibly: "MIDNIGHT BLOOM" and "Live at The Roxy — June 21" with the proper em dash. Additional footer text is accurate and well-rendered, with a minor duplicated "Tickets" label that does not affect the required text.
  • Nano Banana 2 Lite · sample 1 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 D O O R S   8 : 0 0   P M       1 8 +   E V E N T S H O W   9 : 0 0   P M       T I C K E T S   $ 3 0   A D V W W W . M I D N I G H T B L O O M . C O M 100% match · 5/5 The required text "MIDNIGHT BLOOM" and "Live at The Roxy — June 21" are both rendered exactly and legibly, including the em dash. Additional supporting text is also clean and correctly spelled.
  • Nano Banana 2 Lite · sample 2 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 D O O R S   7 : 0 0   P M   S H O W   8 : 0 0   P M T H E   A E R I A L I S T S   N I G H T   O W L S G E N E R A L   A D M I S S I O N   $ 3 5   A D V   |   $ 4 5   O T D T I C K E T S   &   I N F O :   M I D N I G H T B L O O M . C O M T H E   R O X Y   T H E A T R E     L O S   A N G E L E S 100% match · 5/5 The required text "MIDNIGHT BLOOM" and "Live at The Roxy — June 21" both render exactly and legibly, including the em dash. All additional text is clean and correctly spelled.
  • Nano Banana 2 Lite · sample 3 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 L i v e   a t   T h e   R o x y     J u n e   2 1 D O O R S   8 : 0 0   P M       S H O W   9 : 0 0   P M       T I C K E T S   $ 2 5 T H E   R O X Y   T H E A T R E     9 0 0 9   W .   S U N S E T   B L V D ,   W E S T   H O L L Y W O O D M I D N I G H T B L O O M . C O M   |   @ M I D N I G H T B L O O M   |   A L L   A G E S 100% match · 5/5 Both required text elements render exactly and legibly, with correct spelling and the proper em dash. The subheading is duplicated on two lines, which is a minor redundancy but does not violate the checklist requirement.
  • Nano Banana Pro · sample 1 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text elements are rendered exactly and legibly, including the em dash in the subheading. Spelling and punctuation match the prompt precisely with no errors or broken line breaks.
  • Nano Banana Pro · sample 2 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 w i t h T h e   Q u i e t   O n e s , S u n   A t l a s , &   L o m a . 100% match · 5/5 Both required texts render exactly and legibly: "MIDNIGHT BLOOM" as the headline and "Live at The Roxy — June 21" as the subheading with the correct em dash. Additional band credit text is present but does not detract from the required strings.
  • Nano Banana Pro · sample 3 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 A r t i s t   O n e A r t i s t   T w o A r t i s t   T h r e e D o o r s   8   P M   /   2 1 +   /   T i c k e t s   a t   t h e r o x y . c o m 100% match · 5/5 Both required text strings are rendered exactly and legibly, including the em dash in the subheading. Additional supporting text (artist names and details) is also clean and correctly spelled.
  • Qwen-Image · seed 1111 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 All required text is legibly rendered and spelled correctly, with the headline stacked over two lines and the subheading including the em dash. Nothing is missing or misspelled.
  • Qwen-Image · seed 2222 M I I D N G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 93% match · 4/5 The headline is misspelled: "MIIDNGHT" instead of "MIDNIGHT" (doubled I and missing I before GHT). The subheading "Live at The Roxy — June 21" is rendered correctly and legibly.
  • Qwen-Image · seed 3333 M I D N I G H T   B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text strings are rendered exactly and legibly, including the em dash in the subheading. The headline is stacked over two lines as "MIDNIGHT" / "BLOOM" but remains correct.
  • Recraft V3 · seed 1111 M I D N I G H T   B L O O M L I V E   A T   T H E   R O X Y   J U N E   2 1 96% match · 4/5 The headline is rendered correctly and legibly. The subheading is all caps rather than title case and omits the em dash before the date, so it deviates from the required "Live at The Roxy — June 21".
  • Recraft V3 · seed 2222 M I D N I G H T   B L O O M l i v e   a t   t h e   R O X Y J u n e   2 1 96% match · 4/5 The headline is rendered exactly and legibly. The subheading deviates from the required text: it reads "live at the ROXY / June 21" across two lines instead of "Live at The Roxy — June 21," with different capitalization and no em dash separator.
  • Recraft V3 · seed 3333 M I D N I G H T   B L O O M L I V E   A T   T H E   R O X Y   J U N E   2 1 96% match · 4/5 The headline is rendered exactly and legibly. The subheading is rendered in all caps without the required em-dash and case, appearing as "LIVE AT THE ROXY JUNE 21" instead of "Live at The Roxy — June 21".
  • Seedream 4.5 · seed 1111 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 Both required text strings are rendered exactly and legibly, with the headline stacked on two lines and the correct em dash in the subheading. No misspellings or broken characters are present.
  • Seedream 4.5 · seed 2222 M I D N I G H T B L O O M L i v e   a t   T h e R o x y     J u n e   2 1 100% match · 5/5 All required text is rendered legibly and correctly spelled, including the em dash in the subheading. The line breaks split the words across lines but the content matches the prompt exactly.
  • Seedream 4.5 · seed 3333 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y     J u n e   2 1 100% match · 5/5 All required text is rendered exactly and legibly, including the em dash in the subheading. The headline is split across two lines but spells "MIDNIGHT BLOOM" correctly. No misspellings present.
  • Seedream 5.0 Lite · seed 1111 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y J u n e   2 1 96% match · 4/5 The headline is rendered correctly and legibly. The subheading is split onto two lines and omits the em dash ("—") that the prompt required, so it deviates from the exact target text.
  • Seedream 5.0 Lite · seed 2222 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y J u n e   2 1 96% match · 4/5 The headline is rendered correctly and legibly. The subheading omits the em dash and splits into two lines, so it does not match the required exact string "Live at The Roxy — June 21".
  • Seedream 5.0 Lite · seed 3333 M I D N I G H T B L O O M L i v e   a t   T h e   R o x y J u n e   2 1 96% match · 4/5 The headline matches exactly. The subheading is legible but split across two lines and drops the em-dash, so it does not exactly match the required "Live at The Roxy — June 21".
  • Stable Diffusion 1.5 · seed 1111 M U V S A V . 1 0 G X Y R U L Y     J U X T H     O O U I N 8 1 2   8 3 8 3 L I V I E   M R B U N I M 32% match · 1/5 The required text "MIDNIGHT BLOOM" and "Live at The Roxy — June 21" is entirely absent; instead the image shows gibberish like "MUVS", "LIVIE MRBUNIM", and random characters. The text is illegible garble and does not match the requirement at all.
  • Stable Diffusion 1.5 · seed 2222 M L E A T   L I / D E G T   2 2 1   J U Y   M U N Y   2 1 37% match · 1/5 The rendered text is scrambled and does not match "MIDNIGHT BLOOM" or "Live at The Roxy — June 21" in any legible way. Only random letter clusters appear, so the required text failed entirely.
  • Stable Diffusion 1.5 · seed 3333 M . . . I I . . . N   ( g a r b l e d ) I U N I N E B U C R V E M N G E   S C I   I R L V O   W L A 4 0 0   2 3   3 9 R J K Y U K 28% match · 1/5 The required text "MIDNIGHT BLOOM" and "Live at The Roxy — June 21" is not legibly rendered; instead the image shows scrambled, meaningless letter and number sequences. No accurate wording is present.

Inspect the letterforms

FLUX.2: Poster Headline, magnified detail
FLUX.2
FLUX.2 [pro]: Poster Headline, magnified detail
FLUX.2 [pro]
FLUX.2 [dev] Turbo: Poster Headline, magnified detail
FLUX.2 [dev] Turbo
Gemini 2.5 Flash Image: Poster Headline, magnified detail
Gemini 2.5 Flash Image
GPT Image 1.5: Poster Headline, magnified detail
GPT Image 1.5
Ideogram 3.0: Poster Headline, magnified detail
Ideogram 3.0
Luma Photon: Poster Headline, magnified detail
Luma Photon
Nano Banana 2: Poster Headline, magnified detail
Nano Banana 2
Nano Banana 2 Lite: Poster Headline, magnified detail
Nano Banana 2 Lite
Nano Banana Pro: Poster Headline, magnified detail
Nano Banana Pro
Qwen-Image: Poster Headline, magnified detail
Qwen-Image
Recraft V3: Poster Headline, magnified detail
Recraft V3
Seedream 4.5: Poster Headline, magnified detail
Seedream 4.5
Seedream 5.0 Lite: Poster Headline, magnified detail
Seedream 5.0 Lite
Stable Diffusion 1.5: Poster Headline, magnified detail
Stable Diffusion 1.5

Move the cursor over any image: all panels magnify the same spot at 3× so letterforms and fine detail compare directly.

Run-to-run consistency

Same model, same prompt, different seed or sample. Click a card to flip between the two generations: the less it moves, the safer the model is for templated, variable-data production.

Scores

Mean per model across this prompt's runs. Auto-measured criteria plus an interim Claude-VLM tier for prompt adherence and composition; any criterion still awaiting review is labeled pending, never zeroed.
  Text Accuracy Prompt Adherence Resolution Latency Cost
FLUX.2 4.7 / 5 5.0 / 5 2.0 / 5 4.0 / 5 4.0 / 5
FLUX.2 [pro] 5.0 / 5 5.0 / 5 2.0 / 5 2.7 / 5 4.0 / 5
FLUX.2 [dev] Turbo 5.0 / 5 4.7 / 5 2.0 / 5 4.3 / 5 4.0 / 5
Gemini 2.5 Flash Image 5.0 / 5 5.0 / 5 3.0 / 5 3.0 / 5 4.0 / 5
GPT Image 1.5 5.0 / 5 5.0 / 5 3.0 / 5 1.0 / 5 3.0 / 5
Ideogram 3.0 4.7 / 5 4.3 / 5 3.0 / 5 1.7 / 5 3.0 / 5
Luma Photon 4.7 / 5 4.3 / 5 4.0 / 5 2.0 / 5 4.0 / 5
Nano Banana 2 5.0 / 5 5.0 / 5 3.0 / 5 2.0 / 5 3.0 / 5
Nano Banana 2 Lite 5.0 / 5 5.0 / 5 3.0 / 5 4.0 / 5 4.0 / 5
Nano Banana Pro 5.0 / 5 5.0 / 5 3.0 / 5 1.0 / 5 1.0 / 5
Qwen-Image 4.7 / 5 4.3 / 5 2.0 / 5 1.0 / 5 4.0 / 5
Recraft V3 4.0 / 5 3.0 / 5 3.0 / 5 2.7 / 5 4.0 / 5
Seedream 4.5 5.0 / 5 5.0 / 5 5.0 / 5 2.0 / 5 4.0 / 5
Seedream 5.0 Lite 4.0 / 5 4.0 / 5 5.0 / 5 1.0 / 5 4.0 / 5
Stable Diffusion 1.5 1.0 / 5 0.3 / 5 1.0 / 5 1.0 / 5 5.0 / 5

Frequently asked questions

Image generation is stochastic: the same prompt produces different images on every run, so a single sample measures luck, not ability. Every model runs each benchmark three times with fixed seeds (1111, 2222, 3333), or three unseeded samples where the API accepts no seed. Scores average all three samples, and the consistency benchmarks measure the variation itself.

Yes. Every model receives the same prompt text with default parameters and no per-model tuning, so differences in output reflect the model, not prompt engineering. The suite is versioned and prompts are append-only, which keeps historical scores comparable.

The results on this page are scored on this exact prompt, so the strongest model for it is easy to spot; this benchmark sits in the Typography & Text Rendering category. Scores are per model version and reflect this benchmark only. For a ranking across every benchmark see the model rankings, and to weight the numbers by a specific job see the use-case pages.

Each image is scored 0 to 5 per criterion. Measured criteria (resolution, latency, cost, transparency, color accuracy) are computed automatically; quality criteria (text accuracy, prompt adherence, composition) are judged by an automated Claude vision tier against each prompt’s checklist. Page scores are unweighted means over all of a model’s runs in that scope. Blind expert-panel review has not run yet; the dataset is pilot-0.

Model output is a starting point, not a finished asset. Production work usually needs background removal, exact brand colors or editable text, none of which generation guarantees on every run. The IMG.LY AI Editor gives your users those controls to refine any model’s output to production quality.

The suite re-runs on notable model releases so the rankings stay current. The results shown are the pilot-0 dataset, scored by measured criteria plus an automated Claude vision tier, with blind expert review planned. Prompts are versioned and append-only, so scores stay comparable across runs.