What is it about?

We build an AI "archipelago" of art islands, each seeded with any starting cue - an artist, movement, or theme - and then left to run hands-off. A nature-inspired genetic island algorithm evolves the diffusion model's (image generator's) hidden parameterization (the prompt embeddings) to grow diverse image populations. Islands occasionally trade images, letting stylistic traits migrate and shape future "children", echoing how artists influence one another. Quality is guided lightly by an aesthetics neural network, and we log lineages and style maps to show how traits emerge and blend. The goal is open-ended discovery, not a single best picture.

Featured Image

Why is it important?

What is unique and timely here is shifting from prompt engineering usually done by humans to evolving the model's hidden parametrization (the prompt embeddings) automatically. Because these inputs are high-dimensional and numerical, humans would not be able to work with them efficiently, but machines are excellent in this. An evolutionary algorithm mixes, mutates and changes this parametrization to create novel image results over time leaving the human to only define an initial starting point. This technique allows not only exploration but also optimization in the image generation domain.

Perspectives

As image generators, especially diffusion models, have become remarkably powerful, prompt-based control still feels narrow. Evolutionary algorithms open a practical way to explore the vast, hidden parameter space, enabling systematic discovery and refinement at scale. Beyond exploration, this approach can actually find images that would not normally be producable by prompting. Furthermore the evolutionary technique can auto-optimize images to fulfill any criteria - especially useful in the evaluation of image model biases. In another paper "Evolving the Embedding Space of Diffusion Models" we use this technique to find out which biases an aesthetics predictor model has by finding high scoring images through evolutionary improvement.

Marcel Salvenmoser
Fachhochschule Hagenberg

Read the Original

This page is a summary of: Open-Ended Evolution of Artistic Styles in Diffusion Models via Island-Based Genetic Algorithms, July 2025, ACM (Association for Computing Machinery),
DOI: 10.1145/3712255.3734290.
You can read the full text:

Read

Resources

Contributors

The following have contributed to this page