So I'm doing this research interview where I ask people to generate images. Is that even a legit method?

In a research interview, having participants generate AI images on the spot to express their ideas—supposedly more intuitive than describing them—sounds clever on paper. But after actually running a round, you realize the pitfalls. First, participants can’t write prompts, so the images end up reflecting the model’s biases, not what’s in their head.

You think you’re capturing their needs, but really you’re just getting SD’s default aesthetic. Second, generation has lag and randomness, so people tweak their intentions to fit the model, and the interview gets hijacked by the tool.

If I have to use it, I usually let the participant describe verbally first, then I help adjust the prompts on the side, treating image generation as a confirmation tool, not a collection tool. It works as a validation method, but you gotta be super careful using it as primary data source.

“OP not knowing how to write prompts is way too real. What comes out is just SD’s default aesthetic, not the image in their head.”

I tried a round of it, and people really do change what they want just to fit the model. The interview totally went off track.

Once you’ve confirmed the tool works, you just sit next to them and help tweak it, turning their verbal descriptions into actual images to show them—that’s the right direction.

Once you start working with raw data, you’re in dangerous territory. What you’re actually capturing is the model’s bias, not real user demand.

Bookmarked.