Steering emotion in AI portraits, beyond a smile

You steer emotion in an AI portrait by naming the expression concretely instead of just typing "happy" or "smiling": state the emotion and what it does to the eyes, eyebrows and mouth. That is exactly where the difference sits between a portrait that conveys something and a face with a blank, plastic stare. Below you will read which emotions are recognised everywhere and how to put them in your prompt.

Why "smiling" often gives a blank stare

A smile that only lives in the mouth looks fake, and that is exactly what models tend to produce when you only ask for "smiling". A genuine, spontaneous smile involves not just the corners of the mouth but also the muscle around the eyes (the orbicularis oculi). That is the so-called Duchenne smile: the cheeks rise, the lower eyelids lift and crow's feet appear at the outer corners of the eyes. In a fake or polite smile only the mouth moves and the eyes stay still (according to the Paul Ekman Group).

For your prompt this means: don't ask for "smiling", ask for a smile that reaches the eyes. "Genuine warm smile, eyes slightly crinkled, cheeks raised" points the model at the real version instead of the plastic mouth-arc.

The seven emotions that are recognised everywhere

There is a small set of facial expressions that is recognised the same way worldwide, regardless of culture. Psychologist Paul Ekman arrived at seven universal emotions: happiness, sadness, fear, anger, surprise, disgust and contempt (according to the Paul Ekman Group, which later added contempt to the original six).

Those seven are your most reliable vocabulary. A model is trained on countless photos with these clear expressions, so a single, unambiguous base emotion almost always comes through. Vague or blended moods ("melancholy but hopeful") are much harder. In that case pick one dominant emotion and let the setting or the pose carry the rest.

Where expression lives in the face

You don't read an emotion from the mouth alone, but from three zones together: eyes, eyebrows and mouth. Describe those zones and you steer the expression far more precisely than with a single adjective.

• Eyes: wide open in surprise or fear, slightly narrowed in a genuine laugh, soft and relaxed at rest. The direction of the gaze decides whether someone looks engaged or absent.
• Eyebrows: raised in surprise, drawn together in concentration or anger, the inner ends lifted slightly in sadness.
• Mouth: not just smiling or not, but also the tension in it. A light, asymmetric corner of the mouth looks more natural than a broad, symmetric grin.

Rule of thumb: the subtler the emotion, the more the work sits in the eyes and eyebrows and the less in the mouth.

Prompt building blocks for a believable emotion

Build the expression in three layers, from the emotion down to the detail:

• The base emotion: "quiet confidence", "genuine joy", "mild surprise". Pick one.
• The face to match: "soft eyes, relaxed brow, slight smile" or "wide eyes, raised eyebrows, parted lips".
• The context that supports the emotion: light, posture and gaze direction. "looking just off-camera, warm side light" reinforces a restrained, natural look.

Example: "portrait of a woman, genuine warm smile that reaches the eyes, cheeks slightly raised, relaxed brow, looking at the camera, soft window light".

Unsure how to phrase it? Let a prompt generator write out a version and then adjust the expression words by hand. Generate the same prompt a few times in the photo generator and pick the render where the eyes actually join in.

Keep the emotion subtle and consistent

Don't overdo it: most believable portraits sit on a light to moderate expression, not on a maximum grimace. A full grin or wide-open eyes quickly tip into caricature. If you work with a persona or a reference photo, keep the emotion pointing the same way across images, so your character develops a recognisable temperament instead of a random mood per photo.

Frequently asked questions

Why does my AI smile look fake?

Most likely only the mouth is smiling. A genuine smile also involves the eyes: cheeks up, lower eyelids slightly up, faint crow's feet. Explicitly ask for a smile that "reaches the eyes".

How many emotions can a model reliably render?

The seven universal base emotions (happiness, sadness, fear, anger, surprise, disgust and contempt) come through most clearly. Blended or vague moods are harder. In that case pick one dominant emotion.

Can I change the emotion of an existing photo?

Through image-to-image in the photo generator you generate a new version with a different expression in your prompt. It stays a new image, not an edit of the original.

Emotion is one of the cheapest knobs to turn on your portrait: a few precise words about eyes, eyebrows and mouth change the whole feel. Create an account and test the same scene with a neutral and a genuinely warm expression.