Open Face and emotion Strack et al., 1988

Pen in mouth.

Rate four original cartoons from 0 to 9 while holding a pen in your mouth. One of psychology’s most famous experiments, the story of its failed replication and the number our crowd adds to that story.

3 minto take part 1responses Anonymousno sign-up needed
teethlips
EXP. 058

Can you rate four cartoons with a pen in your mouth?

Loading the experiment… It needs JavaScript to run; you can still read the science box and the article below.

Take part first.

Reading the science could sway your answer. Everything unlocks once you take part, but you can read it now if you prefer.

Back to the experiment
Science box

Can the shape of our face change our feelings a little? The famous pen experiment that tested this came out close to zero in large replications thirty years later, and the story did not end there.

What we measure

We measure whether the shape of your facial muscles affects how funny you find something. Participants are split into two groups using a seed tied to them. One group holds the pen horizontally between the teeth, lips not touching it, which puts the face into a smile-like shape. The other holds the pen with the lips only, pointing forward, teeth not touching it, which makes smiling harder. Nobody is told to smile or to pout. With the pen in your mouth you rate four original cartoons drawn for balabs, in an order shuffled by the seed, from 0 (not funny at all) to 9 (very funny). Then we ask whether you could hold the pen as described, whether you understood the cartoons, and what you think the experiment measures. As in the 17-lab replication, the main comparison leaves out people who could hardly hold the pen, who did not understand the cartoons, or who correctly guessed the purpose; we also show the result for everyone who played with a pen. The measure is the difference between the two groups’ mean ratings and its 95% confidence interval.

What the research says

In the first study of Strack, Martin and Stepper’s 1988 paper, participants holding the pen with their teeth rated cartoons at 5.14 on a 0–9 scale on average, those holding it with their lips at 4.32; a difference of 0.82 points. In 2016, 17 labs repeated the study with the same pre-approved protocol and 1,894 participants, and the difference was 0.03 points (95% confidence interval −0.11 to 0.16). Strack pointed out that participants in the replications were video-recorded; Noah, Schul and Mayo (2018) found the effect without a camera and not with one. A meta-analysis of 138 studies (Coles et al., 2019) found facial feedback effects to be significant but small and variable across conditions. A classroom demonstration with over 400 students across nine semesters (Marsh et al., 2019) reported an effect close to the original. The Many Smiles study (2022), with 3,878 participants from 19 countries, showed that mimicking a smiling face and smiling voluntarily increased happiness, while the evidence for the pen task was less conclusive.

Why it happens

According to the facial feedback idea, emotions are not only reflected in the face; the shape of the face also feeds back into the feeling a little. The pen technique was designed to bring people’s faces closer to a smile without telling them to smile, so that participants could not guess what was being measured and act accordingly. Why the effect sometimes appears and sometimes does not is debated. One explanation is that people rely less on internal cues when they feel observed, so a camera can wipe out the effect. Another is that a pen-induced expression is very different from a real smile and lets a small effect get lost in the noise. The Many Smiles findings fit the second reading: more natural smiling tasks increased happiness, while the pen task did not give an equally clear result.

Limitations

This experiment is done at home and unobserved: nobody checks whether you hold the pen correctly, and we rely only on your report. This differs from the camera-monitored replications, but it also weakens control. The page title names one of the holds, and the questions may hint at the purpose for some participants; that is why we separate people who guessed what the experiment measures from the main comparison. Our cartoons are original drawings; because they differ from the cartoons in the original and the replications, the ratings cannot be compared directly, only the difference between the two groups can. Four cartoons and a single play are far too few for a personal result; an effect can only be seen by comparing the means of the crowd’s two groups. The crowd consists of volunteers and is not a random sample.

5.14 / 4.321988: mean rating with teeth / lips (0–9)Strack et al., 1988
0.03 pointsDifference in the 17-lab replication (1,894 people)Wagenmakers et al., 2016
−0.11 to 0.1695% confidence interval of the replicationWagenmakers et al., 2016
138Studies in the meta-analysisColes et al., 2019
3,878 / 19Many Smiles: participants / countriesColes et al., 2022
  1. Strack, F., Martin, L. L., & Stepper, S. (1988). Inhibiting and facilitating conditions of the human smile: A nonobtrusive test of the facial feedback hypothesis. Journal of Personality and Social Psychology, 54(5), 768–777. View source ↗
  2. Wagenmakers, E.-J., Beek, T., Dijkhoff, L., Gronau, Q. F., Acosta, A., Adams, R. B., Jr., … Zwaan, R. A. (2016). Registered Replication Report: Strack, Martin, & Stepper (1988). Perspectives on Psychological Science, 11(6), 917–928. View source ↗
  3. Strack, F. (2016). Reflection on the smiling Registered Replication Report. Perspectives on Psychological Science, 11(6), 929–930. View source ↗
  4. Noah, T., Schul, Y., & Mayo, R. (2018). When both the original study and its failed replication are correct: Feeling observed eliminates the facial-feedback effect. Journal of Personality and Social Psychology, 114(5), 657–664. View source ↗
  5. Coles, N. A., Larsen, J. T., & Lench, H. C. (2019). A meta-analysis of the facial feedback literature: Effects of facial feedback on emotional experience are small and variable. Psychological Bulletin, 145(6), 610–651. View source ↗
  6. Marsh, A. A., Rhoads, S. A., & Ryan, R. M. (2019). A multi-semester classroom demonstration yields evidence in support of the facial feedback effect. Emotion, 19(8), 1500–1504. View source ↗
  7. Coles, N. A., March, D. S., Marmolejo-Ramos, F., Larsen, J. T., Arinze, N. C., Ndukaihe, I. L. G., … Liuzza, M. T. (2022). A multi-lab test of the facial feedback hypothesis by the Many Smiles Collaboration. Nature Human Behaviour, 6(12), 1731–1742. View source ↗

Making people smile without saying “smile”

Everyone knows that emotions show on our faces. The facial feedback idea reverses the direction: the shape of our face may also change what we feel a little. The difficulty of testing this is obvious: tell someone to “smile” and they will understand what you are measuring and may rate the cartoons as funnier just to help you out.

In 1988 Fritz Strack, Leonard Martin and Sabine Stepper found a clever solution. They asked participants to hold a pen in their mouth, using a cover story that hid the real purpose of the study. One group held the pen with their teeth, unknowingly bringing their face closer to a smile; the other held it with their lips, which made smiling harder.

1988: 5.14 versus 4.32

With the pen in their mouths, participants rated cartoons from 0 (not funny at all) to 9 (very funny). Those holding the pen with their teeth gave 5.14 on average, those holding it with their lips 4.32. The difference of 0.82 points entered textbooks as one of the most elegant pieces of evidence for facial feedback.

By 2016 the study had been cited more than 1,300 times, and the pen technique became the standard way to change facial expressions without telling people what to do. But for years nobody ran an exact repeat of the same experiment; later studies usually used other measures and other setups.

2016: 17 labs, 0.03

In 2016, led by Eric-Jan Wagenmakers, 17 labs repeated Strack’s first study as part of a Registered Replication Report. The protocol was written and approved in advance; cartoons were pre-tested and moderately funny ones were chosen; participants were video-recorded to check that they held the pen correctly. People who guessed the purpose of the study or said they did not understand the cartoons were excluded from the analysis.

When the data of 1,894 participants were combined, the difference was 0.03 points, with a 95% confidence interval from −0.11 to 0.16. The original 0.82 lay far outside that range. The result became one of the symbols of psychology’s replication debate.

The camera: just a detail?

In a commentary published alongside the replication, Strack pointed to two differences: in the replications participants were filmed with a video camera, and the cartoons used might have seemed dated or unfamiliar to participants. Knowing that you are being watched could push people to rely less on their own inner feelings.

Noah, Schul and Mayo (2018) tested this idea directly, running the study once with a camera and once without. Without a camera the facial feedback effect appeared; with a camera it disappeared. This is a single study and does not settle the matter, but it is a nice example of how a small difference in method can change a result.

Many Smiles: a big attempt at agreement

In 2019 Coles, Larsen and Lench published a meta-analysis pooling 138 studies: facial feedback was real, but its effect was small and varied with conditions. Marsh, Rhoads and Ryan (2019) found an effect close to the original in a classroom demonstration with over 400 students across nine semesters.

Then believers and sceptics joined forces to design the Many Smiles study. Data from 3,878 participants in 19 countries showed that mimicking a smiling face and smiling voluntarily could both amplify and initiate happiness. For the pen task, the evidence was less conclusive. So the idea lives on; the famous pen method just may not be the most reliable way to show it.

Our crowd’s share

In this experiment participants are at home and nobody watches them, which in this respect resembles the original more than the camera-monitored replications. On the other hand, without supervision we only know from your report whether you held the pen correctly, and the page title gives away one of the holds. That is why, as in the replication study, we separate people who correctly guessed the purpose and those who failed the check questions from the main comparison.

Our cartoons were drawn for balabs; the ratings cannot be compared directly with ratings of the original cartoons, but the difference between the two groups can. On the results screen we show this difference on the same chart as 1988’s 0.82 and 2016’s 0.03, with its confidence interval. Each new participant adds a small data point to this story.

FAQ

What is the pen experiment?

It is the experiment Strack, Martin and Stepper ran in 1988. People holding a pen with their teeth (face similar to a smile) found cartoons funnier than people holding it with their lips (smiling harder): 5.14 versus 4.32.

Was the effect replicated?

Not in the exact replication. In 2016, 17 labs ran the same experiment with 1,894 people and found a difference of 0.03 points. There is evidence for a broader facial feedback effect, though: in the 2022 Many Smiles study, smiling voluntarily and mimicking a smiling face increased happiness.

Does smiling really make you happier?

It seems to have an effect, but a small and conditional one. A meta-analysis of 138 studies found facial feedback to have a significant but small and variable effect. Expecting a smile on its own to fix a bad day is not realistic.

Why do some participants hold the pen with their lips?

For comparison. The effect cannot be seen in one person; the means of the teeth and lips groups are compared. Your group is chosen at random with a seed tied to you; if you play again you try the other hold.

What if I guessed the purpose of the experiment?

You still see your result, but you are not included in the main comparison. Someone who knows the purpose may, without noticing, give ratings that fit the expectation; the replication study excluded people who guessed for the same reason.

Can I play without a pen?

Yes, you can play without one; a chopstick or a tightly rolled piece of paper also works. Ratings from people who play without a pen are not included in the crowd comparison.

Discussion 0 comments

Join the discussionReading is open to everyone. Volunteer to comment and vote; it takes 20 seconds.
No comments yet.Be the first to write; a good question gets the discussion going.

Threads about this experiment

Start a new thread →
There’s no separate thread for this experiment yet. Start one to critique the method, share a paper or ask a new question.