Open Memory Deese, 1959

False memory.

Read four short word lists, then say which words were on them. Each list hides a word: every word on the list points to it, but it is never shown. Will your memory add it?

3 minto take part 0responses Anonymousno sign-up needed
bedrestawaketireddreamwakesnoozesleep?not on the list
EXP. 053

Could you remember a word you never saw, vividly enough to be sure you saw it?

Loading the experiment… It needs JavaScript to run; you can still read the science box and the article below.

Take part first.

Reading the science could sway your answer. Everything unlocks once you take part, but you can read it now if you prefer.

Back to the experiment
Science box

People who read a list of related words often 'remember' a word that was never on the list but that all of them point to, as often and as confidently as the words they actually read.

What we measure

We measure false recognition with the Deese–Roediger–McDermott (DRM) method. You read four lists drawn from a pool of six; each list is the ten strongest associates of a 'hidden word' that never appears (for example bed, rest, awake, tired… but not 'sleep'). Words appear on screen one at a time for 1.1 seconds, with a 0.25-second gap. Then comes a 16-word recognition test: two words from each list you read (the first word on the list and one of the first six), the four hidden words, and the hidden word and first word of the two lists you did not read (unrelated words). You answer each with a four-point rating: definitely there (4), probably there (3), probably not (2), definitely not (1). A 3 or 4 counts as 'there'. Score: hits ('there' for a word you read) minus false alarms ('there' for a word you did not read), from −8 to 8. The lists, test words and order come from the game seed. The English lists are taken from the norms of Stadler, Roediger and McDermott (1999); the Turkish lists from those built by Akdoğan, Akırmak and Gürsoy (2020) from Turkish association norms (Tekcan & Göz 2005).

What the research says

Deese (1959) noticed that in free recall after association lists, a particular word that had not been on the list often crept in. Roediger and McDermott (1995) rediscovered the finding. In their first experiment, participants who heard six 12-word lists 'recalled' the hidden words 40% of the time; on a later recognition test they said 'there' to 86% of the words they had heard, 84% of the hidden words and 2% of unrelated words, and for 58% of the hidden words they were 'sure'. Stadler, Roediger and McDermott (1999) published norms for 36 lists: false recall of the hidden word ranged from 10% to 65% across lists and false recognition from 27% to 84%; the strongest was the 'window' list. With Turkish lists, Akdoğan, Akırmak and Gürsoy (2020) found 'there' responses of 83% for studied words, 71% for hidden words and 6% for unrelated words; the lists producing the most errors were 'sleep', 'shirt', 'flag', 'cold' and 'window'.

Why it happens

Two main explanations are usually given together. In the first, each word on the list spontaneously activates the hidden word in the network of meanings; later, the source of that inner activation cannot be told apart, and the word is taken to have been 'seen'. In the second, memory stores the gist of a list as well as its details ('a list about sleep'); as the detail fades, answers drift towards words that fit the gist. Reviewing fifteen years of DRM research, Gallo (2010) stressed that the illusion arises not from a single process but from several, sometimes opposing ones. The key point is this: it is not a slip of attention but a by-product of a healthy memory that stores meaning.

Limitations

In Roediger and McDermott's study and in Akdoğan and colleagues' study, there was a free recall test after each list before the recognition test; because recall can increase false recognition, our rates may come out somewhat lower. We show the words in writing rather than reading them aloud, and our lists have 10 words (the originals had 12 and 15). In the Turkish lists we followed the norm order but skipped a few words that appear in another list or do not stand naturally on their own. People who know this experiment look out for the hidden word; that is why we ask after the test whether you have seen it before and show those people separately in the crowd results. Sixteen words are too few to establish a personal tendency with confidence.

86% / 84% / 2%'There' for studied / hidden / unrelated words (recognition, Exp. 1)Roediger & McDermott, 1995
58%'Sure' for hidden wordsRoediger & McDermott, 1995
40% / 55%Free recall of the hidden word (12- / 15-word lists)Roediger & McDermott, 1995
84% / 27%False recognition: strongest of 36 lists ('window') / weakestStadler et al., 1999
83% / 71% / 6%Turkish lists: studied / hidden / unrelatedAkdoğan et al., 2020
  1. Deese, J. (1959). On the prediction of occurrence of particular verbal intrusions in immediate recall. Journal of Experimental Psychology, 58(1), 17–22. View source ↗
  2. Roediger, H. L., III, & McDermott, K. B. (1995). Creating false memories: Remembering words not presented in lists. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21(4), 803–814. View source ↗
  3. Stadler, M. A., Roediger, H. L., III, & McDermott, K. B. (1999). Norms for word lists that create false memories. Memory & Cognition, 27(3), 494–500. View source ↗
  4. Gallo, D. A. (2010). False memories and fantastic beliefs: 15 years of the DRM illusion. Memory & Cognition, 38(7), 833–848. View source ↗
  5. Akdoğan, M., Akırmak, Ü., & Gürsoy, İ. (2020). Türkçe kelimelerin bellek yanılması üretme oranlarının Deese-Roediger-McDermott (DRM) paradigması ile incelenmesi [Examining the false memory rates of Turkish words with the Deese-Roediger-McDermott (DRM) paradigm]. Türk Psikoloji Yazıları, 23(46), 31–54. View source ↗

Remembering something that never happened

Imagine a friend describing a wedding to you: bride, groom, cake, dancing, music… A few days later you may be sure they also mentioned the 'registrar', even though they never did. Memory does not work like a camera keeping a record of events; it stores meaning and fills the gaps with the most likely pieces. Most of the time that serves us well; sometimes it keeps a detail that never happened alive as a vivid memory.

In this experiment you read four short word lists. Each list is made up of associates of a word that never appears on it. In the test that follows you say whether words were on the lists and how sure you are. This is one of the most widely used methods for studying false memories in psychology: Deese–Roediger–McDermott, or DRM for short.

From Deese to Roediger and McDermott

In 1959 James Deese noticed something curious in free recall after word lists: after certain lists, people often wrote down a particular word that had not been on the list. The finding attracted little attention for a long time. In 1995 Henry Roediger and Kathleen McDermott took it up again and turned it into one of the basic methods of false memory research.

In their first experiment, participants heard six 12-word lists ('bed, rest, awake, tired, dream…' but no 'sleep') and wrote down what they remembered after each one. The hidden words were 'recalled' 40% of the time, about as often as real words from the middle of the lists. On the later recognition test, people said 'there' to 86% of the words they had heard and 84% of the hidden words, but to only 2% of words unrelated to the lists. More strikingly, for 58% of the hidden words people said they were sure.

Do you remember, or do you know?

In their second experiment Roediger and McDermott used longer, 15-word lists, and free recall of the hidden words rose to 55%. On the recognition test they asked participants to distinguish two kinds of experience for words they called 'old': 'remember' if they could mentally relive the moment the word was spoken, 'know' if they simply knew it had been there.

The result showed that false memories are not just guesses: people often said 'remember' for words they had never heard, reporting that they relived the moment they heard them. The authors summed up their paper with the line: people remember events that never happened. We do not ask 'remember or know' in this experiment, but the four-point confidence rating shows something similar: how often you say 'definitely there' to a hidden word.

Not every list is the same

In 1999 Michael Stadler, Roediger and McDermott published norms for 36 lists. All of them had been built to produce false memories, but their effects varied enormously: the share of people who freely 'recalled' the hidden word was 10% for the weakest list and 65% for the strongest, and false recognition ranged from 27% to 84%. The strongest was the 'window' list: after door, glass, pane, sill… 84% of people later said they had heard 'window' too. For people playing in English we chose lists from these norms.

In Turkish, in 2020 Meliscan Akdoğan, Ümit Akırmak and İdil Gürsoy built ten lists from Turkish association norms (Tekcan & Göz 2005). On their recognition test people said 'there' to 83% of studied words, 71% of hidden words and 6% of unrelated words. Again the lists differed greatly in strength: 'sleep', 'shirt', 'flag', 'cold' and 'window' produced the most errors, 'police' the fewest. For people playing in Turkish we use the five strongest of these lists and the 'car' list.

Why do we fall for it?

Two explanations are often given. In the first, every word on the list spontaneously activates the hidden word in the network of meanings; 'sleep' may well have crossed your mind as you read. Later, on the test, you cannot tell the source of that inner activation apart: did you see the word, or only think it? In the second, memory stores the gist of a list as well as its details: 'a list about sleep'. As the details fade, every word that fits the gist feels familiar.

Reviewing fifteen years of DRM research in 2010, David Gallo stressed that the illusion arises not from a single process but from several, sometimes opposing ones. He also reported that individual differences in susceptibility to this laboratory illusion have been linked to everyday errors such as misremembering public events. One important point: the DRM illusion is not a sign of carelessness or weakness. It is a by-product of a healthy memory that stores meaning and gist and can generalise.

What your score does and does not tell you

Your score is the number of the eight studied words you recognised, minus the number of the eight unstudied words (four hidden, four unrelated) you said were there; it runs from −8 to 8. It weighs hits against false alarms and sums up your result at a glance; it is not meant for rankings or races. The real result of the experiment is how often you said 'there' to the hidden words and how confident you were: falling for the hidden words while hardly ever falling for the unrelated ones shows that the error is not random but comes from meaning.

When you compare your result with laboratory values, keep the differences in mind: in the original experiments there was free recall after each list, which can increase false recognition, while we go straight to the recognition test. The words are written rather than spoken, and the lists are shorter. Because people who know the experiment will look out for the hidden word, we ask about this after the test and show them separately in the crowd. Your first game is the one kept in the scientific data; if you play again, you will know the trick and the result will be different.

FAQ

What is the DRM method?

It is a false memory method named after Deese (1959) and Roediger and McDermott (1995). Participants read or hear lists made up of associates of a word that is not on the list; afterwards they often 'remember' that hidden word about as often as the words they actually studied.

How is my score calculated?

The number of the eight studied words you said were there (hits) minus the number of the eight unstudied words you said were there (false alarms). 'Definitely there' and 'probably there' both count as 'there'. The score runs from −8 to 8.

I fell for the hidden word; is my memory bad?

No. Roediger and McDermott's (1995) participants said 'there' to 84% of the hidden words. The illusion is seen as a by-product of a healthy memory that stores meaning and gist; Gallo (2010) stresses that several processes play a part together.

Which lists fool people most?

In the 36-list norms of Stadler, Roediger and McDermott (1999), false recognition was 27% for the weakest list and 84% for the strongest ('window'). In Turkish, Akdoğan and colleagues (2020) found that the 'sleep', 'shirt', 'flag', 'cold' and 'window' lists produced the most errors.

I already knew the experiment; does my result count?

People who know it can look out for the hidden word, so they usually fall for it less. After the test we ask whether you have seen the experiment before, and in the crowd results we show first-timers and people who knew it separately.

Why is there no race or leaderboard?

This experiment only means something when you take it once, unaware: after you have learned the hidden words, it is no longer the same test. So there are no race rooms, challenges or leaderboard; in sessions it can be added as a solo test that everyone takes on their own. Your first game is the one kept in the scientific data; you can replay, but the result then measures something else.

Discussion 0 comments

Join the discussionReading is open to everyone. Volunteer to comment and vote; it takes 20 seconds.
No comments yet.Be the first to write; a good question gets the discussion going.

Threads about this experiment

Start a new thread →
There’s no separate thread for this experiment yet. Start one to critique the method, share a paper or ask a new question.