What Is the Testing Effect?


5 min read≈ 1,210 words3 questions · up to 3 points
What this is about
Students who read a text four times feel sure they will remember it, and a week later they remember less than students who read it once. You learn what those other students did instead, why it works, why rereading feels more useful than it is, and when testing yourself stops helping.
In a nutshell· skip ahead
The testing effect is the finding that trying to recall what you have learned makes you remember it longer than studying it again for the same time. A test is not only a way to measure memory but a way to strengthen it. The method that uses this is called retrieval practice: closing the book and trying to recall the content, then checking.
In a study published in 2006, two psychologists in St. Louis gave students a short text about sea otters to learn. Some students read it four times and felt sure they would remember it. Other students read it only once and then wrote down three times what they could remember, with no chance to look back. A week later, the students who had read less remembered much more. How can less reading lead to more learning?
What is the testing effect?
The testing effect is the finding that trying to recall what you have learned makes you remember it longer than studying it again for the same amount of time. A test does not only measure what is in your memory; the act of recalling also makes the memory last. Psychologists call the method that uses this retrieval practice: you close the book, try to bring the content back from memory, and only then check.
The testing effect is about what you do when you come back to material. When you come back is a different question, answered in What Is Spaced Repetition?: reviews spread over days beat reviews packed into one evening, and the two ideas work best together.
How did one experiment show it?
The clearest demonstration comes from Henry Roediger and Jeffrey Karpicke at Washington University in St. Louis. Their second experiment, published in 2006, had 180 students and went like this.
- The material. Each student learned one passage of fewer than 300 words, either on the sun or on sea otters, taken from a test-preparation book for English as a foreign language.
- Three ways to use four learning periods. The reading group read the passage four times. A mixed group read it three times and then wrote down on a blank sheet all they could recall, and a recall group read it once and then recalled it in writing three times. Nobody was told what they had got right or wrong.
- The students’ own forecast. Afterwards, everyone rated how well they would remember the passage in a week, and the reading group was the most confident.
- A test five minutes later. The readers were ahead: they recalled 83 percent of the passage, the mixed group 78 percent and the recall group 71 percent.
- A test one week later. Now the order reversed, with 40 percent for the readers, 56 percent for the mixed group and 61 percent for the recall group.
The surprising part is how little reading the winners did: the reading group got through the passage about 14 times, the recall group about three and a half times. Measured against what each group knew at the end of learning, the readers forgot about half of it within the week and the recall group about a seventh.
Testing is a powerful means of improving learning, not just assessing it.
Why should recalling work better than reading, when reading shows you all of the text? The best-supported answer is that the effort of searching memory is what strengthens it. When you reread, the answer is in front of you, but when you recall, you have to find it yourself, and that search makes the memory easier to find the next time. A 2014 meta-analysis by Christopher Rowland, which combined 159 comparisons of testing with restudying, supports this role of effort, although researchers still debate the details. Recall also shows you what you cannot remember yet, so you know where to spend the next session.
What the testing effect teaches you
The general lesson is to practise the act you will need later: if you will have to recall something in an exam or a meeting, prepare by recalling it, not by looking at it again. Step 3 of the experiment adds a warning, because the feeling that you know something after rereading is a poor guide to what you will remember.
- Studying. After reading a chapter, close it, write down what you remember on a blank page, then compare with the book. Flashcards work the same way if you answer before you turn the card. In a 2011 study with 200 students, Karpicke and Janell Blunt found that this kind of recall beat drawing concept maps, also on questions that required inference.
- Work and talks. Before a presentation, give it aloud without notes and then check the notes for what you left out, instead of reading the slides again.
- Teaching. A short, ungraded quiz on last week’s material makes every student in the room recall it. A 2013 review of study methods by John Dunlosky and colleagues rated practice testing and spacing as the two most useful techniques and rereading as one of the least useful.
The same logic works for experience. If you look back at a project with the questions of What Is an After-Action Review?, answer them from memory before you open your notes, so that the review also makes you recall what you learned.
When does testing yourself not help?
The most common mistake is to think that any test helps, however it goes. Rowland found that when people recalled half of the material or less and got no feedback, the test gave no reliable benefit, while tests with feedback gave the largest benefits. So read the material carefully once before you test yourself, and always check your answers afterwards.
A second mistake is to treat “testing” as grading. The research is about low-stakes practice, where a wrong answer costs nothing, and it does not show that more graded exams improve a school.
The evidence also has limits. Most experiments used word lists, facts and short texts, and there is much less research on solving new kinds of problems. The effect varies a lot between studies, and Rowland noted that unpublished studies tended to find smaller effects, but the core finding has been repeated many times. Rowland’s average effect was about half a standard deviation, which would move an average student to about the 69th percentile of the class. A second meta-analysis by Olusola Adesope and colleagues in 2017, which included classroom studies, found practice tests better than restudying and every other method they were compared with.
Learn more
The testing effect has no single discoverer: the psychologist E. E. Abbott studied it in 1909, and in 1917 Arthur Gates showed that schoolchildren from the first to the eighth grade remembered nonsense syllables and short biographies better when they spent part of their study time reciting them from memory. Herbert Spitzer confirmed the idea in 1939 with sixth-graders in Iowa schools. The topic stayed little known outside memory research until Roediger and Karpicke’s 2006 experiments with school-like texts brought it back to education.
To plan when to recall, read What Is Spaced Repetition?, which explains why a review works best after some forgetting. To decide the order of what you practise, read What Is Interleaved Practice?. Roediger also co-wrote a book that puts retrieval practice at the centre of its study advice, reviewed in “Make It Stick” by Peter Brown, Henry Roediger and Mark McDaniel: Summary and Review.
Quiz
3 questions · up to 3 points
Open a question and pick one answer. Only your first answer counts: +1 if it is right, −1 if it is wrong.
In Roediger and Karpicke's 2006 study, what happened when the final test came one week after learning?
Show answer
Students who had recalled the text three times remembered more than students who had read it four times. After one week the recall group remembered 61 percent of the text and the reading group 40 percent, although the reading group had read the passage about four times as often.
You have to give a ten-minute talk in two weeks. Which way of preparing uses the testing effect best?
Show answer
Give the talk aloud without notes every few days, then check the notes for what you left out. Each run without notes makes you recall the content, which is the act you will need on the day. Checking the notes afterwards fixes what you could not recall.
A student tries to recall a chapter she has barely studied, gets very little right, and does not check her answers. What does the research suggest?
Show answer
She will gain little from this test, because the benefit depends on recalling a good part or on checking the answers. In Rowland's 2014 meta-analysis, tests without feedback on which people recalled half or less showed no reliable benefit. With feedback, the benefit was large.
Your points are saved only in this browser for now. Accounts that keep them for good are on the way.
Continue learning: What Is Spaced Repetition? →The takeaway
The testing effect means that recalling what you have learned makes you remember it longer than studying it again, so a test strengthens memory instead of only measuring it. In a 2006 study, students who read a text once and then recalled it three times remembered 61 percent a week later, while students who read it four times remembered 40 percent. The benefit is small or absent when you can recall very little and never check your answers. So close the book, recall what you can, then check what you missed.
References
- Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention. Henry L. Roediger III and Jeffrey D. Karpicke, Psychological Science, 2006
The two experiments with the passages on the sun and on sea otters: rereading wins after five minutes, recall wins after two days and one week.
- Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping. Jeffrey D. Karpicke and Janell R. Blunt, Science, 2011
Two experiments with 200 students that show recall beats drawing concept maps, also on questions that require inference.
- The Effect of Testing Versus Restudy on Retention: A Meta-Analytic Review of the Testing Effect. Christopher A. Rowland, Psychological Bulletin, 2014
A synthesis of 159 comparisons of testing with restudying, with the conditions that make the effect larger or make it disappear.
- Rethinking the Use of Tests: A Meta-Analysis of Practice Testing. Olusola O. Adesope, Dominic A. Trevisan and Narayankripa Sundararajan, Review of Educational Research, 2017
A second large synthesis, including classroom studies, which finds practice tests better than restudying and every other comparison condition.
- Improving Students' Learning With Effective Learning Techniques. John Dunlosky, Katherine A. Rawson, Elizabeth J. Marsh, Mitchell J. Nathan and Daniel T. Willingham, Psychological Science in the Public Interest, 2013
The review of ten study techniques that rates practice testing and spaced practice as the most useful, and rereading and highlighting as the least.





