Making It Stick II

I wrote an article last week about advice for students in Make It Stick: The Successful Science of Learning, by Peter C. Brown, Henry L. Roediger III, and Mark A. McDaniel.

The book also contains sage advice for teachers, much of which is especially pertinent to law school educators and administrators. With declining law school enrollments and falling bar passage rates, the American Bar Association in 2014 revised its Standards and Rules of Procedure for Law Schools relating to learning outcomes, credit hours (including provisions for student out-of-class coursework) and objective policies and procedures for determining the credit hours to be awarded for coursework. Making It Stick describes dozens of practices to help legal instructors remove obstacles to learning, facilitate understanding, and promote success in achieving student learning outcomes.

They advise teachers to (1) explain to students how learning works, (2) teach students how to study, (3) create desirable difficulties and provide a high level of structure in the classroom, and (4) be transparent. I incorporate all of these practices into my classes.

1. Explain to Students How Learning Works.

Students often arrive at law school with the belief that you either have innate talent or you don’t. This fixed mindset is generally reinforced by the first year curriculum. Most first year first semester courses involve a steep learning curve that requires students to learn to read cases, extract legal rules, reason by analogy, identify legal issues in complex fact patterns and write coherent, persuasive analyses about those issues. While the first year student may get feedback in her legal writing class, most first year classes are taught in lecture format or using the Socratic method. The students have no interim assignments and receive no feedback to help them evaluate whether they are on track. Only with the release of the first semester grades do students receive any concrete information about whether they have learned the material to the necessary standard, mastered the essential skills to succeed in law practice, or even attain the knowledge base pass the bar exam. At that point they are often well into the next semester with its new demands and feel like they do not have the time to re-hash their past performance even though this is the most important part of the learning process.

At this point, their perceptions of themselves as either the ones who have “got it” or the ones who “don’t” begins to harden. The ones who have “got it” sometimes begin to avoid challenges that would draw into question whether they have “got it” (or negatively impact their GPA) and the ones who believe that they “don’t” sometimes lose faith that hard work will get them anywhere.

As the authors of Make It Stick explain, students need to be taught at the very beginning of classes that:
• Learning requires that chemical changes take place in the brain. The more effort and the more challenge, the more effective the learning process.
• When learning is easy, it is often superficial. It is also easily forgotten.
• We learn more effectively when we wrestle with new problems before being exposed to the solution. Even though it’s emotionally unsettling, it’s also more effective to think hard about how you’d answer a question before you have access to the answer.
• Learning necessarily involves setbacks and failures. This feedback is often precisely what we need to adjust our strategies and to achieve mastery.
• To achieve mastery, we must surpass our current levels of ability.

Therefore, I share excerpts from The New Science of Learning and Make It Stick with my students at the beginning of the semester and connect that information about how we learn with the organization of the assignments, the graded exercises and exams, and the learning outcomes identified in my syllabus. I especially encourage students to adopt a growth mindset. As Henry Ford said, “Whether you think you can or you think you can’t, you’re right!” I explain that struggle increases your intellectual abilities in the same way that exercising or lifting weights increases your physical strength.

2. Teach Students How to Study.

Students may arrive in law school with the belief that re-reading the texts and highlighting or underlining key material is sufficient engagement for them to remember and use the material. They may have habits of procrastinating and then pulling an all-nighter and cramming to meet a deadline. These practices are, of course, ineffective in professional education. First, cramming doesn’t last. The material is not retained for the long term. Second, rote memorization does not help students apply the material, which is what they’ll be asked to do for their course exams and for the bar exam. Third, distributed learning is far more effective. Student recall and mastery improves when questions are asked several times over increasing periods from the date the material was first presented and when different topics or problem times are alternated. Fourth, interacting with the material is the key to learning. When students are required to perform some task associated with the material they are more likely to remember it. If the practices are identical to key skills they will be using in a professional capacity, then the students can see their progress over time and master practices that will ensure their long-term success.

3. Create Desirable Difficulties and Provide a High Level of Structure in the Classroom.

As the authors of Make It Stick explain, high structure classes with weekly and daily low-stakes exercises provide students with opportunities to practice their skills. The best book I have read on classroom structure was written for elementary school teachers. Nevertheless, The First Days of School: How to Be an Effective Teacher, by Harry K. Wong and Rosemary T. Wong, provides a succinct and valuable set of guidelines for anyone who has begun their teaching career without any prior formal training.

Other effective classroom practices promoted in Make It Stick include requiring the students to generate answers to problems they do not currently know how to answer, and asking them to elaborate, to remember older material and connect it to new material. Finally, spacing out the material, interleaving the material, and varying the topics and the problems has been very effective in enhancing student learning. All of these practices reinforce the neural pathways of learning.

In my classes, I have weekly assignments. In a class like Income Taxation, students must learn several essential skills as well as learn key material. I have divided the course into units based on the types of material to be learned. I assign sections of the tax code and regulations that the students must read. This is challenging, especially for students who have completed only the first year curriculum, which case-based and seldom involves statutory reading and interpretation. To facilitate this work, I have developed worksheets that ask students specific questions about each code section or regulation and direct the students’ reading. By the end of the course students often express surprise at how much their skills have improved in reading the code and the regulations. It’s gratifying for them (and for me) to see how daily practice can so quickly lead to accomplishment.

I also assign tax problem sets each week. I ask the students to attempt the problems and I give them credit for giving the homework a good faith effort and turning it in. As the authors of Make It Stick explain, students learn more effectively when they attempt to do the problems before they’ve been shown how to solve those problems. They are also more attentive when I go over those problems in class.

Finally, as the authors of Make it Stick indicate, while high stakes tests can be stressful and anxiety provoking, students accept quizzing when the stakes are low and when they know in advance the dates the quizzes are going to occur. I give multiple choice clicker quizzes either at the end of a unit in class or in review sessions I provide every other week. When the technology is available, clicker quizzes give students anonymous feedback about their performance. Students want to see how they are doing, but not at the expense of embarrassing themselves in front of their professor or before other students. Clicker quizzes also allow the students to contextualize their performance by giving them feedback about how the rest of the class is doing as a whole.

Spacing out the material, interleaving the material, and varying the topics and the problems has also been very effective in enhancing student learning. The review sessions, which I hold every other week, give the students another chance to apply what they’ve learned in prior weeks. By working through another round of problem sets or past mid-term or final exams, they reinforce their learning and develop a higher level of mastery. Occasionally, I will send students to the blackboard to let them collaborate on the review problems.

4. Be Transparent.

Finally, Make It Stick encourages teachers to be transparent. The syllabus contains the information on their weekly assignments, information on way they will be graded, and a rubric with respect to class participation and how that will be evaluated. When I give midterm examinations and finals, I post prior exams and at least one example of the rubric I used in grading that exam or a copy of the “best of” student answers that I delivered to the prior class. When I grade, I use a rubric and key the student points to the rubric. After the exam, I either go over the rubric in class or provide a copy to the students so that they can compare their answers to the rubric.

Finally, reflection is important. It’s important for professionals to use the feedback they’ve received to improve their performance over time. I ask students to spend a few minutes reflecting on what they learned from their exam and ask them “What would you do differently next time?”

These reflection questions are the most important part of every semester for me when I evaluate my own teaching. As I grade my students’ exams I ask: “What did all of the students get correctly? What did most of the students miss? How can I explain this more clearly? What problems can I assign that will help the students master this material?”

This, and the information I receive on the student feedback forms, is what sticks with me.

Making It Stick

Samford University recently delivered a copy of the 2014 hit "Make It Stick: The Successful Science of Learning, by Peter C. Brown, Henry L. Roediger III, and Mark A. McDaniel to my office. Since I'd bought a copy in 2014, I concluded that this was a signal that I should actually read it. . .   I now share key ideas of the book with my students.

As this recent Business Insider article notes, most people have never been taught how to learn. Many students fall into the "either you got it or you don't" fixed mindset and assume that if a subject is not easy for them, it's not something they can learn. This book (as well as books like The New Science of Learning) helps teachers and students understand the process of learning so that they may work with and enhance that process instead of creating additional obstacles to learning or giving up altogether.

The latter chapters of Make It Stick have a number of tips for students (which I share with my classes). Some of the high points are:

1.    Practice retrieving new learning from memory. We live in an era where so much knowledge can be accessed via Google on your cell phone. We've gotten out of the habit of remembering facts and details. However, the pace at which we can retrieve information may determine whether we can make the necessary connections to solve new problems. By practicing retrieving new memories we cement those memory paths and strengthen our recall. Taking a tip from Mary Pat Wenderoth, a Biology professor featured in the book, I've reminded my students when we are doing review, to take a few moments to try to remember before turning to their notes and books for the answers.

2.    Space out your retrieval practice and "interleave" the study of different problem types. We find some level of gratification in cramming and then perfecting our retrieval of one set of things before going to the next set of things. Unfortunately, this gives us the illusion of learning without really achieving much. Instead, by letting some time lapse before we try to recall, we improve our learning and memory of the material. Just as we build strength more quickly when we give our muscles a day to rest after strength-training exercises, we enhance our learning when we take time to rest or focus on other materials. Likewise, when we study different things, using different skill sets or methodologies, we may feel that we are learning more slowly, but we are learning more effectively. Again, we are strengthening the pathways to new knowledge.

3.    Elaborate. "Elaboration" in this context means relating the new things you've learned to what you already know. When we elaborate, we connect the new pathways, making it more likely that we will actually take the new pathways when facing the next problem.

4.    Generate. When we generate answers to problems we don't currently know how to solve, we take a tour of older problems that we have been able to solve and consider whether those solutions may work. We may also try to come up with new ways of addressing those problems. When we try to answer problems before we have the process and the skills in place, or access to the answer key, we have again strengthened old pathways and primed our attention to learn something new.

5.    Reflect. When we take a few minutes to ask what went well, what could have gone better, and what we could try differently next time, we professionalize our learning process. This is activity that many professions undertake. Medical communities routinely discuss their diagnoses, patient results and their mistakes in an effort to improve their analysis, process, teamwork and patient outcomes. Athletes review film and discuss their past competitions with their coaches to improve their next performance.

6.    Calibrate. Calibration means that we are checking our results against a standard. If we think that we have performed fairly well, but have not examined our performance against a model or a rubric, or gotten feedback about whether we've met the standard, we may be deluding ourselves. you may and responses against a rubric or a "best of" student answers from a prior exam.

7.    Mnemonic Devices. We have all developed acronyms for remembering essential information. The ancient Greeks were able to recite their epic tales of heroism and woe by memory by constructing a house in their mind. They begin the epic poem by "walking" into the foyer of the house and using the objects they imagine they see to evoke the first opening lines. They would progress through the poem by moving into the other rooms and using the sequence of items seen to recall the subsequent lines. Oxford students call these mental edifices "memory palaces."

Many of my students have embraced these ideas and begun to trust the scientific research behind the techniques. When they achieve success in their classes, however, is when it really sticks!