Other education

Why you can pass tests and still fail in the real world, at 2013 9th Annual International CDIO Conference, Harvard University (Cambridge, MA), Wednesday, June 12, 2013:
Why is it that stellar students sometimes fail in the workplace while dropouts succeed? One reason is that most, if not all, of our current assessment practices are inauthentic. Just as the lecture focuses on the delivery of information to students, so does assessment often focus on having students regurgitate that same information back to the instructor. Consequently, assessment fails to focus on the skills that are relevant in life in the 21st century. Assessment has been called the "hidden curriculum" as it is an important driver of students' study habits. Unless we rethink our approach to... Read more about Why you can pass tests and still fail in the real world
Rubrics Workshop, at OnRamps Fall Professional Development Seminar, The University of Texas at Austin (Austin, TX), Monday, December 9, 2013:
Rubrics are powerful tools that can help prepare students for postsecondary success. In this workshop, we will use rubric exercises to simulate the academic behaviors and work habits rubrics can promote. We will also review six ways rubrics can go beyond scoring guides to personalize feedback, make students' practice more efficient, encourage scholarly engagement, and help students monitor their own learning and progress.
Visualizations and visual illusions: how the mind tricks us, at University of Colorado (Boulder, CO), Friday, April 23, 2004:
Neurobiology and cognitive psychology have made great progress in understanding how the mind processes information – in particular visual information. The knowledge we can gain from these fields has important implications for the presentation of visual information and student learning.
N. Lasry, J. Guillemette, and E. Mazur. 2014. “Two steps forward, one step back.” Nature Physics, 10, Pp. 402–403. Publisher's VersionAbstract
Among physics students there exists a wide variety of misconceptions, generally thought to be robust and resistant to change. But our analysis of the path of progress has changed our conception of how students learn physics.
J. Watkins. 2010. “Examining issues of underrepresented minority students in introductory physics”. Publisher's VersionAbstract
In this dissertation we examine several issues related to the retention of underrepresented minority students in physics and science. In the first section, we show that in calculus-based introductory physics courses, the gender gap on the FCI is diminished through the use of interactive techniques, but in lower-level introductory courses, the gap persists, similar to reports published at other institutions. We find that under-represented racial minorities perform similar to their peers with comparable academic preparation on conceptual surveys, but their average exam grades and course grades are lower. We also examine student persistence in science majors; finding a significant relationship between pedagogy in an introductory physics course and persistence in science. In the second section, we look at student end-of-semester evaluations and find that female students rate interactive teaching methods a full point lower than their male peers. Looking more deeply at student interview data, we find that female students report more social issues related to the discussions in class and both male and female students cite feeling pressure to obtain the correct answer to clicker questions. Finally, we take a look an often-cited claim for gender differences in STEM participation: cognitive differences explain achievement differences in physics. We examine specifically the role of mental rotations in physics achievement and problem-solving, viewing mental rotations as a tool that students can use on physics problems. We first look at student survey results for lower-level introductory students, finding a low, but significant correlation between performance on a mental rotations test and performance in introductory physics courses. In contrast, we did not find a significant relationship for students in the upper-level introductory course. We also examine student problem-solving interviews to investigate the role of mental rotations on introductory problems.
E. Mazur. 1992. “Qualitative versus quantitative reasoning: Are we teaching the right thing?” Optics and Photonics News. Publisher's VersionAbstract
For the past eight years I have been teaching an introductory physics course for engineering and science concentrators at Harvard University. Teaching this class, which does not include any physics majors, is a challenging experience because the students take this course as a concentration requirement, not because of a genuine interest in physics. At the same time it can be a very rewarding experience when, at the end of the semester, students show much more appreciation for the subject matter. I used to teach a fairly traditional course in an equally traditional lecture-type of presentation, enlivened by classroom demonstrations. I was generally satisfied with my teaching during these years my students did well on what I considered pretty difficult problems and the feedback I received from them was positive. About a year ago, however, I came across a series of articles by David Hestenes of Arizona State University, which completely and permanently changed my views on teaching.
E. Mazur. 2014. Principles & Practice of Physics, Pp. 1275. Pearson. Publisher's VersionAbstract
The Principles and Practice of Physics is a new calculus-based introductory physics textbook that uses a unique organization and pedagogy to allow students to develop a true conceptual understanding of physics alongside the quantitative skills needed in the course. The book organizes introductory physics around the conservation principles and provides a unified contemporary view of introductory physics. The result of this reorganization is a groundbreaking new book that puts principles first, thereby making it more accessible to students and easier for instructors to teach. To request an examination copy of the complete book, please visit the book web site ISBN-13: 9780136150930
A. P. Fagen. 2003. “Assessing and Enhancing the Introductory Science Course in Physics and Biology: Peer Instruction, Classroom Demonstrations, and Genetics Vocabulary”. Publisher's VersionAbstract
Most introductory college science courses in the United States are taught in large lectures with students rarely having the opportunity to think critically about the material being presented nor to participate actively. Further, many classes focus on teaching rather than learning, that is, the transfer of information as opposed to actual student understanding. This thesis focuses on three studies about the assessment and enhancement of learning in undergraduate science courses. We describe the results of an international survey on the implementation of Peer Instruction (PI), a collaborative learning pedagogy in which lectures are interspersed with short conceptual questions designed to challenge students to think about the material as it is being presented. We present a portrait of the many instructors teaching with PI and the settings in which it is being used as well as data on the effectiveness of PI in enhancing student learning in diverse settings. The wide variety of implementations suggests that PI is a highly adaptable strategy that can work successfully in almost any environment. We also provide recommendations for those considering adopting PI in their classes. Classroom demonstrations are an important aspect of many introductory science courses, but there is little evidence supporting their educational effectiveness. We explore the effect of different modes of presentation on enhancing student learning from demonstrations. Our results show that students who actively engage with a demonstration by predicting the outcome before it is conducted are better able to recall and explain the scenario posed by that demonstration. As preliminary work for the creation of an inventory of conceptual understanding in introductory biology, we discuss results from a survey of vocabulary familiarity and understanding in an undergraduate genetics course. Students begin introductory classes with significant gaps in their understanding, some of which are retained beyond instruction. Further, they overstate their knowledge, and the degree to which they exhibit overconfidence increases over the period of instruction.
G. A. Morris, L. Branum-Martin, N. Harshman, S. D. Baker, E. Mazur, S. Nath Dutta, T. Mzoughi, and V. McCauley. 2005. “Testing the test: Item response curves and test quality.” Am. J. Phys., 74, Pp. 449–453. Publisher's VersionAbstract
We present a simple technique for evaluating multiple-choice questions and their answer choices beyond the usual measures of difficulty and the effectiveness of distractors. The technique involves the construction and qualitative consideration of item response curves (IRCs) and is based upon Item Response Theory from the field of education measurement. Item response curves relate the percentage of students who select each possible answer choice to overall ability level. To demonstrate the technique, we apply IRC analysis to three questions from the Force Concept Inventory (FCI). IRC analysis allows us to characterize qualitatively whether these questions are efficient, where efficient is defined in terms of the construction, performance, and discrimination of a question and its answer choices. Such analysis can be useful both in the development of future multiple-choice examination questions and in the development of a better understanding of results from existing diagnostic instruments such as the FCI.
N. Lasry, N. Finkelstein, and E. Mazur. 2009. “Are most people too dumb for physics?” Physics Teacher, 47, Pp. 418–422. Publisher's VersionAbstract
In a recent article in The Physics Teacher, Michael Sobel claims (as do many teachers) that physics is in a "special category of hard" and is usually taken only by a "certain sort of very bright student." The appealing, yet suspiciously conceited, notion that physics is only for smart or industrious people is questionable. We offer this response as a means to initiate a dialogue on how we engage with students in our physics courses.
L. Tucker, R. E. Scherr, T. Zickler, and E. Mazur. 2016. “Exclusively visual analysis of classroom group interactions.” Phys. Rev. Phys. Educ. Res., 12, Pp. 020142-1–020142-9. Publisher's VersionAbstract
Large-scale audiovisual data that measure group learning are time consuming to collect and analyze. As an initial step towards scaling qualitative classroom observation, we qualitatively coded classroom video using an established coding scheme with and without its audio cues. We find that interrater reliability is as high when using visual data only—without audio—as when using both visual and audio data to code. Also, interrater reliability is high when comparing use of visual and audio data to visual-only data. We see a small bias to code interactions as group discussion when visual and audio data are used compared with video-only data. This work establishes that meaningful educational observation can be made through visual information alone. Further, it suggests that after initial work to create a coding scheme and validate it in each environment, computer-automated visual coding could drastically increase the breadth of qualitative studies and allow for meaningful educational analysis on a far greater scale.
N. Lasry, J. Guillemette, M. Dugdale, E. Charles, and E. Mazur. 2016. “Peut-on apprendre sans désapprendre?” Pédagogie Collégiale, 29, Pp. 27–31. Publisher's VersionAbstract
D’après le romancier français Marcel Proust, «Le véritable voyage de découverte ne consiste pas à chercher de nouveaux paysages, mais à avoir de nouveaux yeux » (Proust, 1923). Ainsi, l’un des principaux objectifs de l’enseignement des sciences est d’aider les étudiants à modifier leur vision du monde. Cela est particulièrement important en physique, car les étudiants ont souvent des idées préconçues qui vont à l’encontre de ce qu’on tente de leur enseigner (Bransford, Brown et Cocking, 2000 ; Knight et Burciaga, 2004 ; Redish, 2003), précisément en ce qui concerne les concepts newtoniens. Parmi ces des décennies (Clement, 1982 ; Halloun et Hestenes, 1985a ; Halloun et Hestenes, 1985b ; Minstrell, 1982 ; Viennot, 1979), on estime qu'un grand nombre sont profondément ancrées dans leur esprit et difficiles à modifier (Dunbar, Fugelsang et Stein, 2007 ; Posner et collab., 1982 ; Vosniadou, 1992 et 1994). Nous pré- sentons ici quelques découvertes qui ont transformé notre propre perception de la façon dont les étudiants apprennent la physique. Plusieurs des idées que nous soumettons pourraient aussi s'appliquer à d'autres disciplines que ce soit dans un programme préuniversitaire ou technique.
J. Edward Dowd. 2012. “Interpreting Assessments of Student Learning in the Introductory Physics Classroom and Laboratory”. Publisher's VersionAbstract
Assessment is the primary means of feedback between students and instructors. However, to effectively use assessment, the ability to interpret collected information is essential. We present insights into three unique, important avenues of assessment in the physics classroom and laboratory. First, we examine students’ performance on conceptual surveys. The goal of this research project is to better utilize the information collected by instructors when they administer the Force Concept Inventory (FCI) to students as a pre-test and post-test of their conceptual understanding of Newtonian mechanics. We find that ambiguities in the use of the normalized gain, g, may influence comparisons among individual classes. Therefore, we propose using stratagrams, graphical summaries of the fraction of students who exhibit “Newtonian thinking,” as a clearer, more informative method of both assessing a single class and comparing performance among classes. Next, we examine students’ expressions of confusion when they initially encounter new material. The goal of this research project is to better understand what such confusion actually conveys to instructors about students’ performance and engagement. We investigate the relationship between students’ self-assessment of their confusion over material and their performance, confidence in reasoning, pre-course self-efficacy and several other measurable characteristics of engagement. We find that students’ expressions of confusion are negatively related to initial performance, confidence and self-efficacy, but positively related to final performance when all factors are considered together. Finally, we examine students’ exhibition of scientific reasoning abilities in the instructional laboratory. The goal of this research project is to explore two inquiry- based curricula, each of which proposes a different degree of scaffolding. Students engage in sequences of these laboratory activities during one semester of an introductory physics course. We find that students who participate in the less scaffolded activities exhibit marginally stronger scientific reasoning abilities in distinct exercises throughout the semester, but exhibit no differences in the final, common exercises. Overall, we find that, although students demonstrate some enhanced scientific reasoning skills, they fail to exhibit or retain even some of the most strongly emphasized skills.

Pages