Peer Instruction (PI) was introduced by Mazur to help students learn physics concepts during lectures. Besides physics, PI has also been adopted in other STEM fields. In this approach [Fig. 1(a)], students answer a related question individually after a concept has been presented. Before they revote on the same question individually, they are asked to convince others that their answer is correct during peer discussion. The percentage of correct answers typically increases after peer discussion. However, Smith et al. highlighted that the improvement may be due to copying, not because students actually learned how to reason correctly. To exclude copying, Smith et al. modified Mazur’s PI protocol by adding a second question Q2 after the students revote on the first question Q1 [Fig. 1(b)]. Q2 is “isomorphic” to Q1, meaning that it requires the application of the same concept, but the “cover story” is different. Here, we simplify Smith et al.’s PI protocol by removing the revote on Q1 [Fig. 1(c)]. Moreover, our Q1 and Q2 are similar, i.e., the same except with some information changed. Our PI protocol is thus the same as Mazur’s, except the pre- and post-discussion questions are not exactly the same. We replace PI in our protocol by teacher’s instruction (TI) to compare the effectiveness of PI with TI for a pair of similar questions involving Lenz’s law, using Hake’s normalized gain and a statistical test.

Peer Instruction (PI) was introduced by Mazur1 to help students learn physics concepts during lectures. Besides physics,2,3 PI has also been adopted in other STEM fields.4 In this approach [Fig. 1(a)], students answer a related question individually after a concept has been presented. Before they revote on the same question individually, they are asked to convince others that their answer is correct during peer discussion. The percentage of correct answers typically increases after peer discussion.2,3 However, Smith et al.5 highlighted that the improvement may be due to copying, not because students actually learned how to reason correctly. To exclude copying, Smith et al.5 modified Mazur’s PI protocol by adding a second question Q2 after the students revote on the first question Q1 [Fig. 1(b)]. Q2 is “isomorphic” to Q1, meaning that it requires the application of the same concept, but the “cover story” is different.5 Here, we simplify Smith et al.’s PI protocol by removing the revote on Q1 [Fig. 1(c)]. Moreover, our Q1 and Q2 are similar, i.e., the same except with some information changed. Our PI protocol is thus the same as Mazur’s, except the pre- and post-discussion questions are not exactly the same. We replace PI in our protocol by teacher’s instruction (TI) to compare the effectiveness of PI with TI for a pair of similar questions involving Lenz’s law, using Hake’s normalized gain6 and a statistical test.

Fig. 1.

Variations of the PI protocol. (a) Mazur’s protocol, (b) Smith et al.’s protocol, and (c) our protocol. The answer to Q1 is not revealed until after Q2 is answered by the students in protocols (b) and (c), together with the answer to Q2. In this paper, we replace peer discussion in our PI protocol in (c) by TI to compare the effectiveness of PI with TI. Students learn how to arrive at the answer for Q1 from their peers and teacher in PI and TI, respectively.

Fig. 1.

Variations of the PI protocol. (a) Mazur’s protocol, (b) Smith et al.’s protocol, and (c) our protocol. The answer to Q1 is not revealed until after Q2 is answered by the students in protocols (b) and (c), together with the answer to Q2. In this paper, we replace peer discussion in our PI protocol in (c) by TI to compare the effectiveness of PI with TI. Students learn how to arrive at the answer for Q1 from their peers and teacher in PI and TI, respectively.

Close modal

The study was conducted in our first-year Physics for Engineering course over five semesters from 2020 to 2021. The pair of similar questions involving the application of Lenz’s law is as follows:

The smaller circle in Fig. 2 is the cross section of a solenoid. The cross section of the solenoid and the conducting loop both lie on the page. The magnetic field outside the solenoid is zero. The magnetic field inside the solenoid is uniform, where the magnitude Bsol is given by μ0ni. The current i in the solenoid is _______ and ________.

Fig. 2.

Cross section of a solenoid, and a circular conducting loop outside the solenoid for the two similar questions involving Lenz’s law.

Fig. 2.

Cross section of a solenoid, and a circular conducting loop outside the solenoid for the two similar questions involving Lenz’s law.

Close modal
  • The magnetic flux through the conducting loop is increasing or decreasing?

  • The current induced in the conducting loop produces a magnetic field. The direction of this magnetic field in the area bounded by the conducting loop is into the page or out of the page?

  • The induced current in the conducting loop is clockwise (cw) or counterclockwise (ccw)?

The information given for the current in the solenoid is one of four possibilities: cw and decreasing, cw and increasing, ccw and decreasing, or ccw and increasing. For Q1, the current information is not the same for all students (to compel students to learn through peer discussion); for Q2, the same question was asked but with different current information (again not the same for all students).

Each question is answered correctly only if all three parts are answered correctly; in this case, 1 mark is awarded; otherwise, no mark is given. Before students attempted Q1, they were told that the probability of guessing all three parts correctly is only 0.125. After answering Q1, they were told that Q2 will be similar to Q1, and they were asked to learn how to arrive at the answers (which are not revealed at this stage) to Q1 during peer discussion (semesters C–E) and teacher’s instruction (semesters A and B). As an incentive to do so, Q2 (like Q1) carries a small credit. Five minutes were allocated for answering each question. The duration for peer discussion was 10 min. For teacher’s instruction (about 5 min), the teacher said the following for each part of Q1 but did not discuss them specifically for any of the four current variations:

  • The magnetic flux through a loop in a uniform magnetic field is given by BA.

  • First, the direction of the solenoid field is determined by the right curl rule (four fingers curled in the direction of current, thumb points in the field direction). Second, according to Lenz’s law, if the magnetic flux increases (decreases), the induced field points in the opposite (same) direction to (as) the solenoid field.

  • The direction of induced current is determined by the right curl rule (thumb points in the field direction, four fingers curled in the direction of current).

Nothing else was mentioned by the teacher beyond the general statements above. These points were already covered separately in the lectures, which is why we administered the pair of questions during the tutorial (problem-solving) session after the lectures. For both PI and TI, the answers to Q1 and Q2 were revealed after Q2 was answered by the students. Both questions were administered as Google forms, and the students submitted their answers through the forms.

For TI (semesters A and B, 121 students in total) and PI (semesters C–E, 137 students in total), the percentage of correct answers (PCA) for Q1 (see Table I) is in the lower part of the 35–70% range proposed by Couch and Mazur2 for the definition of a challenging question. Thus, the pair of similar questions could be classified as highly challenging. Hake’s normalized gain, which is a rough measure of the effectiveness of a method of instruction, is defined as6 
(1)
where á ñ denotes class average, which in our case is the same as the PCA. The normalized gain (actual gain divided by maximum possible gain) is 0.18 and 0.37 for PI (semesters C–E) and TI (semesters A and B), respectively (Table I). Based on this rough measure, TI is twice as effective as PI for the pair of highly challenging questions. We note that Hake’s normalized gain is also consistently lower for PI (see Table I) than TI, based on the data for individual semesters.
Table I.
The percentage of correct answers for each question, Hake’s normalized gain, and p value (Wilcoxon test) for PI and TI based on individual semester data and combination of data from different semesters. n is the number of students. The teacher is the same for semesters A and B.
Instruction Semester n Q1 PCA Q2 PCA Hake’s Normalized Gain p Value
TI  95  43  59  0.28  0.027 
TI  26  42  81  0.67  0.0068 
TI  A and B  121  43  64  0.37  0.0015 
PI  39  46  59  0.24  0.306 
PI  40  40  45  0.08  0.622 
PI  58  59  69  0.24  0.284 
PI  C–E  137  50  59  0.18  0.12 
Instruction Semester n Q1 PCA Q2 PCA Hake’s Normalized Gain p Value
TI  95  43  59  0.28  0.027 
TI  26  42  81  0.67  0.0068 
TI  A and B  121  43  64  0.37  0.0015 
PI  39  46  59  0.24  0.306 
PI  40  40  45  0.08  0.622 
PI  58  59  69  0.24  0.284 
PI  C–E  137  50  59  0.18  0.12 

To assess whether there was a statistically significant difference between the Q1 (pre-instruction) and Q2 (post-instruction) marks, we used the paired-samples Wilcoxon test7 instead of the paired-samples t test, since neither Q1 nor Q2 marks are normally distributed. The test shows that the median of the differences between the paired marks is statistically significantly different from zero (p = 0.0015) for TI (semesters A and B), but not statistically significantly different from zero (p = 0.12) for PI (semesters C–E). In other words, TI elicited a statistically significant change (since p < 0.05) in the student’s paired marks (from Q1 to Q2), but PI did not (p > 0.05). The conclusion is similar based on the data for individual semesters (see the p values in Table I).

Hake’s normalized gain and Wilcoxon’s test show that TI is more effective than PI, in our protocol, for the highly challenging pair of similar questions involving Lenz’s law. It would be interesting to replicate our pilot study to see if the same conclusion holds. Furthermore, our study could be extended to other pairs of similar questions on different topics and at different difficulty levels (as measured by the PCA for Q1). One could also study whether adding TI after PI in our protocol is more effective than either PI or TI alone between the two similar questions.

1.
E.
Mazur
,
Peer Instruction: A User’s Manual
(
Prentice Hall
,
Upper Saddle River, NJ
,
1997
).
2.
C. H.
Couch
and
E.
Mazur
, “
Peer instruction: Ten years of experience and results
,”
Am. J. Phys.
69
,
970
977
(
2001
).
3.
A. P.
Fagen
,
C. H.
Couch
, and
E.
Mazur
, “
Peer instruction: Results from a range of classrooms
,”
Phys. Teach.
40
,
206
209
(
2002
).
4.
T.
Vickrey
et al, “
Research-based implementation of peer instruction: A literature review
,”
CBE Life Sci. Educ.
14
,
es3
(
2015
).
5.
M. K.
Smith
et al, “
Why peer discussion improves student performance on in-class concept questions
,”
Science
323
,
122
124
(
2009
).
6.
R. R.
Hake
, “
Interactive-engagement versus traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses
,”
Am. J. Phys.
66
,
64
74
(
1998
).
7.
MedCalc version 19.5.6 (MedCalc Software, Ostend, Belgium).