In an MIT calculus-based introductory Newtonian mechanics course, we study the effectiveness of various instructional course elements: electronic and written homeworks, collaborative group problems, and class participation. We measure effectiveness by the slope of the regression line between a student’s score (used as a proxy for participation) on a particular course element and his normalized gain on various assessment instruments. These instruments were the MIT final exam comprised mainly of multipart problems demanding analytic responses and two widely used standard physics tests that emphasize conceptual knowledge: the Force Concept Inventory and the Mechanics Baseline Test. The results show that interactive course elements are associated with higher gains on assessment instruments: doing interactive electronic homework administered by myCyberTutor correlated with large gains on the final exam producing a learning effect of 1.8±0.4 standard deviations on the final examination score. myCyberTutor and collaborative group problem solving correlated with gains on the more conceptual tests. We also report surveys that demonstrate that students have had an increasingly favorable opinion of myCyberTutor over the four terms of its use.

1.
J.
Van Aalst
, “
An introduction to physics education research
,”
Can. J. Phys.
78
,
57
71
(
2000
).
2.
D. R.
Sokoloff
and
R. K.
Thornton
, “
Using interactive lecture demonstrations to create an active learning environment
,”
Phys. Teach.
35
,
340
347
(
1997
).
3.
C.
Crouch
and
E.
Mazur
, “
Peer instruction: Ten years of experience and results
,”
Am. J. Phys.
69
,
970
977
(
2001
).
4.
P.
Heller
and
M.
Hollabaugh
, “
Teaching problem solving through cooperative grouping. Part 2: Designing problems and structuring groups
,”
Am. J. Phys.
60
,
637
644
(
1992
).
5.
P.
Heller
,
R.
Keith
, and
S.
Anderson
, “
Teaching problem solving through cooperative grouping. Part 1: Group versus individual problem solving
,”
Am. J. Phys.
60
,
637
644
(
1992
).
6.
myCyberTutor was made by Effective Educational Technologies. The problems were written by David Pritchard using the software developed by Alex Pritchard. David Pritchard is now a consultant to Pearson, which markets an improved version of this product (see www.MasteringPhysics.com).
7.
R.
Hake
, “
Interactive engagement versus traditional methods: A six thousand student survey of mechanics test data for introductory physics courses
,”
Am. J. Phys.
66
,
64
74
(
1998
).
8.
D.
Hestenes
,
M.
Wells
, and
G.
Swackhammer
, “
Force concept inventory
,”
Phys. Teach.
30
,
141
158
(
1992
).
9.
D.
Hestenes
and
M.
Wells
, “
A mechanics baseline test
,”
Phys. Teach.
30
,
159
166
(
1992
).
10.
J.
Saul
, “
Beyond problem solving, evaluating introductory physics courses through the hidden curriculum
,” Ph.D. thesis,
University of Maryland
,
1998
.
11.
L.
McDermott
and
P.
Shaffer
,
Tutorials in Introductory Physics
, 1st ed. (
Prentice-Hall
,
Englewood Cliffs, NJ
,
2002
).
12.
P.
Laws
,
Workshop Physics Activity Guide
(
Wiley
,
New York
,
1996
).
13.
C.
Ogilvie
, “
Effectiveness of different course components in driving gains in conceptual understanding
,” Department of Physics, MIT Internal Report No. 01,
2001
(http://relate.mit.edu).
14.
H.
Cooper
,
Homework
(
Longmans
,
New York
,
1989
).
15.
J.
Mestre
,
R.
Dufrense
,
D.
Hart
, and
K.
Rath
, “
The effect of web-based homework on test performance in large enrollment introductory physics courses
,”
J. Comput. Math. Sci. Teach.
21
,
229
251
(
2002
).
16.
M.
Thoennessen
and
M.
Harrison
, “
Computer-assisted assignments in a large physics class
,”
Comput. Educ.
27
,
141
147
(
1996
).
17.
S.
Bonham
,
R.
Beichner
, and
D.
Deardorff
, “
Online homework: Does it make a difference?
Phys. Teach.
39
,
293
296
(
2001
).
18.
Jacob
Cohen
,
Statistical Power Analysis for the Behavioral Sciences
, 2nd ed. (
Lawrence Erlbaum Associates
,
Hillsdale, New Jersey
,
1988
), pp.
20
25
.
19.
Scott B.
Morris
, “
Estimating effect sizes from pretest-posttest-control group designs
,”
Organ. Res. Methods
11
,
364
386
(
2008
).
20.
David J.
Palazzo
, “
Patterns and consequences of copying electronic homework
,” MS thesis,
Massachusetts Institute of Technology
,
2006
.
21.
Elsa-Sofia
Morote
and
David E.
Pritchard
, “
What course elements correlate with improvement on tests in introductory Newtonian mechanics?
,” Educational Resources Information No. ERIC ED463979.
AAPT members receive access to the American Journal of Physics and The Physics Teacher as a member benefit. To learn more about this member benefit and becoming an AAPT member, visit the Joining AAPT page.