We measured the time taken by students to respond to individual Force Concept Inventory (FCI) questions. We examine response time differences between correct and incorrect answers, both before and after instruction. We also determine the relation between response time and expressed confidence. Our data reveal three results of interest. First, response times are longer for incorrect answers than for correct ones, indicating that distractors are not automatic choices. Second, response times increase after instruction for both correct and incorrect answers, supporting the notion that instruction changes students' approach to conceptual questions. Third, response times are inversely related to students' expressed confidence; the lower their confidence, the longer it takes to respond.

1.
Michael
Cole
,
Cultural Psychology: A Once and Future Discipline
(
Harvard U.P.
,
Cambridge, MA
,
1996
).
2.
Howard
Gardner
,
The Mind's New Science: A History of the Cognitive Revolution
(
Basic Books
,
New York, NY
,
1985
).
3.
R.
Ratcliff
,
T.
van Zandt
, and
G.
McKoon
, “
Connectionist and diffusion models of reaction time
,”
Psychol. Rev.
106
(
2
),
261
300
(
1999
).
4.
S. L.
Wise
and
C. E.
DeMars
, “
An application of item response time: The effort-moderated IRT model
,”
J. Educ. Meas.
43
(
1
),
19
38
(
2006
).
5.
S. L.
Wise
and
X. J.
Kong
, “
Response time effort: A new measure of examinee motivation in computer-based tests
,”
Appl. Meas. Educ.
18
(
2
),
163
183
(
2005
).
6.
R.
Mislevy
, “
Foundations of a new test theory
,” in
Test theory for a new generation of tests
, edited by
N.
Frederiksen
,
R.
Mislevy
, and
I.
Bejar
(
Lawrence Erlbaum Associates
:
Hillsdale, NJ
,
1993
).
7.
D. L.
Schnipke
and
D. J.
Scrams
, “
Modeling item response times with a two-state mixture model: A new method of measuring speededness
,”
J. Educ. Meas.
34
(
3
),
213
232
(
1997
).
8.
F.
Abdelfattah
, “
Response latency effects on classical and item response theory parameters using different scoring procedures
,” in
College of Education
(
Ohio University
,
OH
,
2007
), p.
167
.
9.
K. K.
Tatsuoka
and
M. M.
Tatsuoka
. “
A model for including response time data in scoring achievement tests
,” in
1979 computerized adaptive testing conference
(Minneapolis, MN.,
1997
).
10.
D. L.
Schnipke
and
D. J.
Scrams
, “
Exploring issues of examinee behavior: Insights gained from response time analyses
,”
in Computer-Based Testing: Building the Foundation for Future Assessments
, edited by
C. N.
Mills
 et al (
Lawrence Erlbaum Associates
,
Mahwah, NJ
,
1997
).
11.
D.
Hestenes
,
M.
Wells
, and
G.
Swackhammer
, “
Force Concept Inventory
,”
Phys. Teach.
30
,
141
158
(
1992
).
12.
I. A.
Halloun
 et al,
Revised Force Concept Inventory
, appearing in Ref. 14,
1997
.
13.
C.
Crouch
and
E.
Mazur
, “
Peer Instruction: Ten years of experience and results
,”
Am. J. Phys.
69
(
9
),
970
977
(
2001
).
14.
E.
Mazur
,
Peer Instruction: A User's Manual
(
Prentice-Hall
,
Upper Saddle River, NJ
,
1997
).
15.
W.
van der Linden
, “
A hierarchical framework for modeling speed and accuracy on test items
,”
Psychometrika
72
(
3
),
287
308
(
2007
).
16.
See supplementary material at http://dx.doi.org/10.1119/1.4812583 for more detailed information on response time per question.
17.
I. A.
Halloun
and
D.
Hestenes
, “
Common-Sense Concepts About Motion
,”
Am. J. Phys.
53
(
11
),
1056
1065
(
1985
).
18.
I. A.
Halloun
and
D.
Hestenes
, “
The initial knowledge state of college physics. Students
,”
Am. J. Phys.
53
(
11
),
1043
1055
(
1985
).
19.
D.
Hammer
,
A.
Elby
,
R. E.
Scherr
, and
E. F.
Redish
, “
Resources, framing, and transfer
,” in
Transfer of Learning: Research and Perspectives
, edited by
J.
Mestre
(
Information Age Publishing
,
Charlotte, NC
,
2004
).
20.
E. F.
Redish
, “
A theoretical framework for physics education research: Modeling student thinking
,” in
Enrico Fermi Summer School, Course CLVI 2004
(
Italian Physical Society
,
Varenna, Italy
,
2004
).
21.
E.
Mazur
,
Peer Instruction: A User's Manual
(
Prentice Hall, Upper Saddle River
,
N.J.
,
1997
).

Supplementary Material

AAPT members receive access to the American Journal of Physics and The Physics Teacher as a member benefit. To learn more about this member benefit and becoming an AAPT member, visit the Joining AAPT page.