We measured the time taken by students to respond to individual Force Concept Inventory (FCI) questions. We examine response time differences between correct and incorrect answers, both before and after instruction. We also determine the relation between response time and expressed confidence. Our data reveal three results of interest. First, response times are longer for incorrect answers than for correct ones, indicating that distractors are not automatic choices. Second, response times increase after instruction for both correct and incorrect answers, supporting the notion that instruction changes students' approach to conceptual questions. Third, response times are inversely related to students' expressed confidence; the lower their confidence, the longer it takes to respond.
REFERENCES
1.
Michael
Cole
, Cultural Psychology: A Once and Future Discipline
(Harvard U.P.
, Cambridge, MA
, 1996
).2.
Howard
Gardner
, The Mind's New Science: A History of the Cognitive Revolution
(Basic Books
, New York, NY
, 1985
).3.
R.
Ratcliff
, T.
van Zandt
, and G.
McKoon
, “Connectionist and diffusion models of reaction time
,” Psychol. Rev.
106
(2
), 261
–300
(1999
).4.
S. L.
Wise
and C. E.
DeMars
, “An application of item response time: The effort-moderated IRT model
,” J. Educ. Meas.
43
(1
), 19
–38
(2006
).5.
S. L.
Wise
and X. J.
Kong
, “Response time effort: A new measure of examinee motivation in computer-based tests
,” Appl. Meas. Educ.
18
(2
), 163
–183
(2005
).6.
R.
Mislevy
, “Foundations of a new test theory
,” in Test theory for a new generation of tests
, edited by N.
Frederiksen
, R.
Mislevy
, and I.
Bejar
(Lawrence Erlbaum Associates
: Hillsdale, NJ
, 1993
).7.
D. L.
Schnipke
and D. J.
Scrams
, “Modeling item response times with a two-state mixture model: A new method of measuring speededness
,” J. Educ. Meas.
34
(3
), 213
–232
(1997
).8.
F.
Abdelfattah
, “Response latency effects on classical and item response theory parameters using different scoring procedures
,” in College of Education
(Ohio University
, OH
, 2007
), p. 167
.9.
K. K.
Tatsuoka
and M. M.
Tatsuoka
. “A model for including response time data in scoring achievement tests
,” in 1979 computerized adaptive testing conference
(Minneapolis, MN., 1997
).10.
D. L.
Schnipke
and D. J.
Scrams
, “Exploring issues of examinee behavior: Insights gained from response time analyses
,” in Computer-Based Testing: Building the Foundation for Future Assessments
, edited by C. N.
Mills
et al. (Lawrence Erlbaum Associates
, Mahwah, NJ
, 1997
).11.
D.
Hestenes
, M.
Wells
, and G.
Swackhammer
, “Force Concept Inventory
,” Phys. Teach.
30
, 141
–158
(1992
).12.
13.
C.
Crouch
and E.
Mazur
, “Peer Instruction: Ten years of experience and results
,” Am. J. Phys.
69
(9
), 970
–977
(2001
).14.
E.
Mazur
, Peer Instruction: A User's Manual
(Prentice-Hall
, Upper Saddle River, NJ
, 1997
).15.
W.
van der Linden
, “A hierarchical framework for modeling speed and accuracy on test items
,” Psychometrika
72
(3
), 287
–308
(2007
).16.
See supplementary material at http://dx.doi.org/10.1119/1.4812583 for more detailed information on response time per question.
17.
I. A.
Halloun
and D.
Hestenes
, “Common-Sense Concepts About Motion
,” Am. J. Phys.
53
(11
), 1056
–1065
(1985
).18.
I. A.
Halloun
and D.
Hestenes
, “The initial knowledge state of college physics. Students
,” Am. J. Phys.
53
(11
), 1043
–1055
(1985
).19.
D.
Hammer
, A.
Elby
, R. E.
Scherr
, and E. F.
Redish
, “Resources, framing, and transfer
,” in Transfer of Learning: Research and Perspectives
, edited by J.
Mestre
(Information Age Publishing
, Charlotte, NC
, 2004
).20.
E. F.
Redish
, “A theoretical framework for physics education research: Modeling student thinking
,” in Enrico Fermi Summer School, Course CLVI 2004
(Italian Physical Society
, Varenna, Italy
, 2004
).21.
E.
Mazur
, Peer Instruction: A User's Manual
(Prentice Hall, Upper Saddle River
, N.J.
, 1997
).© 2013 American Association of Physics Teachers.
2013
American Association of Physics Teachers
AAPT members receive access to the American Journal of Physics and The Physics Teacher as a member benefit. To learn more about this member benefit and becoming an AAPT member, visit the Joining AAPT page.
