We investigate how elements of course structure (i.e., the frequency of assessments as well as the sequencing and weight of course resources) influence the usage patterns of electronic textbooks (e-texts) in introductory physics courses. Specifically, we analyze the access logs of courses at Michigan State University and the Massachusetts Institute of Technology, each of which deploy e-texts as primary or secondary texts in combination with different formative assessments (e.g., embedded reading questions) and different summative assessment (exam) schedules. As such studies are frequently marred by arguments over what constitutes a “meaningful” interaction with a particular page (usually judged by how long the page remains on the screen), we consider a set of different definitions of “meaningful” interactions. We find that course structure has a strong influence on how much of the e-texts students actually read, and when they do so. In particular, courses that deviate strongly from traditional structures, most notably by more frequent exams, show consistently high usage of the materials with far less “cramming” before exams.
References
1.
D.
Butler
, “The textbook of the future
,” Nature
458
, 568
–570
(2009
).2.
P.
Arroway
, E.
Davenport
, G.
Xu
, and D.
Updegrove
, EDUCAUSE Core Data Service Fiscal Year 2009 Summary Report, 2010
.3.
S. D.
Smith
and J. B.
Caruso
, “Executive summary
,” in The ECAR Study of Undergraduate Students and Information Technology
(EDUCAUSE Center for Analysis and Research
, 2010
), pp. 7
–17
.4.
S. D.
Smith
and J. B.
Caruso
, “What are students doing with technology?
” in The ECAR Study of Undergraduate Students and Information Technology
(EDUCAUSE Center for Analysis and Research
, 2010
), pp. 55
–72
.5.
G.
Kortemeyer
, “Ten years later: Why open educational resources have not noticeably affected higher education, and why we should care
,” EDUCAUSE Review, 2013
.6.
J. G.
Mazoue
, “The MOOC model: Challenging traditional education
,” EDUCAUSE Review, 2013
.7.
D. T.
Seaton
, Y.
Bergner
, I.
Chuang
, P.
Mitros
, and D. E.
Pritchard
, “Who does what in a massive open online course?
,” Commun. ACM
57
(4
), 58
–65
(2013
).8.
E. F.
Gehringer
, B. L.
Golub
, R.
Cohen
, D. M.
Arnow
, and C. A.
Shaffer
, “Textbook pricing, present and future
,” in SIGCSE'13 Proceedings of the 44th ACM technical symposium on computer science education
, 2013
, pp. 633
–634
.9.
K.
Cummings
, T.
French
, and P.
Cooney
, “Student textbook use in introductory physics
,” in Proceedings of the Physics Education Research Conference
, 2002
; available at (http://www.compadre.org/per/items/detail.cfm?ID=4371).10.
B. D.
Smith
and D. C.
Jacobs
, “TextRev: A window into how general and organic chemistry students use textbook resources
,” J. Chem. Educ.
80
, 99
–102
(2003
).11.
N.
Podolefsky
and N.
Finkelstein
, “The perceived value of college physics textbooks: Students and instructors may not see eye to eye
,” Phys. Teach.
44
, 338
–342
(2006
).12.
T.
Stelzer
, G.
Gladding
, J. P.
Mestre
, and D. T.
Brookes
, “Comparing the efficacy of multimedia modules with traditional textbooks for learning introductory physics content
,” Am. J. Phys.
77
, 184
–190
(2009
).13.
T.
Peckham
and G.
McCalla
, “Mining student behavior patterns in reading comprehension tasks
,” in 5th International Conference on Educational Data Mining
(International Educational Data Mining Society
, 2012
), pp. 87
–94
.14.
A. J.
Rockinson-Szapkiw
, J.
Courduff
, K.
Carter
, and D.
Bennett
, “Electronic versus traditional print textbooks: A comparison study on the influence of university students' learning
,” Comput. Educ.
63
, 259
–266
(2013
).15.
P. M.
Kotas
, J. E.
Finck
, and M.
Horoi
, “Homework habits of college physics students
,” J. Coll. Teach. Learn.
1
(6
), 53
–64
(2004
); available at (http://www.cluteinstitute.com/ojs/index.php/TLC/article/view/1955/1934).16.
L.
Jiang
, J.
Elen
, and G.
Clarebout
, “The relationships between learner variables, tool-usage behaviour and performance
,” Comput. Hum. Behav.
25
, 501
–509
(2009
).17.
G.
Kortemeyer
, “Gender differences in the use of an online homework system in an introductory physics course
,” Phys. Rev. ST Phys. Educ. Res.
5
, 010107
(2009
).18.
D. J.
Palazzo
, R.
Warnakulasooriya
, and D. E.
Pritchard
, “Patterns, correlates, and reduction of homework copying
,” Phys. Rev. ST Phys. Educ. Res.
6
, 010104
(2010
).19.
R.
Phillips
, D.
Maor
, W.
Cumming-Potvin
, P.
Roberts
, J.
Herrington
, G.
Preston
, E.
Moore
, and L.
Perry
, “Learning analytics and study behaviour: a pilot study
,” in Proceedings ASCILITE 2011
(Hobart
, Australia
, 2011
), pp. 997
–1007
.20.
G.
Kortemeyer
, E.
Kashy
, W.
Benenson
, and W.
Bauer
, “Experiences using the open-source learning content management and assessment system LON-CAPA in introductory physics courses
,” Am. J. Phys.
76
, 438
–444
(2008
).21.
R.
Mayer
, Multimedia Learning
, 2nd ed. (Cambridge U.P.
, London; Cambridge, UK; New York
, 2009
).22.
B.
Minaei-Bidgoli
, Ph.D. thesis, Michigan State University
, 2004
.23.
R. E.
Teodorescu
, D. T.
Seaton
, C. N.
Cardamone
, S.
Rayyan
, J. E.
Abbott
, A.
Barrantes
, A.
Pawl
, and D. E.
Pritchard
, “When students can choose easy, medium, or hard homework problems
,” AIP Conf. Proc.
1413
, 81
–84
(2012
).24.
H.
Lin
, “Learning physics vs. passing courses
,” Phys. Teach.
20
, 151
–157
(1982
).25.
V. L.
Dickinson
and L. B.
Flick
, “Beating the system: course structure and student strategies in a traditional introductory undergraduate physics course for nonmajors
,” Sch. Sci. Math.
98
, 238
–246
(1998
).26.
27.
N.
Finkelstein
, “Learning physics in context: a study of student learning about electricity and magnetism
,” Int. J. Sci. Educ.
27
, 1187
–1209
(2005
).28.
S.
Pollock
, “No single cause: learning gains, student attitudes, and the impacts of multiple effective reforms
,” AIP Conf. Proc.
790
, 137
–140
(2005
).29.
J. T.
Laverty
, W.
Bauer
, G.
Kortemeyer
, and G.
Westfall
, “Want to Reduce Guessing and Cheating While Making Students Happier? Give More Exams!
,” Phys. Teach.
50
, 540
–543
(2012
).30.
S.
Freeman
, D.
Haak
, and M. P.
Wenderoth
, “Increased course structure improves performance in introductory biology
,” CBE Life Sci. Educ.
10
, 175
–186
(2011
).31.
P. W.
Laws
, “Millikan Lecture 1996: Promoting active learning based on physics education research in introductory physics courses
,” Am. J. Phys.
65
, 14
–21
(1997
).32.
R. K.
Thornton
and D. R.
Sokoloff
, “Assessing student learning of Newton's laws: The Force and motion conceptual evaluation and the evaluation of active learning laboratory and lecture curricula
,” Am. J. Phys.
66
, 338
–352
(1998
).33.
D. C.
Haak
, J.
HilleRisLambers
, E.
Pitre
, and S.
Freeman
, “Increased structure and active learning reduce the achievement gap in introductory biology
,” Science
332
, 1213
–1216
(2011
).34.
L.
Deslauriers
, E.
Schelew
, and C.
Wieman
, “Improved learning in a large-enrollment physics class
,” Science
332
, 862
–864
(2011
).35.
G. M.
Novak
, A.
Gavrin
, and W.
Christian
, Just-In-Time Teaching: Blending Active Learning with Web Technology
(Prentice Hall
, Englewood Cliffs, NJ; London
, 1999
).36.
H.
Sadaghiani
, “Using multimedia learning modules in a hybrid-online course in electricity and magnetism
,” Phys. Rev. ST Phys. Educ. Res.
7
, 010102
(2011
).37.
H.
Sadaghiani
, “Controlled study on the effectiveness of multimedia learning modules for teaching mechanics
,” Phys. Rev. ST Phys. Educ. Res.
8
, 010103
(2012
).38.
C. I.
Hovland
, “Experimental studies in rote-learning theory. i. reminiscence following learning by massed and by distributed practice
,” J. Exp. Psychol.
22
, 201
–224
(1938
).39.
C. I.
Hovland
, “Experimental studies in rote-learning theory. vi. comparison of retention following learning to same criterion by massed and distributed practice
,” J. Exp. Psychol.
26
, 568
–587
(1940
).40.
R.
Seabrook
and J. E.
Solity
, “Distributed and massed practice: from laboratory to classroom
,” Appl. Cognit. Psychol.
19
, 107
–122
(2005
).41.
N.
Cepeda
, N.
Coburn
, D.
Rohrer
, J.
Wixted
, M.
Mozer
, and H.
Pashle
, “Optimizing distributed practice: Theoretical analysis and practical implications
,” Exp. Psychol.
56
, 236
–246
(2009
).42.
G.
Kortemeyer
and W.
Bauer
, “Multimedia collaborative content creation (mc3)—The MSU lecture online system
,” J. Eng. Educ.
88
, 421
–427
(1999
).43.
R. E.
Teodorescu
, A.
Pawl
, S.
Rayyan
, A.
Barrantes
, and D. E.
Pritchard
, “Toward an Integrated Online Learning Environment
,” AIP Conf. Proc.
1289
, 321
–324
(2010
).44.
A.
Pawl
, A.
Barrantes
, and D. E.
Pritchard
, “Modeling Applied to Problem Solving
,” AIP Conf. Proc.
1179
, 51
–54
(2009
).45.
S.
Rayyan
, A.
Pawl
, A.
Barrantes
, R.
Teodorescu
, and D. E.
Pritchard
, “Improved student performance in electricity and magnetism following prior MAPS instruction in mechanics
,” AIP Conf. Proc.
1289
, 273
–276
(2010
).46.
C.
Fredericks
, S.
Rayyan
, R.
Teodorescu
, T.
Balint
, D.
Seaton
, and D. E.
Pritchard
, “From flipped to open instruction: The mechanics online course
,” in Proceedings the Sixth Conference of MIT's Learning International Network Consortium
(Cambridge, MA
, 2013
); available at (http://linc.mit.edu/linc2013/proceedings.html).47.
D. T.
Seaton
, J.
Reich
, S. O.
Nesterko
, T.
Mullaney
, J.
Waldo
, A. D.
Ho
, and I.
Chuang
, “8.mrev Mechanics Review (MITx on Edx course report—2013 Spring
,” MITx Working Paper
, Vol. 12
, 2014
.48.
D.
Riendeau
, “Flipping the classroom
,” Phys. Teach.
50
, 507
–507
(2012
).49.
D.
MacIsaac
and K.
Falconer
, “Reforming physics instruction via RTOP
,” Phys. Teach.
40
, 479
–485
(2002
).50.
E.
Moran
, “Logging: the dark art of tracking and interpreting interaction with hypermedia CALL materials
,” CALL-EJ Online, Vol. 6, 2004.51.
L. P.
Macfadyen
and S.
Dawson
, “Mining LMS data to develop an ‘early warning system,’ for educators: A proof of concept
,” Comput. Educ.
54
, 588
–599
(2010
).52.
E. F.
Redish
, R. N.
Steinberg
, and J. M.
Saul
, “Student expectations in introductory physics
,” Am. J. Phys.
66
, 212
–224
(1998
).53.
G.
Kortemeyer
, “The challenge of teaching introductory physics to premedical students
,” Phys. Teach.
45
, 552
–557
(2007
).54.
C.
Cabolis
, S.
Clerides
, I.
Ioannou
, and D.
Senft
, “A textbook example of international price discrimination
,” Econ. Lett.
95
, 91
–95
(2007
).55.
G.
Kortemeyer
, “Correlations between student discussion behavior, attitudes, and learning
,” Phys. Rev. ST Phys. Educ. Res. Phys. Rev. ST-PER
3
, 010101
(2007
).56.
D.
Seaton
, Y.
Bergner
, and D. E.
Pritchard
, “Exploring the relationship between course structure and etext usage in blended and open online courses
,” in 6th International Conference on Educational Data Mining
(International Educational Data Mining Society
, 2013
), pp. 350
–351
.57.
R.
Crane
and D.
Sornette
, “Robust dynamic classes revealed by measuring the response function of a social system
,” Proc. Natl. Acad. Sci. U.S.A.
105
, 15649
–15653
(2008
).58.
R.
Crane
, F.
Schweitzer
, and D.
Sornette
, “Power law signature of media exposure in human response waiting time distributions
,” Phys. Rev. E
81
, 056101
(2010
).© 2014 American Association of Physics Teachers.
2014
American Association of Physics Teachers
AAPT members receive access to the American Journal of Physics and The Physics Teacher as a member benefit. To learn more about this member benefit and becoming an AAPT member, visit the Joining AAPT page.
