Students enrolled in introductory astronomy at a mid-sized land grant institution were surveyed at the start and end of each semester for three years regarding their epistemic beliefs about the physical sciences. After collecting data for two years in the control (baseline) course, the course was revised to include regular discussions of the nature of science, practice identifying pseudoscientific claims, and practice with metacognition. Survey data on epistemic beliefs were collected for one more academic year after the course was revised. This work details how the course was structured during the baseline and revised portions of the study. Data from both portions of the study are analyzed as a whole as well as broken down by gender. Negative trends seen in the baseline data are mostly eradicated in the revised portion of the course. The data analysis motivates a discussion of why including content regarding the nature of science should be integrated in classes geared toward non-science majors.

1.
The NASA Science program strategy can be found at <http://science.nasa.gov/researchers/education-public-outreach/strategy >.
2.
The American Astronomical Society mission and vision statement is available at < http://aas.org/governance/aas-mission-and-vision-statement >.
3.
B.
Partridge
and
G.
Greenstein
, “
Goals for ‘Astro 101’: Report on workshops for department leaders
,”
Astron. Educ. Rev.
2
(
2
),
46
89
(
2003
).
4.
T.
Slater
and
J.
Adams
, “
What topics are taught in introductory astronomy courses?
,”
Phys. Teach.
39
,
52
55
(
2001
).
5.
A.
Fraknoi
, “
The state of astronomy education in the US
,”
Astron. Soc. Pacific Conf. Ser.
89
,
9
25
(
1996
).
6.
G.
Deming
and
B.
Hufnagel
, “
Who's Taking Astro 101?
,”
Phys. Teach.
39
,
368
369
(
2001
).
7.
D.
Duncan
and
L.
Arthurs
, “
Improving student attitudes about learning science and student scientific reasoning skills
,”
Astron. Educ. Rev.
11
,
010102
(
2012
).
8.
W. K.
Adams
,
K. K.
Perkins
,
N. S.
Podelefsky
 et al, “
New instrument for measuring student beliefs about physics and learning physics: The Colorado learning attitudes about science survey
,”
Phys. Rev. Spec. Top.: Phys. Educ. Rev.
2
,
010101
(
2006
).
9.
E. F.
Redish
,
J. M.
Saul
, and
R. N.
Steinberg
, “
Student expectations in introductory physics
,”
Am. J. Phys.
66
,
212
224
(
1998
).
10.
S.
Bates
,
R.
Galloway
,
C.
Loptson
, and
K.
Slaughter
, “
How attitudes and beliefs about physics change from high school to faculty
,”
Phys. Rev. Spec. Top.: Phys. Educ. Res.
7
,
020114
(
2011
).
11.
A.
Elby
, “
Helping physics students learn how to learn
,”
Am. J. Phys. Suppl.
69(7)
,
S54
S64
(
2000
).
12.
C. S.
Kalman
,
M.
Sobhanzadeh
,
R.
Thompson
,
A.
Ibrahim
, and
X.
Wang
, “
Combination of interventions can change students' epistemological beliefs
,”
Phys. Rev. ST Phys. Educ. Res.
11
,
020136
(
2015
).
13.
L.
Lising
and
A.
Elby
, “
The impact of epistemology on learning: A case study from introductory physics
,”
Am. J. Phys.
73
,
372
382
(
2005
).
14.
D. B.
May
and
E.
Etkina
, “
College physics students epistemological self-reflection and its relationship to conceptual learning
,”
Am. J. Phys.
70
,
1249
1258
(
2002
).
15.
The idea behind ebaps
,” <http://www2.physics.umd.edu/elby/EBAPS/idea.htm>.
16.
S. J.
Slater
, “
The development and validation of the test of astronomy standards (TOAST)
,”
Journal of Astronomy & Earth Sciences Education
1
(1),
1
–22 (
2014
).
17.
G. L.
Deming
, “
Results of the astronomy diagnostic test national project
,”
Bull. Am. Astron. Soc.
33
,
1424
(
2001
).
18.
A.
Rudolph
,
E.
Prather
,
G.
Brissenden
 et al, “
A national study assessing the teaching and learning of introductory astronomy Part II: The connection between student demographics and learning
,”
Astron. Educ. Rev.
9
,
010107
(
2010
).
19.
W.
Cobern
,
Scientific Literacy and Cultural Studies Project
(
Kalamazoo
,
MI
,
2000
).
20.
C.
Wallace
,
E.
Prather
, and
B.
Mendelsohn
, “
Astro 101 students' perceptions of science: Results from the ‘thinking about science survey instrument’
,”
Astron. Educ. Rev.
12
,
010101
(
2013
).
21.
A.
Mason
and
C.
Singh
, “
Surveying graduate students attitudes and approaches to problem solving
,”
Phys. Rev. Spec. Top.: Phys. Educ. Res.
6
,
020124
(
2010
); available at https://www.physport.org/assessments/assessment.cfm?I1/460&A1/4AAPS.
22.
I.
Halloun
and
D.
Hestenes
, “
Interpreting VASS dimensions and profiles for physics students
,”
Sci. Educ.
7
,
553
577
(
1998
).
23.
J. de la
Garza
and
H.
Alarcon
, “
Assessing students' attitudes in a college physics course in Mexico
,” in
Physics Education Research Conference 2010, PER Conference
(Portland, Oregon,
2010
), Vol. 1289, pp.
129
132
.
24.
M.
Milner-Bolotin
,
T.
Antimirova
,
A.
Noack
, and
A.
Petrov
, “
Attitudes about science and conceptual physics learning in university introductory physics courses
,”
Phys. Rev. Spec. Top.: Phys. Educ. Res.
7
,
020107
(
2011
).
25.
N.
Lederman
, “
Students' and teachers' conceptions of the nature of science: A review of the research
,”
J. Res. Sci. Teach.
29
,
331
359
(
1992
).
26.
See the Physport website here http://www.physport.org for an assortment of instrument surveys and articles.
27.
D.
Muchoney
,
The implementation of an interactive engagement model of instruction in high school physics
,” Ph.D. thesis,
The Robert Morris University
(
2008
), p.
71
.
28.
B.
Palomar
,
B.
Cruz
, and
J.
Rogel
, “
Science and non-science education students' images and epistemological beliefs toward physics learning
,” in
International History, Philosophy and Science Teaching Asian Regional Conference
(Taipei, Taiwan,
2014
).
29.
G.
Duffy
and
S.
Chance
, “
Improving engineering students design skills in a project-based learning course by addressing epistemological issues
,” in
40th SEFI Conference
(Thessaloniki, Greece,
2012
).
30.
R.
Coe
, “It's the effect size, stupid. WhateEffect size is and why it is important,” Paper presented at the
Annual Conference of the British Educational Research Association
, University of Exeter (
2002
).
31.
R.
Kirk
, “
Practical significance: A concept whose time has come
,”
Educ. Psychol. Meas.
56
,
746
759
(
1996
).
32.
M.
Rice
and
G.
Harris
, “
Comparing effect sizes in follow-up studies: ROC, Cohen's d and r
,”
Am. Psychol. Law Soc.
29
,
615
620
(
2005
).
33.
S.
Freeman
,
S.
Eddy
,
M.
McDonough
 et al, “
End of Lecture: Active learning increases student performance across the STEM disciplines
,”
Proc. Natl. Acad. Sci. U.S.A
111
,
8410
8415
(
2014
).
34.
D.
Allchin
,
Teaching the Nature of Science
(
SHiPS Education Press
,
Saint Paul, MN
,
2013
), pp.
3
27
.
35.
J.
Sweller
, “
Cognitive load during problem solving: effects on learning
,”
Cogn. Sci.
12
,
257
285
(
1988
).
36.
W.
McKeachie
and
M.
Svinicki
, “
How to make lectures more effective
,” McKeachie's Teaching Tips (
2006
), pp.
58
73
.
37.
J.
Cohen
,
Statistical Power Analysis for the Behavioral Sciences
(
L. Erlbaum Associates
,
Hillsdale, NJ
,
1988
).
38.
G.
Glass
,
B.
McGaw
, and
M.
Smith
, “Definition and interpretation of effect size,”
Meta-Analysis in Social Research
(
1981
), pp.
99
106
.
39.
R.
Lindell
and
J. P.
Olsen
, “
Developing the lunar phases concept inventory
,” in
Physics Education Research Conference 2002, PER Conference
(Boise, Idaho,
2002
).
40.
The following website http://www.ufos-aliens.co.uk/cosmicapollo.html is a prime example of standard arguments from a moon landing hoax supporter.
41.
M.
Hennessey
, “
Metacognitive aspect of students reflective discourse: implications for intentional conceptual change teaching and learning
,” in
Intentional Conceptual Change
, edited by
G. M.
Sinatra
and
P. R.
Pintrich
(
2003
), pp.
103
132
.
42.
P.
Hewson
,
M.
Beeth
, and
N.
Thorley
, “
Teaching for Conceptual Change
,”
International Handbook of Science Education
(
1998
), pp.
199
218
.
43.
M.
Sackes
, “
The role of cognitive, metacognitive, and motivational variables in conceptual change: Preservice early childhood teachers conceptual understanding of the cause of lunar phases
,” Ph.D. thesis,
Ohio State University
(
2010
).
44.
H.
Vilppu
,
M.
Mikkil-Ermann
, and
I.
Ahopelto
, “
The role of regulation and processing strategies in understanding science text among university students
,”
Scandinavian J. Educ. Res.
57
,
246
262
(
2013
).
45.
P.
Pintrich
,
C.
Wolters
, and
G.
Baxter
, “
Assessing metacognition and self-regulated learning
,” available online at <http://digitalcommons.unl.edu/burosmetacognition/3/> (
2000
).
46.
A.
Heikkila
and
K.
Lonka
, “
Studying in higher education: Students' approaches to learning, self-regulation, and cognitive strategies
,”
Stud. Higher Educ.
31
,
99
117
(
2006
).
47.
S.
Ambrose
,
M.
Bridges
,
M.
DiPietro
 et al,
How Learning Works: Seven Research Based Principles for Smart Teaching
(
Jossey-Bass Publishers
,
San Francisco, CA
,
2010
) pp. 188-216.
48.
See http://www.hhpublishing.com/_assessments/lassi/ for access to, and information on, LASSI.
49.
This brief inventory, https://www.harford.edu/~/media/PDF/Student-Services/Tutoring/Metacognition%20Awareness%20Inventory.ashx, provides a quick means by which to gauge ones metacognitive ability.
50.
L.
Aguilar
,
G.
Walton
, and
C.
Wieman
,
Phys. Today
67
(
5
),
43
49
(
2014
).
51.
T.
Angelo
and
K.
Cross
, “
Muddiest Point
,”
Classroom Assessment Techniques: A Handbook for College Teachers
(
Jossey-Bass Publishers
,
San Francisco, CA
,
1993
), pp.
154
158
.
52.
P.
Foos
,
Teach. Psychol.
1677
,
77
78
(
1989
).
53.
J.
Novak
,
Learning, Using and Creating Knowledge: Concept Maps as Facilitative Tools in Schools and Corporations
(
Taylor & Francis
,
Milton Park, England
,
2009
).
AAPT members receive access to the American Journal of Physics and The Physics Teacher as a member benefit. To learn more about this member benefit and becoming an AAPT member, visit the Joining AAPT page.