We report the results of our study of the connections between students’ learning of physics content knowledge and the development of general scientific reasoning abilities. In particular, we seek to determine whether and to what extent content learning affects the development of general reasoning abilities. Pre-college-instruction data of first-year college students in the United States and China were collected using the FCI, BEMA, and Lawson’s classroom test of scientific reasoning. We find that the rigorous learning of physics knowledge in middle and high schools has made a significant impact on the ability of students in China to solve physics problems, but this knowledge does not seem to have a direct effect on their general scientific reasoning ability, which is determined to be at the same level as that of the students in the United States.

1.
A.
Boudreaux
,
P. S.
Shaffer
,
P. R. L.
Heron
, and
L. C.
McDermott
, “
Student understanding of control of variables: Deciding whether or not a variable influences the behavior of a system
,”
Am. J. Phys.
76
(
2
),
163
170
(
2008
).
2.
E.
Etkina
,
A.
Van Heuvelen
,
Suzanne
White-Brahmia
,
David T.
Brookes
,
Michael
Gentile
,
Sahana
Murthy
,
David
Rosengrant
, and
Aaron
Warren
, “
Scientific abilities and their assessment
,”
Phys. Rev. ST Phys. Educ. Res.
2
,
020103
1
(
2006
).
3.
D. E.
Meltzer
, “
The relationship between mathematics preparation and conceptual learning gains in physics: A possible ‘hidden variable’ in diagnostic pretest scores
,”
Am. J. Phys.
70
(
12
),
1259
1268
(
2002
).
4.
V. P.
Coletta
and
J. A.
Phillips
, “
Interpreting FCI scores: Normalized gain, reinstruction scores, and scientific reasoning ability
,”
Am. J. Phys.
73
(
12
),
1172
1179
(
2005
).
5.
R. R.
Hake
, “
Relationship of individual student normalized learning gains in mechanics with gender, high-school physics, and pretest scores on mathematics and spatial visualization
,”
Physics Education Research Conference
, Boise, ID; August 2002; ⟨www.physics.indiana.edu/~hake/PERC2002h-Hake.pdf⟩.
6.
L.
Bao
, “
Dynamic models of learning and education measurement
,” ⟨arXiv.org/abs/0710.1375⟩.
7.
D. E.
Pritchard
,
Y.
Lee
, and
L.
Bao
, “
Mathematical learning models that depend on prior knowledge and instructional strategies
,”
Phys. Rev. ST Phys. Educ. Res.
4
,
010109
1
(
2008
).
8.
BBC News report, “
Mathematicians set Chinese test
,” ⟨news.bbc.co.uk/2/hi/uk_news/education/6589301.stm⟩.
9.
FCI stands for “Force Concept Inventory,” which (1995 version) is a 30-question multiple choice test covering basic concepts in Newtonian mechanics. See
D.
Hestenes
,
M.
Wells
, and
G.
Swackhamer
, “
Force concept inventory
,”
Phys. Teach.
30
(
3
),
141
158
(
1992
). The test used is the 1995 version.
10.
BEMA is the short name for “Brief Electricity and Magnetism Assessment,” which is a 31-question multiple choice test covering basic concepts in introductory E&M. See
L.
Ding
,
R.
Chabay
,
B.
Sherwood
, and
R.
Beichner
, “
Evaluating an electricity and magnetism assessment tool: Brief electricity and magnetism assessment
,”
Phys. Rev. ST Phys. Educ. Res.
2
,
010105
1
(
2006
).
11.
A. E.
Lawson
, The development and validation of a classroom test of formal reasoning,
J. Res. Sci. Teach.
15
(
1
),
11
24
(
1978
). Test used in study: Classroom Test of Scientific Reasoning, revised ed. (
2000
).
12.
A p-value of 0.05 or smaller indicates a statistically significant difference between the mean scores of two populations. The effect size can be approximately interpreted as the signal to noise ratio, in which the signal is the difference between two means and the noise is the standard deviation of the test results. A widely accepted guideline by Cohen defines 0.2 as small, 0.5 as medium, and 0.8 as large. If the effect size is larger than 0.8, the two population groups tested are often considered categorically different, meaning that they belong to two clearly distinguishable levels (categories) on an assessment scale. For more details on computing effect size and guidelines on interpreting effect sizes, see
L. V.
Hedges
and
I.
Olkin
,
Statistical Methods for Meta-Analysis
(
Academic
,
San Diego
,
1985
);
and
J.
Cohen
,
Statistical Power Analysis for the Behavioral Sciences
(
Erlbaum, Hillsdale
,
NJ
,
1988
), 2nd ed.
13.
See
L.
Bao
 et al, “
Learning and Scientific Reasoning
,”
Science
323
(
5914
),
586
587
(
2009
).
AAPT members receive access to the American Journal of Physics and The Physics Teacher as a member benefit. To learn more about this member benefit and becoming an AAPT member, visit the Joining AAPT page.