We have empirically identified over 40 distinct sub-skills that affect a person's ability to solve complex problems in many different contexts. The identification of so many sub-skills explains why it has been so difficult to teach or assess problem solving as a single skill. The existence of these sub-skills is supported by several studies comparing a wide range of individuals' strengths and weaknesses in these sub-skills, their “problem solving fingerprint,” while solving different types of problems including a classical mechanics problem, quantum mechanics problems, and a complex trip-planning problem with no physics. We see clear differences in the problem solving fingerprint of physics and engineering majors compared to the elementary education majors that we tested. The implications of these findings for guiding the teaching and assessing of problem solving in physics instruction are discussed.

1.
D. P.
Maloney
, “
An Overview of Physics Education Research on Problem Solving
,” in
Getting Started in PER
, edited by
C.
Henderson
and
K. A.
Harper
(
American Association of Physics Teachers
,
College Park, MD
,
2011
), Reviews in PER Vol.
2
, <http://www.per-central.org/items/detail.cfm?ID=11457>.
2.
National Research Council (NRC)
,
Adapting to a Changing World— Challenges and opportunities in Undergraduate Physics Education
(
National Academies Press
,
Washington, DC
,
2013
).
3.
OECD
, PISA 2012 Assessment and Analytical Framework: Mathematics, Reading, Science, Problem Solving and Financial Literacy, <> (
2013
).
4.
R. E.
Mayer
and
M.
Whitrock
, “
Problem Solving
,” in
Handbook of Educational Psychology
, 2nd ed., edited by
Patricia A.
Alexander
and
Philip H.
Winne
(
Erlbaum
,
New Jersey
,
2006
), Chap. 13, pp.
287
303
.
5.
J. H.
Larkin
, “
Processing Information for Effective Problem Solving
,”
Eng. Educ.
70
(
3
),
285
288
(
1979
).
6.
J. H.
Larkin
,
J.
McDermott
,
D. P.
Simon
, and
H. A.
Simon
, “
Expert and novice performance in solving physics problems
,”
Science
208
(
4450
),
1335
1342
(
1980
).
7.
M. T. H.
Chi
,
P. S.
Feltovich
, and
R.
Glaser
, “
Categorization and representation of physics problems by experts and novices
,”
Cogn. Sci.
5
,
121
152
(
1981
).
8.
A. H.
Schoenfeld
,
Mathematical Problem Solving
(
Academic Press, Inc.
, Harcourt Brace Javanovich,
Orlando
,
1985
).
9.
C.
Singh
, “
When physical intuition fails
,”
Am. J. Phys.
70
,
1103
1109
(
2002
).
10.
S.
Wineburg
, “
Reading Abraham Lincoln: An expert/expert study in the interpretation of historical texts
,”
Cogn. Sci.
22
,
319
346
(
1998
).
11.
P.
Heller
,
R.
Keith
, and
S.
Anderson
, “
Teaching problem solving through cooperative grouping. Part 1: Group versus individual problem solving
,”
Am. J. Phys.
60
(
7
),
627
636
(
1992
).
12.
D.
Huffman
, “
Effect of explicit problem solving instruction on high school students' problem-solving performance and conceptual understanding of physics
,”
J. Res. Sci. Teach.
34
(
6
),
551
570
(
1997
).
13.
P.
Heller
and
M.
Hollabaugh
, “
Teaching problem solving through cooperative grouping. Part 2: Designing problems and structuring groups
,”
Am. J. Phys.
60
(
7
),
637
644
(
1992
).
14.
J. I.
Heller
and
F.
Reif
, “
Prescribing effective human problem-solving processes: Problem description in physics
,”
Cogn. Instrum.
1
(
2
),
177
216
(
1984
).
15.
D. M.
Bunce
and
H.
Heikkinen
, “
The effects of an explicit problem-solving approach on mathematical chemistry achievement
,”
J. Res. Sci. Teach.
23
,
11
20
(
1986
).
16.
G.
DiLisi
,
J.
Eulberg
,
J.
Lanese
, and
P.
Padovan
, “
Establishing problem-solving habits in introductory science courses
,”
J. College Sci. Teach.
35
(
5
),
42
47
(
2006
).
17.
D. P.
Maloney
, “
Research on Problem Solving: Physics
,” in
Handbook of Research on Science Teaching and Learning Project
, edited by
D. L.
Gabel
(
MacMillan Publishing Company
,
New York
,
1993
).
18.
J. R.
Anderson
and
C. D.
Schunn
, “
Implications of the ACT-R learning theory: No magic bullets
,” in
Advances in instructional psychology
, edited by
R.
Glaser
(
Lawrence Erlbaum Associates
,
New Jersey
,
2000
), Vol.
V
, pp.
1
34
.
19.
B.
Ross
, “
Cognitive science: Problem solving and learning for physics education
,”
AIP Conf. Proc.
951
,
11
14
(
2007
).
20.
W. L.
Anderson
,
C. A.
Sensibaugh
,
M. P.
Osgood
, and
S. M.
Mitchell
, “
What really matters: Assessing individual problem-solving performance in the context of biological sciences
,”
Int. J. Schol. Teach. Learn.
5
(
1
),
17-1
20
(
2011
).
21.
J.
Docktor
and
K.
Heller
, “
Robust assessment instrument for student problem solving
,” in
Proc. NARST 2009 Annual
(
NARST
,
Reston, VA
,
2009
).
22.
E. E.
Gayon
, The Problem-solving ability of high school chemistry students and its implications in redefining chemistry education, <http://academia.edu/593365/THE_PROBLEM-SOLVING_ABILITY_OF_HIGH_SCHOOL_CHEMISTRY_STUDENTS_AND_ITS_IMPLICATIONS_IN_REDEFINING_CHEMISTRY_EDUCATION> (
2005
).
23.
D.
Hestenes
and
M.
Wells
, “
A mechanics baseline test
,”
Phys. Teach.
30
,
159
166
(
1992
).
24.
J.
Marx
and
K.
Cummings
, “
Development of a survey instrument to gauge students' problem-solving abilities
,”
AIP Conf. Proc.
1289
,
221
224
(
2010
).
25.
S.
Klein
,
R.
Benjamin
,
R.
Shavelson
, and
R.
Bolus
, “
The collegiate learning assessment: Facts and fantasies
,”
Eval. Rev.
31
,
415
439
(
2007
).
26.
ACT
CAAP Technical Handbook
(
ACT
,
Iowa City, IA
,
2007
).
27.
Educational Testing Service (ETS)
,
MAPP User's Guide
(
Educational Testing Service
,
Princeton, NJ
,
2007
).
28.
Cognition and Technology Group at Vanderbilt
,
The Jasper Project: Lessons in Curriculum, Instruction, Assessment, and Professional Development
(
Lawrence Erlbaum Associates
, Mahwah,
New Jersey
,
1997
).
29.
30.
See supplementary material at http://dx.doi.org/10.1119/1.4913923 for problem solving rubric; the Great Pyramid of Piza problem; McKagen's interview protocol and an example of a quantum mechanics problem used in these interviews.
31.
University of Maryland Physics Education Group, Alternative homework Assignments (AHA), <http://www.physics.umd.edu/perg/abp/aha/index.html> (
2002
).
32.
W. K.
Adams
, Development of a Problem Solving Evaluation Instrument; Untangling of specific problem solving skills, <www.unco.edu/nhs/physics/faculty/adams/research.html> (
2008
).
33.
S. B.
McKagan
,
K. K.
Perkins
, and
C. E.
Wieman
, “
Reforming a large lecture modern physics course for engineering majors using a PER-based design
,”
AIP Conf. Proc.
883
,
34
37
(
2007
).
34.
W. K.
Adams
and
C. E.
Wieman
, “
Problem solving skill evaluation instrument—validation studies
,”
AIP Conf. Proc.
883
,
18
21
(
2007
).

Supplementary Material

AAPT members receive access to the American Journal of Physics and The Physics Teacher as a member benefit. To learn more about this member benefit and becoming an AAPT member, visit the Joining AAPT page.