This paper presents a case study assessing and analyzing student engagement with and responses to binary, descriptive, and computational questions testing the concepts underlying resistor networks (series and parallel combinations). The participants of the study were undergraduate students enrolled in a university in Pakistan. The majority of students struggled with the descriptive question, and while successfully answering the binary and computational ones, they failed to build an expectation for the answer, and betrayed significant lack of conceptual understanding in the process. The data collected was also used to analyze the relative efficacy of the three questions as a means of assessing conceptual understanding. The three questions were revealed to be uncorrelated and unlikely to be testing the same construct. The ability to answer the binary or computational question was observed to be divorced from a deeper understanding of the concepts involved.

1.
Carl
Wieman
, “
Why not try a scientific approach to science education?
,”
Change: Mag. Higher Learn.
39
(5),
9
15
(
2007
).
2.
Carl
Wieman
and
Katherine
Perkins
, “
Transforming physics education
,”
Phys. Today
58
(
11
),
36
41
(
2005
).
3.
Joshua
Von Korff
,
Benjamin
Archibeque
,
K.
Alison Gomez
,
Tyrel
Heckendorf
,
Sarah B.
McKagan
,
Eleanor C.
Sayre
,
Edward W.
Schenk
,
Chase
Shepherd
, and
Lane
Sorell
, “
Secondary analysis of teaching methods in introductory physics: A 50 k-student study
,”
Am. J. Phys.
84
(
12
),
969
974
(
2016
).
4.
Kathryn
Williamson
,
Edward E.
Prather
, and
Shannon
Willoughby
, “
Applicability of the Newtonian gravity concept inventory to introductory college physics classes
,”
Am. J. Phys.
84
(
6
),
458
466
(
2016
).
5.
Ashiq
Hussain
,
Muhammad
Azeem
, and
Azra
Shakoor
, “
Physics teaching methods: scientific inquiry vs traditional lecture
,”
Int. J. Humanit. Social Sci.
1
(
19
),
269
276
(
2011
).
6.
Nadia
Naviwala
, “
A slogan ready for retirement
,”
Dawn
, 29 May
2017
,
<https://
www.dawn.com/news/1335980>.
7.
Nadia
Siddiqui
and
Stephen
Gorard
, “
Comparing government and private schools in Pakistan: The way forward for universal education
,”
Int. J. Educ. Res.
82
,
159
169
(
2017
).
8.
Harold
Aldermana
,
Peter F.
Orazemb
, and
Elizabeth M.
Paternoc
, “
School quality, school cost, and the public/private school choices of low-income households in Pakistan
,”
J. Human Resour.
36
,
304
326
(
2001
).
9.
Ajmal G.
Malik
, “
Code-switching: Awareness about its utility in bilingual classrooms
,”
Bull. Educ. Res.
32
(
2
),
23
44
(
2010
).
10.
J. D.
Irwin
and
R. M.
Nelms
,
Basic Engineering and Circuit Analysis
, 11th ed. (
Wiley
,
New York
,
2015
).
11.
Richard
Newman
,
Brandon
van der Ventel
, and
Crischelle
Hanekom
, “
First-year university Physics students' knowledge about direct current circuits: Probing improvement in understanding as a function of teaching and learning interventions
,”
Phys. Educ.
52
(
4
),
045014
(
2017
).
12.
Ane
Leniz
,
Kristina
Zuza
, and
Jenaro
Guisasola
, “
Students' reasoning when tackling electric field and potential in explanation of dc resistive circuits
,”
Phys. Rev. Phys. Educ. Res.
13
(
1
),
010128
(
2017
).
13.
Paula V.
Engelhardt
and
Robert J.
Beichner
, “
Students' understanding of direct current resistive electrical circuits
,”
Am. J. Phys.
72
(
1
),
98
115
(
2004
).
14.
Eugenia
Etkina
,
Sahana
Murthy
, and
Xueli
Zou
, “
Using introductory labs to engage students in experimental design
,”
Am. J. Phys.
74
(
11
),
979
986
(
2006
).
15.
See supplementary material at https://doi.org/10.1119/1.5008266 for raw collected data and R scripts for analyzing and plotting case study data.
16.
Mohsen
Tavakol
and
Reg
Dennick
, “
Making sense of Cronbach's alpha
,”
Int. J. Med. Educ.
2
,
53
55
(
2011
).
17.
The value of ρT was calculated using open-source software R, available at https://www.r-project.org/. The source code (see Ref. 15) has been made available online.
18.
Colin S.
Wallace
and
Janelle M.
Bailey
, “
Do concept inventories actually measure anything?
,”
Astron. Educ. Rev.
9
(
1
),
010116
(
2010
).
19.
James G.
Kalbfleisch
,
Probability and Statistical Inference
(
Springer Science & Business Media
,
New York
,
2012
), Vol. 2.
20.
David C.
LeBlanc
,
Statistics: Concepts and Applications for Science
(
Jones & Bartlett Learning
,
Sudbury, MA
,
2004
), Vol. 2.
21.
T.
Christie
and
M.
Afzaal
, “
Rote memorization as a sufficient explanation of secondary school examination achievement in Pakistan: An empirical investigation of a widespread assumption
,” in
International Conference on Assessment and the Future Schooling and Learning. International Association for Educational Assessment
,
Abuja, Nigeria
,
2005
.
22.
Sarwat
Nauman
, “
Lack of critical thinking skills leading to research crisis in developing countries: A case of Pakistan
,”
Learned Publ.
30
(
3
),
233
236
(
2017
).

Supplementary Material

AAPT members receive access to the American Journal of Physics and The Physics Teacher as a member benefit. To learn more about this member benefit and becoming an AAPT member, visit the Joining AAPT page.