• Open Access

Development and reliability analysis of a split-administration test of the math epistemic games survey

Stephen Hackler, Emily Elliott, Mark Eichenlaub, and Alison M. Sweeney
Phys. Rev. Phys. Educ. Res. 19, 020152 – Published 27 October 2023

Abstract

The increasing and diversifying student enrollments in introductory physics courses make reliable, valid, and usable instruments for measuring student skills and gains ever more important. In introductory physics, in addition to teaching facts about mechanics, we also seek to teach our students the skills of “thinking like a physicist,” or expertise in and intuition for physical problem solving. How and when these expert, intuitive problem-solving skills emerge during a STEM education, or what the most effective teaching methods might be, are not certain. A facile survey to measure students’ “physics-thinking” skills in a pretest and post-test format is therefore desirable to measure and evaluate different pedagogical approaches. Prior investigators codified these skills as “epistemic games” (e.g., order-of-magnitude estimation, evaluating extreme cases) and developed and validated the math epistemic games survey (MEGS) to measure students’ ability to employ these techniques. The original survey instrument is reliable and valid but has drawbacks in its length and in students’ ability to recall questions between administrations. We employed factor analysis to split the MEGS into two mutually exclusive subtests and measured them to be equivalently reliable and valid as the full-length MEGS as originally formulated. The “split MEGS” is well suited for use as a pretest and post-test instrument to measure gains in expertise in problem solving in introductory physics courses.

  • Figure
  • Figure
  • Figure
  • Figure
  • Received 17 June 2022
  • Accepted 5 September 2023

DOI:https://doi.org/10.1103/PhysRevPhysEducRes.19.020152

Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI.

Published by the American Physical Society

Physics Subject Headings (PhySH)

Physics Education Research

Authors & Affiliations

Stephen Hackler1,2,*, Emily Elliott3, Mark Eichenlaub4,5,*, and Alison M. Sweeney1,6,*

  • 1Department of Physics and Astronomy, University of Pennsylvania, Philadelphia, Pennsylvania 19104, USA
  • 2Department of Physics, Swarthmore University, Swarthmore, Pennsylvania 19081, USA
  • 3Center for Teaching and Learning, University of Pennsylvania, Philadelphia, Pennsylvania 19104, USA
  • 4Physics Education Research Group, University of Maryland, College Park, Maryland 20742-4111, USA
  • 5Art of Problem Solving, Lewisburg, Pennsylvania 17831, USA
  • 6Departments of Physics and Ecology & Evolutionary Biology, Yale University, New Haven, Connecticut 06520-8106, USA

  • *Present address: 15330 Avenue of Science; San Diego, CA 92128, USA.

Article Text

Click to Expand

Supplemental Material

Click to Expand

References

Click to Expand
Issue

Vol. 19, Iss. 2 — July - December 2023

Reuse & Permissions
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review Physics Education Research

Reuse & Permissions

It is not necessary to obtain permission to reuse this article or its components as it is available under the terms of the Creative Commons Attribution 4.0 International license. This license permits unrestricted use, distribution, and reproduction in any medium, provided attribution to the author(s) and the published article's title, journal citation, and DOI are maintained. Please note that some figures may have been included with permission from other third parties. It is your responsibility to obtain the proper permission from the rights holder directly for these figures.

×

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×