Introduction

Electrical engineering involves the design and production of a range of artifacts, from smart microdevices and robotics to supercomputers and citywide power systems (Gross & Roppel, 2012; Rauf, 2021). With the proliferation of new technologies and the systems that manage and renew electricity, electrical engineering is among the most transformational agents of societal change in the twenty-first century. The study of energy is typically introduced in elementary science classrooms, where electric circuits are positioned as tools for the learning of what energy is, how it is conserved and transferred, and how it can be utilized in technologies for the benefit of all (NGSS Lead States, 2013). The design of devices that operate with electrical energy is part of the recent movement of the Career and Technical Education (CTE) pathways for high school students. These newer CTE courses and programs—previously known as vocational education—provide more hands-on activities to support the development of technical skills that lead to certificates, apprenticeships, jobs, and relevant experience for college (U.S. Department of Education, 2019). Circuitry design principles, therefore, are central to the skills needed to extend a prototype into a mass-produced technology capable of widespread change.

With the launch of the Maker Movement at the turn of the twenty-first century, the emergence of new maker toolkits is changing the way we engage electrical engineering, including new on-ramps into learning advanced electrical engineering. For example, the introduction of sewable and playdough-based circuits into educational environments have illuminated ways that changing our materials have strengthened learning outcomes and broadened access to the big ideas of electrical circuits (Peppler & Glosson, 2013; Peppler et al., 2018). Promising innovations such as these alert us to the need to re-examine our STEM tools and materials and better align them to our targeted learning objectives. This manuscript strives to push beyond basic circuitry learning to target a broader array of advanced concepts important to the design and creation of new printed circuit boards (PCBs), including space allocation (i.e., floorplanning), placement of electronic components, and routing (Kularatna, 2008; Mitzner et al., 2019; Webb, 2016; Wilson, 2018).

For this study, we use two types of toolkits used for circuitry learning and making: paper circuits and the solderless breadboard. The objective for this comparison is to closely examine the educational opportunities to engage in targeted electrical engineering concepts and assess how features of each toolkit afford or obstruct possibilities for learning. In this study with pre-college participants, we address the following research questions: How do each of these toolkits impact the learning of simple circuitry, including polarity, current flow, and connections? How do each of these toolkits impact the learning of advanced circuitry design principles, including space allocation, placement of electronic components, and routing? In the process, we discuss the design features of the kits that seem to best support learning outcomes and illuminate how each set of materials uniquely solicit body- and material-syntonic patterns of activity, thus differentially engaging learners’ powerful ideas around circuitry and design principles. This study extends previous empirical work on the different roles that toolkits and materials play for learning circuitry (Peppler & Glosson, 2013; Peppler et al., 2018). By performing systematic studies on recent electronic tools and materials, we seek to understand how to shape equitable participation of teenage learners and illuminate design principles for future toolkits to effectively support learning.

Background

Constructionism and Powerful Ideas

The current work is built on the theoretical foundation of Papert’s constructionism. This body of thinking grew out of Piaget’s developmental theory of constructivism. Constructivism focuses on developing mental models: structures in the mind that become more complex as learners grow and are able to more accurately categorize and represent new information in their minds. Following Piaget’s work, Papert shifts our understanding of learning out of the head alone and places emphasis on representations out in the world. Papert asserts that learning happens in especially meaningful ways through the construction of artifacts—abstract or physical—that can be publicly shared and reflected upon.

In particular, the constructionist concept of powerful ideas helps illuminate some of the big ideas in circuitry design that may lead to more learning and innovation in the future. These ideas may be new to the learner, or entirely new innovations, but discovering them opens unimagined possibilities in ways that more traditional, instructor-focused methods cannot. According to Papert, a constructionist approach that involves building and creating with materials and artifacts results in a type of learning that is more intimate and less fragmented than much school learning. A goal here is for learners to develop deeper ideas of important concepts; learners should have opportunities to “get to know” and “explore” a body of knowledge through interaction and creation. Papert also thought the body should work in parallel with objects to illuminate powerful ideas. This idea, known as body syntonicity, takes into account the body as part of the constellation of materials in a learning environment by designing maps or parallels between the body and the objects being manipulated. For example, in Papert’s LOGO settings, youth would often physically map the path of the turtle with their own bodies, gaining unique understandings of the computing concepts they used. More recent work has examined the new possibilities at the intersection of body syntonicity and the tools and materials used in learning—an expansive theoretical concept known as material syntonicity (Keune, 2022). We take a related stance here as we are interested in how tools and materials for circuitry learning prompt particular actions and intra-actions, potentially leading to varied understandings of advanced circuit layout design.

For the later grades in particular, the use of such embodied and tangible manipulatives is sometimes lost in classrooms, especially as the concepts become more abstract and demanding. A goal of the current work is to explore whether some forms of learning to design circuits better support both body and material syntonicity, and thus making the powerful ideas of circuit design more accessible.

Foundational Concepts About Electric Circuits

Electric circuitry concerns the formation of various electric components into a closed loop that allow electrons to flow, producing work along the way (e.g., Glisson, 2011). A simple electric circuit can be constructed with an energy source, connected with conductive paths to a load (e.g., light bulb). An electric load is a component or system of components that consumes electrical energy. Prior research has demonstrated that the teaching of electric circuitry frequently produces common conceptual misunderstandings, particularly in the areas of current flow, connections, and polarity (Osborne, 1981, 1983; Shipstone, 1984, 1988; Peppler & Glosson, 2013).Footnote 1 In fact, Fredette and Lochhead (1980) found that misconceptions related to polarity were still present in college students. However, research demonstrates that attending to the tools and materials used to teach circuitry can lead to profound learning outcomes around these persistently challenging concepts, even for children as young as 4 years old (Peppler et al., 2018). Prior work with a playdough electronics kit showed preschool children demonstrating learning about current flow, connections, and polarity as well as gains in their ability to discuss circuitry concepts after seven play sessions (Peppler et al., 2018). This body of research has begun to demonstrate that tools and materials seem to have an impact on circuitry learning for middle-school youth as well. Electronic textiles were used to teach circuitry to a group of middle school youth, who were then tested on their understanding of current flow, connections, and polarity. The outcomes of this work demonstrated that assessment scores improved significantly on these concepts after ten 2-h sessions (Peppler & Glosson, 2013). As important as these three targeted circuitry concepts (i.e., current flow, connections, and polarity) are to understand electrical circuits, there are more advanced circuitry concepts that warrant further exploration. Within this space, other research has used toys and e-textiles to prompt novel circuitry solutions with undergraduate learners, and used debugging/problem-solving as a circuitry assessment metric with high-school learners. Together, these lines of research suggest that exploring the affordances of multiple tools used to teach advanced circuitry concepts and ideas may allow designers and educators to make more informed choices to improve and enhance circuitry learning across educational levels. This is only one small sub-area of the ongoing effort toward more effective and useful assessments within the larger maker movement, both in formal classrooms and in informal learning environments (e.g., Wardrip et al., 2021). The current study illuminates advanced circuitry and layout design principles—fundamental areas of electronics and engineering education—that can be uniquely learned with these particular sets of tools and materials.

Circuit Prototyping: Breadboards and PCBs

One of the most common toolkits for electrical circuit learning in electrical engineering labs is the solderless breadboard. The use of solderless breadboards for prototyping electric systems is to temporarily fix electronic components in place and their different connecting wires. Breadboards are often made of wood, glass-reinforced plastic (fiberglass), or thermoset polymers or plastics (epoxy) with fasteners made out of metallic nails, pins, or springs to hold the components.

The different components are not permanently secured with solder so any circuit can be built and taken apart to change its configurations. Solderless breadboards are often the preferred toolkit in electrical engineering labs and industry for their convenience in the creation, design, and testing of prototypes of electrical devices (Fig. 1).

Fig. 1
figure 1

Examples of a circuit prototype on a solderless breadboard (left) and of a PCB with internal electric components of a cell phone (right)

If a circuit prototype works according to requirements, the designer may decide to create a more permanent solution on a printed circuit board (PCB), replacing the bulky breadboard with a lighter and smaller support surface and all wires with conductive traces of copper. The configuration of an electric circuit increases in complexity as the number of components increases (Fig 1).

PCBs are made out of non-conductive material laminated with conductive metal in between providing structural support to hundreds of connections for micro-electronic components.

PCB Layout Design Principles

There are three general design principles that experts consider when designing PCBs: (1) space allocation or floorplanning, (2) placement of components, and (3) routing or trace positioning (Mitzner et al., 2019; Webb, 2016; Wilson, 2018). Adequate space allocation considers the constraints of cost, speed of data transmission, and manufacturing capabilities (Wilson, 2018). Another general principle is the placement of components, which usually depends on a variety of considerations, such as heat avoidance, signal interference, and performance (Wilson, 2018; Mitzner et al., 2019). Lastly, the positioning of traces or connections between elements ensures that elements are connected to the power source and ground, as well as avoiding cross of conductive paths (Wilson, 2018). Due to the ongoing increase in complexity of electronic devices, electrical engineers and circuit designers commonly utilize electronic design automation (EDA) softwareFootnote 2 (e.g., Altium Designer, OrCAD, Fritzing, EAGLE) to assist with the design of PCBs (Cohen, 1988; Fan, 2001; Hedges & Olkins, 1985; Sawilowsky, 2009; Thompson, 2002; Wilson,1956; Zaiontz, 2020). EDA software allows designers to follow the three general design principles of space allocation, placement of components, and routing, in addition to other important considerations in the layout of PCBs.

Maker Circuitry Toolkits

The Maker Movement brings a revival of do-it-yourself (DIY) projects and fosters the use and creation of diverse maker toolkits for projects. Examples of maker toolkits range from sewable and playdough-based circuits to high-tech microcontrollers and single-board computers (Fig. 2). Though maker toolkits may be used in industry for prototyping purposes of “real-life” applications on control systems, these toolkits are generally different from circuitry and control tools used in industry. For example, the high-tech end of the maker toolkits could control industrial processes after receiving input from connected sensors. They could control timing or sequential tasks, but they are not built to withstand harsh industrial environments, nor are easily programmed as programmable logic controllers (PLCs), the specialized devices used in industry for control purposes. Nonetheless, circuitry toolkits can scaffold learning of practices of electrical engineers, particularly those that design circuits.

Fig. 2
figure 2

Current high-tech circuitry toolkits as exposed PCBs. From left to right, the microcontroller boards, Arduino UNO R3 and micro: bit v2, and the single-board computers, Raspberry Pi 4B and the BeagleBone® AI

Methods

We collected data for this study as part of a series of week-long programs for youth offered by an art + science museum partner. We designed two analogous workshops centered on circuitry using educational circuitry toolkits: (1) traditional solderless breadboards and (2) paper circuits. Each workshop included pre- and post-tests to assess the understanding of circuitry, such as current flow, polarity, and connections, and the practice of circuit layout following the design principles for component placement and (wire) routing or trace positioning. We used a coding scheme informed by previous studies (Peppler & Glosson, 2013) to analyze the pre- and post-circuitry diagram assessments.

Research Questions

The research questions guiding this study are:

  1. 1.

    How do each of these toolkits impact the learning of simple circuitry, including polarity, current flow, and connections?

  2. 2.

    How do each of these toolkits impact the learning of layout design principles, including space allocation (or floor planning), placement of electronic components, and routing?

Setting and Participants

We implemented the two circuitry workshops in the Science Gallery Museum housed in Trinity College, Dublin (Ireland), a midsize city with a population of 1.2 million. This museum is a partner organization for a larger project that investigates ways to engage youth with STEM + Art-related content. Science Gallery provides educational programs at no cost during week-long workshops and hands-on activities usually related to their exhibits. The museum exhibits are designed from contemporary societal issues and presented to the audiences from an intersectional perspective informed by the disciplines of science, technology, art, and design. The workshops of this study coincided with the museum’s exhibition on issues of sustainability and environmental impacts of plastics. During the week, youth engaged in an exhibition tour, collaborative design projects and workshops. One of those workshops was our circuitry workshop.

Regarding participant selection for the study, the partner museum recruited students on its website, social media, and through information flyers mailed to schools, particularly those in socio-economic disadvantaged areas or very rural areas. Youth participants registered online to a weekly session according to their availability and preference. We did not disclose the type of toolkit they would engage with to ensure that the differences between the conditions were not due to their preference.

Because PCB design and manufacturing are generally introduced in the classroom at college level and not before, this study targeted youth ages 15–16 years old. Twenty-one youth were included in the study sample; 12 participants for the breadboard group (6 females and 6 males) and 9 participants for the paper circuit group (7 females and 2 males). Table 1 shows the number of participants by level of experience prior to their assigned workshop. The majority of participants had never experienced either working with breadboards or paper circuit toolkits.

Table 1 Percentage of participants (N = 21) with prior experience level with circuitry toolkits

The Circuitry Workshops

Each circuitry workshop consisted of three 1-h sessions held throughout the week-long program at the museum. In session 1, participants took a pre-test to assess their prior knowledge on basic concepts of circuitry before being introduced to the basic components and concepts of creating a circuit. The introduced concepts were power source or batteries, current flow, conductor, load, circuit, and polarity. The basic electronic components were a 3-V battery, battery holder, LEDs, and conductive material (e.g., wire) depending on the type of toolkit used. The challenge for the first session was to use these components and create a circuit to light up one LED. In session 2, participants were taught how to light up additional LEDs in the circuit, as well as introduce a switch. At the end of the second session, the participants were challenged to include one switch to turn on and off a LED. In session 3, participants were first shown how a pre-programmed microcontroller board could be used to turn on and off the provided LEDs (the programming of the board was out of the scope of these workshops), followed by open-ended collaboration time where teams could create a project that integrated the electric components. At the end of the last session, the participants took a post-test which assessed the understanding of the same content of the pre-test.

The curriculum was uniquely created for the purposes of this workshop and was enacted identically across the two conditions. Each condition introduced key terms (e.g., conductivity, current flow, load, resistance) and their relationship to the materials used, and followed a similar overview of activity. Where material differences necessitated instructions specific to each condition, the corresponding instruction was used in the other condition to minimize differences in how concepts were presented in each group (Table 2).

Table 2 Activity excerpt from curriculum for day 1 of the workshop

Toolkits

The two toolkits explored in this study were the traditional solderless breadboard and a paper circuitry toolkit, Chibitronics™ (Qi, 2012; Qi et al., 2015). Both toolkits were used to create circuits without the need of soldering to attach and connect electronic components.

Breadboards contain arrangements of tiny holes and metallic strips of clips, framed by two sets of vertical metal strips (rails or busses), that provide common power and ground when connected to a power source (see Fig 3).

Fig. 3
figure 3

Front and back views of solderless breadboard exposing power rail columns and metallic rows of clips

Paper circuits combine paper crafts and arts with circuitry and computer programming. Paper-based surfaces serve as the foundation for circuit designs, upon which users place peel-sticker LEDs and copper tape to connect components to each other and to the power source. Paper circuitry is also solderless and the same fundamental circuit concepts apply to the components and circuit configurations to power the projects. However, while paper circuits can be used to prototype circuitry concepts and layout design principles, these materials are also designed to become more permanent forms of art-making. Paper circuit projects use copper tape to connect the circuit stickers to paper, which can then be surrounded by artistic elements with personal meaning (see Fig. 4). Paper electronics tend to appeal to people who already participate in crafting and who are willing to work with these circuit stickers regardless of the potential for complexity.

Fig. 4
figure 4

Chibitronics™ materials with an introductory project (left); and Pu Gong Ying Tu (Dandelion Painting) by Jie Qi (right)

There are a couple of evident differences in circuitry design between the two toolkits (Table 3). The first difference has to do with space allocation due to the size of the work area. Paper circuit projects are not constrained by the small surface area of the breadboard to place and connect components, though multiple breadboards can be attached and multiple insulated wires can be used. The second difference is related to the placement of the components. Due to the space constraints of the connecting surface of the breadboard, components need to be connected to the metallic strips through the tiny openings which are already in close proximity. In addition, component orientation and alignment relative to each other is also constrained to the grid-like configuration of the breadboard. In contrast, sticker components of paper circuits can be placed throughout the paper-based surfaces. Finally, the third difference is related to the aspect of routing connections. Insulated wires used for breadboard projects can touch and cross without causing short circuits. In contrast, connecting traces with copper tape cannot touch or cross because they will cause short circuits. Also, another distinct property of the position of the connecting elements (or routing) is that the copper tape in the paper circuits is positioned or routed on a 2-dimensional (2D) or flat surface making sure the traces do not touch. In the breadboard toolkit, the flexible insulated wires are placed on a 3-dimensional (3D) space on top, bottom, crossing, touching other wires. This 2D vs. 3D positioning of the connections facilitates or complicates (depending on the toolkit) accurate connections and troubleshooting actions. It can be easier to figure out accurate connections in the paper circuit projects.

Table 3 Comparison table of circuit components across the two toolkits

Data Sources

The design of the pre- and post-circuit diagram assessments used in this study were used to assess circuitry understanding by creating working circuit diagrams of the power source and microcontroller boards in each question and stickers representing the switch and LEDs. As circuitry understanding is traditionally rooted in the tools and materials in which they are learned (e.g., Peppler & Glosson, 2013), pictures of the actual components were used to represent working circuit diagrams. We consulted with commercial kit designers, licensed teachers, historical examples found in textbooks, and licensed engineers over a period 18 months to refine the assessment, helping to ensure that the items and coding categories identified would have content validity. In constructing the rubric, we aimed to find alignment between what is valued by industry and areas taught in the K-16 classrooms. Each assessment had four sections, one section corresponding to one circuitry toolkit: breadboard, paper circuits, littleBits™ (Bdeir, 2009), and LilyPad Arduino (i.e., e-textiles) (Buechley et al., 2013). These sections of the assessment compared how youth formed working circuits using materials familiar to them (i.e., the kit they used during the workshop) against less familiar materials (i.e., the other three kits they did not use during the workshop), exposing general learning gains as well as indicators of preparedness for future learning (Bransford & Schwartz, 1999). Given that this is a new and exploratory area of research, this study aimed to check the utility and feasibility of this new instrument through a pre-post design to examine the extent to which the instrument could detect changes in overall understanding of circuitry and layout design over the course of the workshop.

To control for prior experience, each section asked participants if they had prior experience with each of the presented four toolkits and asked them to use the provided stickers of electronics components and a pencil to diagram (A) a working circuit with one LED and a switch; and (B) a circuit where three LEDs in the circuit could perform a different function. This resulted in an eight-item assessment (two items for each of the targeted toolkits).

Analytical Techniques

In order to address our research questions, we used criteria presented in Table 4 to score each of the eight assessment diagrams according to the presence or not of understanding of the three basic circuitry concepts and layout design principles.

Table 4 Scoring criteria for basic circuit concepts and layout design principles per test

For questions on the basic circuitry concepts, we assigned a “0” if any of the three basic circuitry concepts were absent or a “1” if any were present. One of the authors and another research assistant coded 30 of the tests, randomly selected, reaching a high interrater reliability of κ = 0.836 (Cohen, 1960) before they split up the remaining assessments and coded the remaining data for basic circuitry concepts. Both raters were blind to the workshop condition, had backgrounds in engineering or robotics, and neither was an instructor during the workshop. To assess layout design, we assigned different values to the multi-function circuit diagrams (involving the three LEDs and a microcontroller) according to the presence of the four layout design principles. These codes were only applied to the four assessment items that asked learners to create working circuits with multiple LEDs. Two raters with experience with circuitry designs scored all tests together. Polarized component orientation was scored by assigning a 1 for each components’ positive terminal oriented toward one of the microcontroller board’s pins. Trace-to-trace spacing was scored by assigning one point for each line from each LED’s positive terminal that did not touch any other positive and one more point if no positive line touched or crossed any negative lines. Power distribution was scored by assigning one point for each line that correctly connected each LED’s positive terminal to a different pin in the microcontroller board to indicate proper connection to power. Finally, correct and effective ground distribution was scored with one point for each line that correctly connected each LED’s negative terminal to the negative terminal of the microcontroller board and one more point for one shared line to the negative terminal.

Due to the fact that the scores for basic circuitry concepts and layout design principles have two different scales, maximum scores were multiplied by a factor of 5/4 (1.25) to standardize data and assist comparisons made between the two. See Table 5 for examples of coded items across pre- and post-tests.

Table 5 Example of pre- and post-test scoring of each test section (cases from Kiera and Eileen—both pseudonymous) from the paper circuit workshop)

Statistical Analysis

To determine how each of these toolkits impact the learning of simple circuitry and the practice of advanced circuitry design principles, we used SPSS to perform paired-samples t-tests to examine differences and changes between groups. We ran paired-samples t-tests for each of the seven constructs to compare groups at different points in time (i.e., within-subjects factor). We also ran independent-samples t-tests to compare the mean gain scores of basic and design layout constructs for the two independent workshop groups (i.e., between-subjects factor) to determine how each toolkit related to each of the seven constructs.

The unequal sample size (n = 12 and n = 9 for each of the groups) made this an unbalanced design. Therefore, we used the results of the Welch t-test to correct for these types of unbalanced designs (Howell, 2010). We checked all assumptions for the normal distribution of variables, homogeneity of variances, and identification of problematic extreme outliers. The variables for connections, polarity, and ground violated the normality assumption with p values less than 0.05 in the Shapiro–Wilk test. However, considering the exploratory nature of this study, we proceeded performing the t-tests backed by previous findings from Boneau (1960), Posten (1984), and Schmider et al. (2010), confirming the robustness of t-test and ANOVA to violations of normality.

Findings

Overview of Combined or Total Scores

Both toolkit groups had statistically significant within-group differences, where learners in both groups performed better in the post-test than in the pre-test. However, when comparing pre- to post-test scores, youth had a higher gain mean score for paper circuits as compared to the breadboard workshop in terms of combined scores, basic concepts, and layout design principles. After running independent-samples t-tests of the total scores between groups (Fig. 5), we found two differences of total gain scores of breadboard and paper circuits to be statistically significant but at the p < 0.10 level using Welch’s test for correction of unequal sample sizes, t(16.050) =  − 2.096, p = 0.052, with a large effect size of Hedges’ g = 0.9.

Fig. 5
figure 5

Comparisons of combined or total mean gain scores between toolkits. Note. Mean (M), standard deviation (SD), and statistical significance (p) are displayed. *Significant difference at the p < 0.10 level

This overview presented all t-tests with total scores, so we further breakdown these total scores by performing t-tests of each of the three basic concepts and four layout design principles.

Basic Circuitry Concepts

Participants in both groups performed better in the post-test for each of the three basic concepts with gains after the workshops. For the breadboard workshop condition, the highest gain score was for current flow (M = 20.8, SD = 25.7, p < 0.05), followed by polarity (M = 9.4, SD = 22.7) and connections (M = 7.3, SD = 12.5, p < 0.1). For the paper circuit workshop condition, the highest gain score was for polarity (M = 33.3, SD = 21.7, p < 0.05), followed by current flow (M = 15.3, SD = 23.2, p < 0.10) and connections (M = 11.1, SD = 17.1, p < 0.10). The only gain without significant difference between pre and post was the polarity score for the breadboard workshop.

When we ran independent-samples t-tests of the gain scores for the three basic concepts, current flow, connections, and polarity, the only mean gain score to achieve statistical significance at the p < 0.05 level (using Welch’s test) was polarity, where the mean gain score in the paper circuits (M = 33.3, SD = 21.7) surpassed the breadboard group (M = 9.4, SD = 22.7). We believe the printed positive ( +) and negative ( −) signs on the corresponding terminals on the LED stickers used in the tests may have contributed to the higher gain scores for the paper circuit participants.

Design Layout Principles

Participants in both groups performed better for each of the four layout design principles with gains after the workshops (see Fig 6). For the breadboard workshop condition, the highest gain scores were for ground distribution (M = 28.6, SD = 28.4) and power distribution (M = 28.5, SD = 36.7), both statistically significant at p < 0.05 level, followed by trace-to-trace spacing (M = 9.4, SD = 25.8) and orientation of polarized components (M = 9.0, SD = 17.6), none with statistically significant differences. In contrast, all gain scores for design layout principles from the paper circuit workshop condition were statistically significant at p < 0.05 level. The highest gain score was for power distribution (M = 56.5, SD = 27.6), followed by trace-to-trace spacing (M = 31.9, SD = 28.2), orientation of polarized components (M = 30.6, SD = 31.7), and ground distribution (M = 29.2, SD = 22.3).

Fig. 6
figure 6

Comparison of trace spacing (and routing) of a PCB and paper circuit and breadboard projects. (1) An example of a PCB showing parallel and non-crossing traces illustrating a proper trace-to-trace spacing. (2) Paper circuit project depicting a similar 2D configuration as an actual PCB. (3) Same circuitry project using a breadboard but with a convoluted 3D configuration with touching traces (wires)

Independent-samples t-tests that compared mean gain scores for the four layout design principles between toolkits (Fig. 7) revealed that power distribution gains were higher in the paper circuit group (M = 56.5, SD = 27.6) than the breadboard group (M = 28.5, SD = 36.7) and statistically significant at p < 0.10 level (using Welch’s test). Similarly, the mean gain score for trace-to-trace spacing in the paper circuit group (M = 31.9, SD = 28.2) exceeded that of the breadboard group (M = 9.4, SD = 25.8), just as it did regarding orientation of polarized components (paper circuits: M = 30.6, SD = 31.7; breadboard: M = 9.0, SD = 17.6), both statistically significant at p < 0.10 level (using Welch’s test). Finally, the mean gain score in the paper circuits for ground distribution (M = 29.2, SD = 22.3) was a bit higher than that of the breadboard group (M = 28.6, SD = 28.4) but not statistically significant (p = 0.963).

Fig. 7
figure 7

Comparisons of mean gain scores of layout design principles between toolkits. Mean (M), Standard deviation (SD), and statistical significance (p) are displayed. *Significant difference at the p < 0.10 level

Effect Sizes: Within and Between Groups

Effect sizes provide the actual magnitude of the differences of the mean scores (Coe, 2002; Sullivan & Feinn, 2012; Lakens, 2013; Cumming, 2014), but since experimental designs generally deal with sample effect sizes (not population effect sizes), they are influenced by sampling variability brought by the sample sizes. Thus, we also calculate confidence intervals for all sample effect sizes.Footnote 3

Effect Sizes Within Groups

The repeated measures effect size Hedges’ grm compares standardized effect sizes in order to illustrate the magnitude of the sample mean difference. For example, the effect size for connections between pre and post in the breadboard group was Hedges’ grm = 0.77, indicating that the magnitude of the sample mean difference between pre and post is 0.77 standard deviations. The breadboard toolkit also had large effects for the basic concept of current flow (Hedges’ grm = 0.95) and for the layout design principles, power (grm = 0.89) and ground distribution (grm = 1.20) (Table 6).

Table 6 Effect sizes within the breadboard group

We can conclude that larger post-mean scores are evidence of learning for these concepts after the participants participated in the breadboard workshop. For the large effect sizes on current flow (grm = 0.95), power (grm = 0.89), and ground (grm = 1.20) distribution, we conjecture that the marked power rails with the positive (in red) and negative (in blue) signs and lines along the rails (see Fig. 3) supported the learner to follow the direction of the current flow from the power source and back to ground. In contrast, the paper circuit toolkit had large effects in the basic concepts of connections (Hedges’ grm = 0.83) and polarity (grm = 2.15), and in all layout design principles, orientation of polarized components (grm = 1.02), trace-to-trace spacing (grm = 1.18), power distribution (grm = 2.02), and ground distribution (grm = 1.73) (Table 7).

Table 7 Effect sizes within the paper circuit group

Effect Sizes Between Groups

All large effect size differences favored the paper circuit group over the breadboard group. The only large effect for the basic concepts was polarity (Hedges’ grm = 1.03) but large effects were found in all of the layout design principles: orientation of polarized components (grm = 0.84), trace-to-trace spacing (grm = 0.81), and power distribution (grm = 0.81) (see Table 8 ). We interpret the small effect sizes for current flow, connections, and ground distribution (in Table 8) as neither the paper circuits nor the breadboard toolkit performs higher than the other. In other words, both workshops seemed to positively impact higher scores (see medium to large effect sizes in Tables 6 and 7).

Table 8 Effect sizes of between group comparison

Discussion

In examining the outcomes of this study, we see that both toolkits advance understanding, yet the tools and materials used in the paper circuit toolkit vastly outperform the standard breadboard kit in terms of affording possibilities for learning targeted concepts and layout design principles. To explain these differences, we can turn to prior research that illuminates how the materials (e.g., metal, plastic), properties (e.g., transparent, hard, flexible, weight), and forms (e.g., shape, size) of our STEM educational toolkits impact learning outcomes (Peppler & Glosson 2013; Peppler et al., 2018). Viewing these findings through the constructionist notions of body syntonicity and material syntonicity (Keune, 2022), we start to understand how tools and actions that mirror and mimic the embedded concepts may lead to stronger outcomes in learning and understanding. In this instance, we can hypothesize that human-material intra-actions create concept-clarifying parallels between the body and the objects being manipulated.

Furthermore, we also see that paper circuits promote arts integration with STEM, leading artistic exploration into STEM engagement. In this case, the comparatively prescribed design options for a breadboard are replaced by the “blank canvas” of paper and the addition of crafting supplies, encouraging learners in the paper circuit condition to imagine new possibilities for circuit design. Creating a circuit using copper-colored tape and paper provides flexibility and possibility for exploration with esthetics, color, shape, unexpected uses of circuits, and more. According to Papert, exploring concepts through personalized interaction and imagination forges the formation of powerful ideas of a domain. This is a similar pattern found in other toolkits that promote artistic engagement; in addition to a more artistic output, the process of crafting these types of circuits seems to deepen opportunities for applications of STEM concepts for greater learning.

Further, arts integration seems to demonstrate a broader applicability for transfer of circuitry concepts from one set of context and materials to another. With flexible materials that require deep embodied actions, such as pressing down copper tape along its entire trace, circuitry kits like paper circuits create a unique type of relationship between the materials and the elements that are necessary to build a working circuit. This leaves space for learners to apply parts of that close relationship to other toolkits and potentially learn the new materials more easily. This power of the more arts-based toolkits is echoed in studies where learners who used such kits outperformed their peers (Peppler et al., 2018). Maker toolkits and the integration of new materials bring about promising new ways to rethink how concepts are taught, and help educators and designers imagine new ways for electrical engineering to advance societal needs unmet by our current uses of electrical energy.

Implications for Teaching and Learning

While we have a good understanding of the features that promote basic circuitry learning, more work is needed to tightly tie design features to advanced STEM conceptual categories. In this effort, we explore design features of each toolkit in support of electrical engineering concepts, based on their relative strengths in cultivating these understandings. Based on our findings, we list relevant toolkit features and how they afford or obstruct learning of targeted circuitry concepts and design layout principles (Tables 9 and 10).

Table 9 Toolkit features that afford or obstruct learning of targeted basic circuitry concepts
Table 10 Toolkit features that afford or obstruct learning of targeted design layout principles

The design hypotheses included here build on a growing body of research on the materiality of learning (Peppler & Glosson 2013; Peppler et al., 2018), which urges for a new mapping of design features and theoretical content to be further tested. In combination with the findings presented in this study, such design recommendations encourage educators to be deliberate when considering using any type of educational toolkit and assess how the materiality and features of the toolkits can positively afford or obstruct possibilities for learning. Additionally, these observations can be used to empirically inform the design of future toolkits, inviting designers to better align their design choices to targeted conceptual content. 

Implications for Assessment

This study presented an initial foray into addressing the need for new educational assessments and studies on circuitry and layout design. The above results demonstrated that the tested rubric is both reliable and valid for use in out-of-school electronics workshops: its content was validated by consulting with teaching artists and by aligning to standards and showed high inter-rater reliability.

A strength of the assessment is that it took place in the context of a short 3-day workshop activity in a low-stakes environment. As the activity captures learning over time, the rubric could be used at different time points to evaluate student development across the selected concepts measured by the instrument (sample items are in Table 4). This initial effort to create an unobtrusive, research-based assessment toward the support of program evaluation and other interested stakeholders shows promise in its reliability, validity, and ability to assess learning over time.

Conclusion, Limitations, and Further Work

By performing systematic studies on recent electronic tools and materials, this study sought to understand how more advanced circuitry and layout design principles can be materialized for future teaching and learning experiences. In the process, findings suggest illuminate design principles for future toolkits to effectively support learning. Further research should seek to test each of the design hypotheses listed here under controlled experiments and a broader range of participants and settings (see Table 11 for an emerging set of design principles specific to this work). To clarify the relationship between these design features and their learning outcomes, it would require that we provide opportunities for learners to engage with multiple types of materials and closely examine the actions and interactions that the materials prompt and discourage.

Additionally, further work is needed on convergent and discriminant validity of the circuitry and layout design assessment instrument. A limitation of the current design is that we did not employ other measures of reliability such as test–retest reliability and internal consistency. Test–retest reliability was not appropriate for the two treatment groups since we hypothesized that scores would change over time. Future research could add a control group to establish test–retest reliability and examine the internal consistency of the rubric, as another indicator of its reliability.