Cybersecurity professionals need hands-on training to prepare for managing the current advanced cyber threats. To practice cybersecurity skills, training participants use numerous software tools in computer-supported interactive learning environments to perform offensive or defensive actions. The interaction involves typing commands, communicating over the network, and engaging with the training environment. The training artifacts (data resulting from this interaction) can be highly beneficial in educational research. For example, in cybersecurity education, they provide insights into the trainees' learning processes and support effective learning interventions. However, this research area is not yet well-understood. Therefore, this paper surveys publications that enhance cybersecurity education by leveraging trainee-generated data from interactive learning environments. We identified and examined 3021 papers, ultimately selecting 35 articles for a detailed review. First, we investigated which data are employed in which areas of cybersecurity training, how, and why. Second, we examined the applications and impact of research in this area, and third, we explored the community of res
Evidence-based education has become a central concept in science education, with meta-analyses often regarded as the gold standard for informing practice. This emphasis raises critical questions concerning the applicability, generalizability and transferability of research findings into classroom practice. It remains unclear both what kind of evidence education should be based on and whether science education research can provide the type of evidence required to guide decisions at different levels. This paper argues that theories play a crucial role in building bridges between research and practice. Drawing on literature from science education and the philosophy of science, we contrast the explanatory scope of meta-analyses with the predictive and integrative potential of theories, understood in a structuralist sense as systems of models with defined domains of applicability. We propose that science education research requires both fundamental and applied research, each contributing to theory development at different levels, ranging from local and context-specific models to more fundamental theoretical frameworks. Importantly, we argue that theories in science education should not
Quantum information science (QIS) is an emerging interdisciplinary field at the intersection of physics, computer science, electrical engineering, and mathematics leveraging the laws of quantum mechanics to circumvent classical limitations on information processing. With QIS coursework proliferating across US institutions, including at the undergraduate level, we argue that it is imperative that ethics and social responsibility be incorporated into QIS education from the beginning. We discuss ethical issues of particular relevance to QIS education that educators may wish to incorporate into their curricula. We then report on findings from focus interviews with six faculty who have taught introductory QIS courses, focusing on barriers to and opportunities for incorporation of ethics and social responsibility (ESR) into the QIS classroom. Few faculty had explicitly considered discussion of ethical issues in the classroom prior to the interview, yet instructor attitudes shifted markedly in support of incorporating ESR in the classroom as a result of the interview process itself. Taking into account faculty's perception of obstacles to discussing issues of ESR in coursework, we propose
It is becoming increasingly important that physics educators equip their students with the skills to work with data effectively. However, many educators may lack the necessary training and expertise in data science to teach these skills. To address this gap, we created the Data Science Education Community of Practice (DSECOP), bringing together graduate students and physics educators from different institutions and backgrounds to share best practices and lessons learned from integrating data science into undergraduate physics education. In this article we present insights and experiences from this community of practice, highlighting key strategies and challenges in incorporating data science into the introductory physics curriculum. Our goal is to provide guidance and inspiration to educators who seek to integrate data science into their teaching, helping to prepare the next generation of physicists for a data-driven world.
Contribution: This article analyzes the learning effectiveness of a virtual educational escape room for teaching software engineering and compares this activity with traditional teaching through a randomized controlled trial. Background: Educational escape rooms have been used across a wide variety of disciplines at all levels of education and they are becoming increasingly popular among teachers. Nevertheless, there is a clear general need for more robust empirical evidence on the learning effectiveness of these novel activities and, particularly, on their application in software engineering education. Research Questions: Is game-based learning using educational escape rooms more effective than traditional lectures for teaching software engineering? What are the perceptions of software engineering students toward game-based learning using educational escape rooms? Methodology: The study presented in this article is a randomized controlled trial with a pre-and post-test design that was completed by a total of 326 software engineering students. The 164 students belonging to the experimental group learned software modeling by playing an educational escape room whereas the 162 student
This entry introduces educational games in secondary schools. Educational games include three main types of educational activities with a playful learning intention supported by digital technologies: educational serious games, educational gamification, and learning through game creation. Educational serious games are digital games that support learning objectives. Gamification is defined as the use of "game design elements and game thinking in a non-gaming context" (Deterding et al. 2011, p. 13). Educational gamification is not developed through a digital game but includes game elements for supporting the learning objectives. Learning through game creation is focused on the process of designing and creating a prototype of a game to support a learning process related to the game creation process or the knowledge mobilized through the game creation process. Four modalities of educational games in secondary education are introduced in this entry to describe educational games in secondary education: educational purpose of entertainment games, serious games, gamification, and game design.
Demographic data collection is essential in education research, as demographic data allows researchers to better describe the participant population they study and to contextualize findings. However, current research practices for neurodiversity demographics often rely on prescriptive methods (e.g., requiring participants to report official diagnoses) rather than allowing participants to self-identify. This approach can: a) not allow participants to express their intersecting identities in ways that are authentic; and b) limit trustworthiness and reliability of the data and interpretation. In addition, inconsistent dissemination and representation of demographic data across studies hinder the accessibility and usability of this work. Through a literature review of neurodivergent student experiences with learning and performing STEM, we identified widespread discrepancies in how demographic information is collected and reported. This paper explores how neurodivergent identities can be more accurately and inclusively represented in education research. We present findings of a thematic analysis on the ways neurodivergent demographic data collection is done in the literature using data
Physics Education Research (PER) practitioners have engaged in substantial curriculum development and dissemination work in recent years. Yet, it appears that this work has had minimal influence on the fundamental teaching practices of typical physics faculty. To better understand this situation interviews were conducted with 5 likely users of physics education research. All reported making changes in their instructional practices and all were influenced, to some extent, by educational research. Yet, none made full use of educational research and most had complaints about their interactions with educational researchers. In this paper we examine how these instructors used educational research in making instructional decisions and identify divergent expectations about how researchers and faculty can work together to improve student learning. Although different instructors emphasized different aspects of this discrepancy between expectations, we believe that they are all related to a single underlying issue: the typical dissemination model is to disseminate curricular innovations and have faculty adopt them with minimal changes while faculty expect researchers to work with them to inc
In the symposium contributions we discuss research in physics education and the consequences of its results for physics teaching. The symposium presents four different aspects of physics teaching and learning, but all of them have research-based problem analysis in common. The problems analysed cover different aspects of the physics teaching-learning process. Innovative aspects such as the effect on learning of the integration of engineering projects in the science teaching process, the influence on the learning process of conceptions about science and attitudes, and aspects related to teaching contents and students' learning difficulties. Its conclusions are not merely intuitive proposals based on teaching experience, but on a careful planning of data collection, analysis of results and empirical basis
In the last decade, major efforts have been made to promote inquiry-based mathematics learning at the tertiary level. The Inquiry-Based Mathematics Education (IBME) movement has gained strong momentum among some mathematicians, attracting substantial funding, including from some US government agencies. This resulted in the successful mobilization of regional consortia in many states, uniting over 800 mathematics education practitioners working to reform undergraduate education. Inquiry-based learning is characterized by the fundamental premise that learners should be allowed to learn 'new to them' mathematics without being taught. This progressive idea is based on the assumption that it is best to advance learners to the level of experts by engaging learners in mathematical practices similar to those of practising mathematicians: creating new definitions, conjectures and proofs - that way learners are thought to develop 'deep mathematical understanding'. However, concerted efforts to radically reform mathematics education must be systematically scrutinized in view of available evidence and theoretical advances in the learning sciences. To that end, this scoping review sought to con
We believe that economists have much to learn from educational research practices and related pedagogical innovations in other disciplines, in particular physics education. In this paper we identify three key features of physics education research that distinguish it from economics education research - (1) the intentional grounding of physics education research in learning science principles, (2) a shared conceptual research framework focused on how students learn physics concepts, and (3) a cumulative process of knowledge-building in the discipline - and describe their influence on new teaching pedagogies, instructional activities, and curricular design in physics education. In addition, we highlight four specific examples of successful pedagogical innovations drawn from physics education - context-rich problems, concept tests, just-in-time teaching, and interactive lecture demonstrations - and illustrate how these practices can be adapted for economic education.
A difficult challenge in physics education is to design professional development programs for teachers, which can lead to fundamental changes in their practise. We report all activities for physics teachers in the context of the National Plan for Scientific Degrees in Southern Tuscany. Research and practice have shown that physics teaching in school is inadequate. The main consequences are limited achievements in school, decrease of students' interests in learning physics and decrease of enrolments in physics in many countries. In recent years, the decline in enrolments was faced up with the launch of a wide national project addressed to secondary school students and teachers. The active involvement of teachers in the design of laboratories was found to be essential for obtaining actions which were not transitory and entered permanently in classroom practice. We describe some advanced courses in Physics and Mathematics Education realized few years ago and courses designed for a Master in Physics Educational Innovation and Orienting performed jointly by many Italian universities. Other activities are less formal but equally relevant, such as the active involvement of expert, young a
The higher education (HE) sector benefits every nation's economy and society at large. However, their contributions are challenged by advanced technologies like generative artificial intelligence (GenAI) tools. In this paper, we provide a comprehensive assessment of GenAI tools towards assessment and pedagogic practice and, subsequently, discuss the potential impacts. This study experimented using three assessment instruments from data science, data analytics, and construction management disciplines. Our findings are two-fold: first, the findings revealed that GenAI tools exhibit subject knowledge, problem-solving, analytical, critical thinking, and presentation skills and thus can limit learning when used unethically. Secondly, the design of the assessment of certain disciplines revealed the limitations of the GenAI tools. Based on our findings, we made recommendations on how AI tools can be utilised for teaching and learning in HE.
The gap between theory and practice is well-documented in educational research. Physics teachers' willingness to apply research findings in practice may be influenced by a sceptical attitude towards science education research. This study explores physics teachers' perspectives on science education research, with a particular focus on potential scepticism towards the discipline. A two-step mixed-methods approach was employed: (1) Interviews with a purposeful sample of 13 experienced physics teachers for a first exploration of attitudes towards physics education research, and (2) a quantitative survey of 174 physics teachers to examine, among other aspects, the previously observed attitudes in a larger sample and to identify teacher profiles using latent profile analysis. The interview study revealed both sceptical and non-sceptical attitudes towards physics education research, including some that fundamentally questioned its practical value. Based on the survey data and latent profile analysis, four distinct teacher profiles differing in their level of scepticism towards science education research were identified. While one profile is highly sceptical, the other three exhibit a mix
Randomized A/B comparisons of alternative pedagogical strategies or other course improvements could provide useful empirical evidence for instructor decision-making. However, traditional experiments do not provide a straightforward pathway to rapidly utilize data, increasing the chances that students in an experiment experience the best conditions. Drawing inspiration from the use of machine learning and experimentation in product development at leading technology companies, we explore how adaptive experimentation might aid continuous course improvement. In adaptive experiments, data is analyzed and utilized as different conditions are deployed to students. This can be achieved using machine learning algorithms to identify which actions are more beneficial in improving students' learning experiences and outcomes. These algorithms can then dynamically deploy the most effective conditions in subsequent interactions with students, resulting in better support for students' needs. We illustrate this approach with a case study that provides a side-by-side comparison of traditional and adaptive experiments on adding self-explanation prompts in online homework problems in a CS1 course. Thi
For many students, introductory college science courses are often the only opportunity in their formal higher education to be exposed to science, shaping their view of the subject, their scientific literacy, and their attitudes towards their own ability in STEM. While science writing instruction has been demonstrated to impact attitudes and outlooks of STEM majors in their coursework, this instructional strategy has yet to be explored for non-majors. In this work, we investigate student attitudes towards STEM before and after taking a writing-intensive introductory astronomy course. We find that students cite writing about science as beneficial to their learning, deepening their understanding of science topics and their perspective on science as a field and finding writing to be a "bridge" between STEM content and their focus on humanities in their majors. Students also report increased perceptions of their own ability and confidence in engaging with STEM across multiple metrics, leaving the course more prepared to be informed, engaged, and science literate citizens.
Modern Education is not \textit{Modern} without AI. However, AI's complex nature makes understanding and fixing problems challenging. Research worldwide shows that a parent's income greatly influences a child's education. This led us to explore how AI, especially complex models, makes important decisions using Explainable AI tools. Our research uncovered many complexities linked to parental income and offered reasonable explanations for these decisions. However, we also found biases in AI that go against what we want from AI in education: clear transparency and equal access for everyone. These biases can impact families and children's schooling, highlighting the need for better AI solutions that offer fair opportunities to all. This chapter tries to shed light on the complex ways AI operates, especially concerning biases. These are the foundational steps towards better educational policies, which include using AI in ways that are more reliable, accountable, and beneficial for everyone involved.
Physics education researchers (PER) often analyze student data with single-level regression models (e.g., linear and logistic regression). However, education datasets can have hierarchical structures, such as students nested within courses, that single-level models fail to account for. The improper use of single-level models to analyze hierarchical datasets can lead to biased findings. Hierarchical models (a.k.a., multi-level models) account for this hierarchical nested structure in the data. In this publication, we outline the theoretical differences between how single-level and multi-level models handle hierarchical datasets. We then present analysis of a dataset from 112 introductory physics courses using both multiple linear regression and hierarchical linear modeling to illustrate the potential impact of using an inappropriate analytical method on PER findings and implications. Research can leverage multi-institutional datasets to improve the field's understanding of how to support student success in physics. There is no post hoc fix, however, if researchers use inappropriate single-level models to analyze multi-level datasets. To continue developing reliable and generalizable
Contribution: This article analyzes the learning and motivational impact of teacher-authored educational video games on computer science education and compares its effectiveness in both face-to-face and online (remote) formats. This work presents comparative data and findings obtained from 217 students who played the game in a face-to-face format (control group) and 104 students who played the game in an online format (experimental group). Background: Serious video games have been proven effective at computer science education, however, it is still unknown whether the effectiveness of these games is the same regardless of their format, face-to-face or online. Moreover, the usage of games created through authoring tools has barely been explored. Research Questions: Are teacher-authored educational video games effective in terms of learning and motivation for computer science students? Does the effectiveness of teacher-authored educational video games depend on whether they are used in a face-to-face or online format? Methodology: A quasi-experiment has been conducted by using three instruments (pre-test, post-test, and questionnaire) with the purpose of comparing the effectiveness o
Quaternions, discovered by Sir William Rowan Hamilton in the 19th century, are a significant extension of complex numbers and a profound tool for understanding three-dimensional rotations. This work explores the quaternion's history, algebraic structure, and educational implications. We begin with the historical context of quaternions, highlighting Hamilton's contributions and the development of quaternion theory. This sets the stage for a detailed examination of quaternion algebra, including their representations as complex numbers, matrices, and non-commutative nature. Our research presents some advancements compared to previous educational studies by thoroughly examining quaternion applications in rotations. We differentiate between left and right rotations through detailed numerical examples and propose a general approach to rotations via a theorem, clearly defining the associated morphism. This framework enhances the understanding of the algebraic structure of quaternions. A key innovation is presenting a three-dimensional example illustrating the rotation of a frame with strings, connecting quaternions to the quaternion group, half-integer spin phenomena, and Pauli matrices.