The Persistent Gap: Insights from PISA 2022 and a Comparative Look at Global Performance Trends

 In an increasingly interconnected world, understanding global educational trends is crucial for policymakers, educators, and researchers alike. Building upon our previous analysis of the PISA 2018 data, this article delves into the most recent PISA 2022 results, offering fresh insights into the persistent challenges and evolving landscapes of global education.

The Programme for International Student Assessment (PISA) provides a unique opportunity to examine educational outcomes across diverse nations, shedding light on the complex interplay of factors that influence student performance. This analysis focuses on reading, mathematics, and science literacy, while also exploring the impact of socioeconomic factors such as parental education and home possessions.

As we navigate through the findings, I aim to not only present the current state of affairs but also to draw meaningful comparisons with my 2018 analysis. This longitudinal perspective allows us to identify trends, evaluate the effectiveness of educational policies, and consider the potential impact of global events, such as the COVID-19 pandemic, on educational outcomes.

The Sample

This study analyzes a dataset comprising 66,125 students from 10 countries, identified as the top 6 and bottom 4 in my 2018 analysis. Of the total, 42,147 students are from non-OECD countries, while 23,978 are from OECD nations. The gender distribution includes 32,559 female and 33,561 male students.

This dataset allows for a comparative analysis of educational systems, contrasting high-performing countries such as Korea and Hong Kong with those facing educational challenges, such as the Dominican Republic and Morocco. The categorization into top- and bottom-performing nations is based on my previous work, facilitating a comprehensive examination of global educational disparities.

A. Performance Across Domains: Reading, Mathematics, and Science

The PISA 2022 results reveal distinct patterns in student performance across the three key domains:

  • Reading: The mean score of 446.0 (SD = 114.0) reflects a symmetrically distributed performance (skewness = 0.0621). The median score of 445.0 closely matches the mean, indicating a balanced distribution of reading abilities across the sample.
  • Mathematics: Students performed slightly better in mathematics, with a mean score of 455.0 (SD = 115.0). A positive skew (0.367) suggests a distribution that tails towards higher scores, indicating a cluster around the mean with a subgroup of high performers.
  • Science: Science exhibits the highest mean score at 459.0 (SD = 111.0), accompanied by a modest positive skew (0.219). Similar to mathematics, this suggests a tendency towards higher performance among a subset of students.

Interestingly, all three domains display negative kurtosis (reading: -0.736, mathematics: -0.674, science: -0.770), indicating distributions flatter than a normal curve. This suggests a wider range of scores around the mean, potentially reflecting the diverse educational systems and backgrounds represented in the sample.

B. Socioeconomic Factors: Parental Education and Home Possessions

Two socioeconomic variables provide insight into students’ backgrounds:

  • Parental Education (paredint): The mean parental education level is 13.3 years (SD = 3.11), implying that most parents have completed secondary and some tertiary education. The distribution is negatively skewed (-1.35), indicating a longer tail towards lower education levels, while the positive kurtosis (1.76) suggests a peaked distribution, pointing to a potential divide in parental education levels.
  • Home Possessions (homepos): Replacing the wealth variable from PISA 2018, home possessions show a mean of -0.541 (SD = 1.22). The negative mean and median (-0.509) suggest that most students possess fewer home resources than the OECD average. However, the wide range (-7.90 to 15.2) and positive kurtosis (2.19) highlight substantial variability, with extreme values at both ends, indicating significant inequality in home resources.

C. Top vs Bottom Performing Country Analysis

The comparison of mean scores across mathematics, reading, and science reveals a stark contrast between top-performing and bottom-performing countries in the PISA 2022 assessment. Across all three subjects, top-performing countries consistently outscored their bottom-performing counterparts by a substantial margin of approximately 140-150 points. Science emerges as the strongest subject for both groups, with top countries averaging 514.6 points and bottom countries 372.1 points. Mathematics follows closely, with mean scores of 512.3 and 365.8 for top and bottom countries respectively. Reading appears to be the most challenging subject, particularly for bottom-performing countries, which scored an average of 359.1 points compared to 502.4 points for top countries. This persistent gap across all subjects underscores the significant disparities in educational outcomes between these two groups of countries.

Figure 1: Mean PISA 2022 Scores by Subject for Top and Bottom-Performing Countries. This bar chart illustrates the substantial performance gap in mathematics, reading, and science between top-performing and bottom-performing countries, with science showing the highest scores for both groups.

The key finding in both 2018 and 2022 is the persistent and substantial performance gap between top- and bottom-performing countries across all subjects. In 2022, this gap remains particularly pronounced in reading, suggesting that it remains the most challenging domain for lower-performing nations.

D. Gender Analysis: Persistent Gaps and Nuanced Patterns

The PISA 2022 results highlight the ongoing disparity in student performance between top- and bottom-performing countries, consistent with previous trends observed in the 2018 analysis. Across all subjects—reading, mathematics, and science—students from top-performing countries outscore their counterparts in bottom-performing nations by a significant margin. However, the 2022 data, particularly as shown in Figure 2, reveals additional complexity in the interplay of gender, subject performance, and country groupings.

In top-performing countries, females excel in reading (514.0 vs. 491.3 for males), while males slightly outperform females in mathematics (517.2 vs. 507.2) and science (515.8 vs. 513.2). These trends align with global educational patterns observed in many assessments, where females generally perform better in reading and males tend to have an edge in mathematics.

Conversely, in bottom-performing countries, females consistently outperform males across all subjects. The most striking difference is in reading, where females scored 372.9 compared to 345.4 for males. This pronounced gender gap in reading proficiency exists in both country groups, reinforcing the global trend of females outperforming males in this domain. Interestingly, the performance gap in mathematics, a traditionally male-dominated field, shows an inverted pattern: males outperform females in top-performing countries, but underperform relative to females in bottom-performing nations.


Figure 2: Mean PISA 2022 Scores by Subject, Gender, and Country Group (Top/Bottom Performers). This bar chart illustrates the performance differences between genders across mathematics, reading, and science in top and bottom-performing countries, revealing complex patterns of gender-based disparities within the broader context of country-level performance gaps.

The 2018 results similarly highlighted the performance gap between top and bottom-performing countries for both genders. Within each group, male and female students performed comparably in mathematics and science, with females showing a slight advantage in reading. However, the 2022 data reveals more nuanced gender dynamics, particularly within bottom-performing countries, where females outperformed males across all subjects.

E. Impact of Socioeconomic Status on Educational Outcomes

The PISA 2022 results presented in Figure 3 provide a detailed examination of the relationship between home possessions (a proxy for socioeconomic status), gender, academic performance, and country groupings. This analysis reinforces the substantial educational divide between top- and bottom-performing countries while offering additional insights into how socioeconomic factors and gender influence performance.

  1. Persistent Performance Gap: Across all subjects and socioeconomic quartiles, top-performing countries consistently outperform their bottom-performing counterparts. This mirrors the educational disparities observed in previous analyses, confirming that the performance gap between these two groups remains a significant issue.
  2. Socioeconomic Gradient: Across both top- and bottom-performing countries, a consistent and comparable increase in student test scores is observed across all subjects and genders as home possession levels rise. This trend suggests that students from households with more resources consistently perform better in both top- and bottom-performing nations, with no pronounced difference in the magnitude of the socioeconomic effect between these groups. The data indicates that higher home possessions correlate with better academic performance throughout, regardless of the country's overall educational performance.
  3. Gender Differences: As seen in previous figures, females outperform males in reading across all socioeconomic quartiles in both country groups. In mathematics and science, the gender gap is less pronounced and varies depending on the country group and socioeconomic quartile, indicating a more complex interaction between gender and subject performance.

Figure 3: Mean PISA 2022 Scores by Subject, Gender, Home Possession Quartile, and Country Group (Top/Bottom Performers). This comprehensive bar chart illustrates the complex relationships between socioeconomic status (represented by home possession quartiles), gender, academic performance in mathematics, reading, and science, and the broader context of country-level performance disparities.

Both the 2022 and 2018 analyses reveal that the effect of socioeconomic status on academic performance is much more pronounced in bottom-performing countries. The 2018 results similarly identified a clear gap between top- and bottom-performing countries across all wealth quartiles. In bottom-performing countries, there was a steady improvement in reading, math, and science scores from the lowest to the highest wealth quartile, consistent across genders.

F. The Role of Parental Education in Student Performance

Figure 4 provides a detailed examination of how parental education levels interact with gender, subject performance, and country groupings in the PISA 2022 results. This multifaceted analysis reveals several key insights:

  1. Persistent Performance Gap: The performance gap between top-performing and bottom-performing countries remains evident across all subjects (math, reading, and science) and parental education quartiles. Regardless of parental education level or gender, students from top-performing countries consistently achieve higher scores than their counterparts from bottom-performing countries.
  2. Parental Education Gradient: The relationship between parental education and student performance is non-linear in top-performing countries. In top-performing countries, students' test scores experience a slight dip as parental education increases from the 1st to the 2nd quartile across all subjects. This is followed by a substantial increase in scores as parental education moves from the 2nd to the 3rd quartile, after which there is a more pronounced dip in scores in the 4th quartile. 
    In bottom-performing countries, the trend is more stable, with small but consistent increases in students' reading, math, and science scores from the 1st to the 3rd quartiles. However, a similar dip in scores occurs in the 4th quartile, indicating that while higher parental education generally benefits student performance, there may be diminishing returns or other contextual factors influencing performance at the highest parental education levels in these countries as well.
    These fluctuations may point to potential over-involvement of parents in higher quartiles or excessive academic pressures on students in the highest quartiles, particularly in top-performing countries. In bottom-performing countries, the more moderate gains suggest that access to resources associated with parental education may be more incremental and less pronounced, while the dip in the 4th quartile could indicate a limit to the advantages provided by parental education in these environments.

3. Gender Differences: The gender gap remains consistent with previous analyses, where females outperform males in reading across all parental education quartiles in both top-performing and bottom-performing countries. In contrast, females tend to score lower than males in math and science. These gender differences are consistent across all quartiles and both country groups.

Furthermore, the pattern of change in scores—both the initial dip, the subsequent increase, and the dip in the 4th quartile—is consistent across genders and subjects. This indicates that gender does not significantly influence the general trend of score fluctuations based on parental education levels but reinforces known subject-based gender differences in performance.

Figure 4: Mean PISA 2022 Scores by Subject, Gender, Parental Education Quartile, and Country Group (Top/Bottom Performers). This comprehensive bar chart illustrates the intricate relationships between parental education levels, gender, academic performance in mathematics, reading, and science, and the broader context of country-level performance disparities.

The PISA 2022 results highlight the persistent performance gap between top- and bottom-performing countries, with students from top-performing countries continuing to excel across all subjects. However, the relationship between parental education and student performance follows a fluctuating pattern, particularly in top-performing countries. While higher parental education generally correlates with better scores, the dips in the 2nd and 4th quartiles suggest that other factors, such as parental expectations, involvement, or stress, may influence performance at higher levels of education.

In bottom-performing countries, the relationship between parental education and student performance is more stable, showing gradual improvements across the first three quartiles before a similar decline in the 4th quartile. The implications of these findings point to the need for targeted interventions that address the specific challenges and pressures associated with parental education, particularly in the higher quartiles, while continuing to promote resource access and support for students in lower quartiles.

The gender differences are consistent across all parental education levels, with females performing better in reading and males excelling in math and science, reaffirming the need for gender-sensitive educational policies that address these disparities and promote balanced academic support for both male and female students.

Conclusion and Further Analysis

It is crucial to note that these analyses are based on prima facie descriptive statistics. While they provide valuable insights and suggest important trends, they should be interpreted with caution. The next stage of our research will involve rigorous statistical analyses to determine whether these observed trends hold true when controlling for various factors and accounting for statistical significance.

In the forthcoming phase of my study, I will employ advanced statistical techniques to:

  1. Test the statistical significance of the observed differences and trends
  2. Control for confounding variables that may influence these relationships
  3. Explore potential causal mechanisms underlying the observed patterns
  4. Investigate interactions between variables that may not be apparent in descriptive statistics alone

Comments

Popular posts from this blog

Education Matters: Understanding Nepal’s Education (Publication Date: June 19, 2023, Ratopati-English, Link at the End)

Multiple Correspondence Analysis (MCA) in Educational Data

charting Concept and Computation: Maps for the Deep Learning Frontier