EdTech is not the silver bullet for COVID catch-up

As we enter the midway point of the Autumn term in the academic year 2022 – 23, the continuing impact of COVID and the disruption to learning for the last two academic years is a constant challenge for anyone involved in education.

In the UK, the recent release of the KS1 data reports attainment has decreased in all subjects compared to 2019. 67% of pupils met the expected standard in reading, down from 75% in 2019, 68% of pupils met the expected standard in maths, down from 76% in 2019 and 58% of pupils met the expected standard in writing, down from 69% in 2019 (1).

At secondary level, the unprecedented changes to the way GCSE results were awarded in the summers of 2020 and 2021, as well as the changes to the methods of assessment for the most recent academic year, mean we need to use caution when comparing data with previous years. However, the most recent data shows the KS4 disadvantage gap index has widened compared to 2020/21, from 3.79 to 3.84. Even before the pandemic in the academic years between 2017 and 2019, the gap had widened from 3.66 to 3.7 (2).

In the USA, the National Center for Education Statistics (NCES) conducted a special administration of the NAEP long-term trend (LTT) reading and mathematics assessments for age 9 students to examine student achievement during the COVID-19 pandemic. Average scores for age 9 students in 2022 declined 5 points in reading and 7 points in mathematics compared to 2020. This is the largest average score decline in reading since 1990, and the first ever score decline in mathematics (3).

From a global perspective, the World Bank reported a learning crisis in low and middle-income countries, with learning poverty estimated at 57% and 87% in Sub-Saharan Africa in 2019. The learning poverty rate measures the share of children who cannot read a simple text with comprehension by the age of 10. Since the onset of COVID and the disruption caused by the pandemic, modelling for 2022 estimates that learning poverty for low- and middle-income countries is now 70 percent (4). 

The universal foundational skills of reading and mathematics are essential for any child and form the foundations for societies to flourish, and as a parent and educator it is heart breaking to see this widespread learning poverty. We have a moral responsibility at a global and governmental level to help close the attainment gaps and tackle learning poverty, as this threatens to undermine the future of today’s children and the economic prospects of their countries. 

Education has encountered monumental challenges over the last two years, yet one sector has appeared to thrive since the onset of the pandemic. The annual 2022 report by Brighteye Ventures (5) shows global funding for EdTech companies increased from $7.7 billion in 2019 to $15 billion in 2020. In 2021, the investment in educational technology increased by a further 34% to an eye watering $20.1 billion dollars. 
Unfortunately, I believe that the increase in investment into EdTech is not the silver bullet to solve the challenges facing education. Between 2014 and 2019, $36 billion dollars was invested in educational technology without much impact on attainment. Increasing funding into EdTech solutions without a robust evidence base for which approaches work best, will just result in funding interventions that make little difference or could even cause harm. 

Recently, I have read the book ‘The Hard Thing about Hard Things: Building a Business When There Are No Easy Answers by Ben Horowitz (6). One quote stands out for me when I think about the investment in EdTech and the challenges within education. “There is no silver bullet that's going to fix that. No, we are going to have to use a lot of lead bullets”. 

If EdTech is to make a difference within education, we need to use robust evaluations to find out what works, for whom, and in different contexts to build an evidence base to help inform teachers, school leaders, parents and governments on the best bets in education. The good news is that we are starting to see a move towards using evidence to support decisions to purchase EdTech interventions. In the USA, the creation of the ESSA (Every Students Succeeds Act) Tiers of Evidence in 2015 provides districts and schools with a framework for determining which programmes, practices, strategies, and interventions work in which contexts and for which students (7). As more schools and districts demand robust evidence of impact, EdTech companies will be required to provide this evidence. 

In education and EdTech investment, we need to challenge the evidence of impact prior to investing in products, so that we can make informed decisions on what may be the best bets to improve the educational outcomes of learners. I have previously posted about how we can use more innovative methodological approaches to provide cost effective and time efficient evaluations within education, so I will not be repeating this here. I will just finish requoting Ben Horowitz, ‘we are going to have to use a lot of lead bullets’ to address the widening inequalities in learning.


References

(1) https://explore-education-statistics.service.gov.uk/find-statistics/key-stage-1-and-phonics-screening-check-attainment

(2) Key stage 4 performance, Academic Year 2021/22 – Explore education statistics – GOV.UK (explore-education-statistics.service.gov.uk)

(3) https://www.nationsreportcard.gov/highlights/ltt/2022/

(4) https://thedocs.worldbank.org/en/doc/e52f55322528903b27f1b7e61238e416-0200022022/original/Learning-poverty-report-2022-06-21-final-V7-0-conferenceEdition.pdf

(5) https://www.brighteyevc.com/post/the-european-edtech-funding-report-2022

(6) Ben Horowitz (2014) The Hard Thing About Hard Things: Building a Business When There Are No Easy Answers

(7) https://ies.ed.gov/ncee/edlabs/regions/midwest/pdf/blogs/RELMW-ESSA-Tiers-Video-Handout-508.pdf
Created with