How to avoid three common pitfalls in EdTech impact evaluations

Before we celebrate EdTech results, let us check the evidence. Professor Kucirkova wrote about three common traps distorting impact claims for UNESCO GEM Blog Series.

Pitfall 1: Confusing usage with learning. Time spent- on-app is an output, not an outcome. Balance frequency/intensity and test whether more use really yields more learning in reality.

Pitfall 2: Trusting in-app quizzes that lack psychometrics. Many provider-built or AI-generated tests don’t validly measure the construct (e.g., numeracy), leading to inflated “impact.” External, validated instruments can be helpful.

Pitfall 3: Relying only on internal data. Even if internal metrics are sound, you don’t know whether gains transfer to the classroom. Independent external data (observations, interviews) can reveal both positive effects and harms.

Read the full text HERE.