Switch course ▾
Session 5. Privacy, Equity and Evaluating Whether It Worked
Objective. Apply privacy and consent habits to personalization, check who may be left out by devices or connectivity, evaluate a change with simple before-and-after evidence by group, and write a one-page personalization plan.
The best-designed personalized lesson can still do harm if it exposes children's data or leaves out those who have no phone at home. And even a lesson that feels successful may not have helped, if you never looked at the evidence. This final session brings together the three questions every teacher should ask before and after a change: is it safe for children's data, does it include everyone, and did it work? It ends with a one-page plan you can share with colleagues.
Key ideas
Privacy and consent: collect less
- Personalization runs on information about children, and that information can be misused or leak. Ask before collecting: do I need this to decide the next step? If not, do not collect it. Use pupil numbers or initials; never put names, photos, voices, health or family details into an app or an AI tool.
- Follow national rules and your school's decision about tools: ask the head teacher or the person responsible before using a new one. Tell parents in plain Uzbek or Russian which tools are used and why, ask for consent where it is required, and make sure a family can say no without any penalty.
Equity: who is left out?
- Check devices (one phone per four pupils?), connection (rural areas, evenings), language of the tool, home internet and shared family phones. International data show that many school-age children have no internet at home, with sharp gaps between rural and urban areas and between rich and poor families.
- Design rule: nothing essential depends on a device or home internet. Rotate one shared device per group in class, set paper homework of equal quality, and never grade or praise pupils for using an app. If the paper route is the poorer route, you have built inequality.
Did it work? Evaluate small and honestly
- Before you start, decide the success sign: for example, the share of pupils who reach the standard on a same-difficulty exit ticket. Add the teacher's cost in minutes per week and what pupils say. Use the same kind of task before and after, and if possible a comparison class or topic where you changed nothing.
- Look at groups, not only the average: by route, by girls and boys, by pupils with and without a device at home. An average can rise while a gap grows. A rise after a change does not prove the change caused it: the topic, the test or the season may have helped, so write down what else changed.
Continue, adapt or stop
- Decide with three questions. Did pupils do at least as well? Did it cost you fewer or acceptable minutes? Did every group gain, with no one excluded or exposed? Yes to all: continue. Some groups gain, others not: adapt. Costs, data risk or exclusion outweigh gains: stop.
- Write a one-page personalization plan: the diagnostic routine, the routes, the tools allowed with their checks and fallbacks, the feedback routine, the tracker rules, the privacy rules, the equity safeguards and how you will evaluate. Share it with colleagues so the school, not one teacher, owns it.
Four questions before and after a change
Collecting less, and making inclusion a design rule
Most decisions in this course need very little information: a number, a pile, a symbol. Each extra piece of data (a name, a photo, a family detail) adds risk and rarely adds value, so ask before collecting: which decision does this help me make? A report on education technology used during school closures found that many products appeared to collect children's data, so ask the head teacher before using any new tool.
Inclusion works best as a design rule, not a rescue. If nothing essential depends on a phone or home internet, a pupil without one loses nothing. International data show large gaps in home internet access by region, income and between rural and urban areas, so a plan that assumes a connection will exclude many pupils here too.
Evaluating a change without fooling yourself
A change feels successful when you want it to be. A simple evaluation protects you: decide the success sign first (for example, the share of pupils reaching the standard on a same-difficulty exit ticket), measure before and after, and when possible compare with a class or topic where you changed nothing. Add what it cost you in minutes and what pupils say about it.
Then look at groups. The average can rise while a group is left behind, as with pupils without a phone in the sample data. Be modest in your claims: with two classes and small numbers, you can say the data suggest an effect, not that it is proved. Write down what else changed, such as a new topic or a visit. Finally decide: continue, adapt or stop.
Examples from the classroom
The numbers on the sheet
Scene. Aziz in Namangan used to keep a notebook with each pupil's name, marks and short remarks about their families. After the course he rewrites it with pupil numbers and three symbols, and keeps the number list in a different place. At a parents' meeting he explains that he tracks learning only, and that families can ask to see their own child's entries.
Insight. Collecting only what a decision needs lowers risk and builds trust with families.
Two tablets and thirty-two pupils
Scene. Dilnoza teaches Grade 7 in a village in Karakalpakstan with two school tablets and few phones at home. She plans stations: two tablet groups for ten minutes each, the rest on paper cards with the same questions. Homework is a paper sheet. She checks that no pupil spends the whole lesson on cards, and swaps groups so that everyone uses a tablet at least once a week.
Insight. Equity is built into the timetable: fair rotation and equal paper work.
Class 7A and 7B
Scene. Malika in Samarkand tries the three-route method in 7A for a unit but not in 7B. At the end, 7A has more pupils reaching the standard. She then remembers that 7A had a student teacher helping for two weeks. She writes this down, says in her review that the data suggest the method may help, and repeats the unit with 7B before deciding.
Insight. Noting what else changed keeps a hopeful result from becoming a false conclusion.
Common pitfalls
- Entering pupil names, photos or family details into free apps or AI tools 'just once'.
- Setting app-based homework without checking who has a phone and a connection.
- Looking only at the class average and missing a gap that is growing between groups.
- Claiming that a change worked on the basis of one class and one test.
Audit Six Cases, Read the Data and Write Your Plan
- Open the Activity Kit: six short cases about data and devices. In trios, decide for each: OK, CHANGE or STOP, and name the safeguard (20 min).
- Pairs (20 min): read the sample results of two Grade 6 classes. Work out the share reaching the standard before and after, compare the two classes, then compare pupils with and without a phone at home in the changed class. Decide: continue, adapt or stop.
- Whole group (10 min): share decisions. What would you ask about the data before deciding? What else might have changed?
- Second short activity (15 min): draft your one-page personalization plan with the template. Swap with a partner who asks one question only: 'Who might be left out?'
- Alone (5 min): write your school-based task from the Kit and the date you will share the plan with your head teacher or team.
Your facilitator will guide you through this activity in the session.
Questions to discuss
- Which case was hardest to decide, and which safeguard made it acceptable?
- The average rose in the changed class. Why is that not enough to continue?
- What is the first line of your plan that a colleague could adopt tomorrow?
Reflect
- What information about pupils do you hold now that you do not really need?
- Which pupils could be disadvantaged by your current homework?
- What result would make you stop a method you like?
Try it tomorrow
- List the information about pupils you hold now and cross out anything you do not need for a teaching decision.
- Ask your pupils, by a show of hands, who could do a phone-based homework tonight, and plan an equal paper alternative.
- Write your one-page plan, share it with a colleague for ten minutes and ask 'Who might be left out?'.
Further reading and links
Collect the least data, keep every route open to every pupil, compare groups before and after, and let the evidence decide whether to continue, adapt or stop.