Child Rights by Design

Guidance for innovators of digital products and services used by children

Credits and References

The Digital Futures Commission

The Digital Futures Commission (DFC) is an exciting research collaboration of unique organisations that invites innovators, policymakers, regulators, academics and civil society to unlock digital innovation in the interests of children and young people. It seeks to put the needs of children and young people into the minds and work plans of digital innovators, businesses, regulators and governments. It calls for a critical examination of how innovation is reconfiguring children’s lives to reimagine the digital world in value-sensitive ways that uphold their rights and take practical steps to meet their needs.

The DFC research team, led by Professor Sonia Livingstone OBE, has three workstreams: play in a digital world, beneficial uses of education data, and guidance for innovators. Each is informed by children’s voices and underpinned by research and outputs geared toward real-world change for children.

Commissioners

David Halpern, Chief Executive, The Behavioural Insights Team 

Baroness Beeban Kidron OBE, Founder and Chair, 5Rights Foundation 

Ansgar Koene, Global Al Ethics and Regulatory Leader, EY 

Professor Sonia Livingstone OBE, London School of Economics and Political Science 

Professor Helen Margetts OBE, The Alan Turing Institute 

Professor Mark Mon-Williams, University of Leeds 

Professor Dorothy Monekosso, Durham University 

Professor Brian O’Neill, Technological University Dublin 

Michael Preston, Executive Director, Joan Ganz Cooney Center, Sesame Workshop 

Anna Rafferty, Vice President, Digital Consumer Engagement, The LEGO Group 

Dee Saigal, Co-Founder and CEO, Erase All Kittens

Farida Shaheed, Shirkat Gah, Women’s Resource Centre 

Roger Taylor, Open Data Partners

Adrian Woolard, Head of Research & Development, BBC

Biographies for the Commissioners are here.
Biographies for the researchers are here.

Acknowledgements

We thank the many experts, designers and innovators who helped with this report as well as our Commissioners, the Digital Futures Commission researchers and the 5Rights team, and the children who joined our consultation workshops.
Suggested citation format: Livingstone, S. & Pothong, K. (2023). Child Rights by Design: Guidance for Innovators of Digital Products and Services Used by Children. Digital Futures Commission, 5Rights Foundation.

References

5Rights Foundation. (2021a, September). Tick to Agree: Age Appropriate Presentation of Published Terms. https://5rightsfoundation.com/TicktoAgree-Age_appropriate_presentation_of_published_terms.pdf

5Rights Foundation. (2021b). But How Do They Know It Is a Child? Age Assurance in the Digital World (Updated). https://5rightsfoundation.com/uploads/But_How_Do_They_Know_It_is_a_Child.pdf

5Rights Foundation. (2021c). Risky by Design. www.riskyby.design/introduction

5Rights Foundation. (2022). Child Online Safety Toolkit: Making Child Online Safety a Reality. https://childonlinesafetytoolkit.org

Access Now, et al (2018). The Santa Clara Principles on Transparency and Accountability in Content Moderation. https://santaclaraprinciples.org

Alves-Oliveira, P., Arriaga, P., Paiva, A., & Hoffman, G. (2021). Children as robot designers. Proceedings of the 2021 ACM/IEEE International Conference on Human–Robot Interaction. https://doi.org/10.1145/3434073.3444650

Amurabi. (no date). Legal Innovation by Design. www.amurabi.eu/en Anti-Bullying Alliance (2022). Prevalence of online bullying. https://anti- bullyingalliance.org.uk/tools-information/all-about-bullying/prevalence-and- impact-bullying/prevalence-online-bullying

Artefact Group. (no date). The Tarot Cards of Tech. https://tarotcardsoftech. artefactgroup.com

ASA (Advertising Standards Authority). (2022). Non-Broadcast Code. www.asa.org.uk/codes-and-rulings/advertising-codes/non-broadcast-code.html

Atabey, A. (2022a, 26 September). Fairness by design: Addressing children’s expectations through children’s best interests. Blog, Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/blog/fairness-by-design-addressing-childrens-expectations-through-childrens-best-interests

Atabey, A. (2022b, 7 March). Innovating in children’s best interests for a ‘fair’ digital world. Blog, Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/blog/innovating-in-childrens-best-interests-for-a-fair-digital-world%ef%bf%bc

Atabey, A., Pothong, K., & Livingstone, S. (2023, 20 February). When are commercial practices exploitative? Ensuring child rights prevail in a digital world. Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/blog/when-are-commercial-practices-exploitative-ensuring-child-rights-prevail-in-a-digital-world/

Australian Office of the eSafety Commissioner. (2019). Safety by Design. https://www.esafety.gov.au/industry/safety-by-design

Ball, J. (2019, 1 October). The Double Diamond: A universally accepted depiction of the design process. Design Council. https://www.designcouncil.org.uk/our-work/news-opinion/double-diamond-universally-accepted-depiction-design-process

Barassi, V. (2020). Child Data Citizen: How Tech Companies Are Profiling Us from before Birth. MIT Press. https://mitpress.mit.edu/books/child-data-citizen?_ga=2.147312311.1208907863.1624138438-898542324.1621987361

BBC. (2016, 18 August). How to design for children. https://bbc.co.uk/gel/features/how-to-design-for-children

BBC. (2019). Digital wellbeing. https://www.bbc.co.uk/rd/projects/digital-wellbeing

BBC. (2022). Human values. https://humanvalues.io

Bekker, T. & Antle, A. N. (2011). Developmentally Situated Design (DSD): Making theoretical knowledge accessible to designers of children’s technology.

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2531–40. Vancouver, BC, Canada. https://doi.org/10.1145/1978942.1979312

Bengtsson, T., Bom, L. H., & Fynbo, L. (2021). Playing apart together: Young people’s online gaming during the COVID-19 lockdown. YOUNG, 29(4). https:// doi.org/10.1177/11033088211032018

Better Internet for Kids. (2021, March). Age-Appropriate Design with Youth: Best Practice Guideline. https://www.betterinternetforkids. eu/documents/167024/200055/Best-practice+guideline+-+Age- appropriate+design+with+youth+-+March+2021+-+FINAL.pdf/449ee94e-ce0d- c4be-d9cf-d768381d997c?t=1617107095397

Bhardwaj, N. (2020, 27 December). TikTok videos that promote anorexia are misspelling common hashtags to beat the ‘pro-ana’ ban. Insider. https://www.insider.com/tiktok-bans-six-accounts-posting-eating-disorder-content

Big Motive. (2023). Creating Safer Digital Experiences by Putting Kids First. https://www.bigmotive.com/kids-first

Broadband Commission. (2019). Child Online Safety: Minimizing the Risk of Violence, Abuse and Exploitation Online. https://broadbandcommission.org/publication/child-online-safety

Broadcast Committee of Advertising Practice. (2021). The UK Code of Broadcast Advertising. https://www.asa.org.uk/codes-and-rulings/advertising-codes/broadcast-code.html

B-Tech. (2021). Designing and Implementing Effective Company-Based Grievance Mechanisms. https://www.ohchr.org/sites/default/files/Documents/Issues/Business/B-Tech/access-to-remedy-company-based-grievance-mechanisms.pdf

Centre for Data Ethics and Innovation. (2020). Review into Bias in Algorithmic Decision-Making. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/957259/Review_into_bias_in_algorithmic_decision-making.pdf

Cheng, S., Zhang, B., Zou, G., Huang, M., & Zhang, Z. (2019). Friend recommendation in social networks based on multi-source information fusion. International Journal of Machine Learning and Cybernetics, 10(5), 1003–24. https://doi.org/10.1007/s13042-017-0778-1

Competition and Markets Authority. (2022). Online Choice Architecture: How Digital Design Can Harm Competition and Consumers. https://www.gov.uk/find-digital-market-research/online-choice-architecture-how-digital-design-can-harm-competition-and-consumers-2022-cma

Conway, L. (2022a, 13 January). Advertising to children. House of Commons Research Briefing. House of Commons Library. https://commonslibrary.parliament.uk/research-briefings/cbp-8198

Conway, L. (2022b). Consumer Rights Act 2015. House of Commons Library. https://researchbriefings.files.parliament.uk/documents/SN06588/SN06588.pdf

Council of Europe. (2020). Handbook for Policy Makers on the Rights of the Child in the Digital Environment. https://rm.coe.int/publication-it-handbook-for-policy-makers-final-eng/1680a069f8

D4CR (Designing for Children’s Rights). (2017). Designing for Children’s Rights V. 1.3.1. https://childrensdesignguide.org/d4cr_10_key_principles_simple

D4CR. (2022, July). Design Principles. https://childrensdesignguide.org/wp-content/uploads/2022/07/D4CR-Design-Principles-2.0-2022-07-12.pdf

D4CR. (no date-a). Defining diversity at Toca Boca. https://childrensdesignguide.org/toca-boca-story

D4CR. (no date-b). Designing for Children’s Rights Guide. https://childrensdesignguide.org

Data Protection Commission. (2021, December). Fundamentals for a Child- Oriented Approach to Data Processing. https://www.dataprotection.ie/sites/default/files/uploads/2021-12/FundamentalsforaChild-OrientedApproachtoDataProcessing_FINAL_EN.pdf

Day, E. (2021). Governance of Data for Children’s Learning in UK State Schools. Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/wp-content/uploads/2021/06/Governance-of-data-for-children-learning.pdf

Day, E., Pothong, K., Atabey, A., & Livingstone, S. (2022). Who controls children’s education data? A socio-legal analysis of the UK governance regimes for schools and EdTech. Learning, Media and Technology, 1–15. https://doi.org/10.1080/17439884.2022.2152838

DCMS (Department for Digital, Culture, Media & Sport). (2019). Code of Practice for Providers of Online Social Media Platforms. https://www.gov.uk/government/publications/code-of-practice-for-providers-of-online-social-media-platforms

DCMS. (2021). Secure by Design. https://www.gov.uk/government/collections/secure-by-design

DeCID. (no date). Thematic Area: Children Participation and Design. https://decid.co.uk/thematic-area/children-participation-and-design/?_keywords=tools

Department of Health and Social Care. (2018). Guidance: Digital and Data- Driven Health and Care Technology (Updated 19 January 2021). https://www.gov.uk/government/publications/code-of-conduct-for-data-driven-health-and-care-technology

Design Council. (2019a). Double Diamond Diagram. https://www.designcouncil.org.uk/our-work/skills-learning/the-double-diamond/

Design Council. (2019b, 17 May). Framework for innovation: Design Council’s evolved Double Diamond. https://www.designcouncil.org.uk/our-work/skills-learning/tools-frameworks/framework-for-innovation-design-councils-evolved-double-diamond

DFC (Digital Futures Commission). (2022). Playful by Design Toolkit. https://digitalfuturescommission.org.uk/playful-by-design-toolkit

Dinsmore, B. & Pugh, A. J. (2021). The paradox of constrained well-being: Childhood autonomy, surveillance and inequality. Sociological Forum, 36(2), 448–70. https://doi.org/https://doi.org/10.1111/socf.12687

Directive 2001/95/EC of the European Parliament and of the Council of 3 December 2001 on general product safety.

Dodd, H. F., FitzGibbon, L., Watson, B. E., & Nesbit, R. J. (2021). Children’s play and independent mobility in 2020: Results from the British Children’s Play Survey. International Journal of Environmental Eesearch and Public Health, 18(8), 4334.

Dodgson, L. (2022, 30 June). Twitch streamer swatted in the middle of livestreaming making tacos after viewer told police he killed his family. Insider. https://www.insider.com/swatting-livestream-twitch-nick-frags-heyitsmesalty-police-2022-6

Doteveryone. (2019, April). Consequence Scanning: An Agile Event for Responsible Innovators. https://doteveryone.org.uk/wp-content/uploads/2021/02/Consequence-Scanning-Agile-Event-Manual-TechTransformed-Doteveryone-2.pdf

Druin, A. (1999). Cooperative inquiry: Developing new technologies for children with children. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Pittsburgh, Pennsylvania, USA. https://doi.org/10.1145/302979.303166

Druin, A., Bederson, B., Boltman, A., Miura, A., Knotts-Callahan, D., & Platt, M. (1998). Children as Our Technology Design Partners+. Digital Repository at the University of Maryland, Chapter 3. https://drum.lib.umd.edu/handle/1903/947

EDPB. (2022). Guidelines 3/2022 on dark patterns in social media platform interfaces: How to recognise and avoid them. https://edpb.europa.eu/our-work-tools/documents/public-consultations/2022/guidelines-32022-dark-patterns-social-media_en

Eekelaar, J. & Tobin, J. (2019). Article 3 The Best Interests of the Child. In J. Tobin (ed) The UN Convention on the Rights of the Child: A Commentary. Oxford University Press.

Engineering Design Centre. (2017). What is inclusive design? Inclusive Design Toolkit. University of Cambridge. https://www.inclusivedesigntoolkit.com/whatis/whatis.html

ENOC (European Network of Ombudspersons for Children). (2020, November). Common Framework of Reference on Child Rights Impact Assessment: A Guide On How to Carry Out CRIA. http://enoc.eu/wp-content/uploads/2020/12/ENOC-Common-Framework-of-Reference-FV.pdf

Equality and Human Rights Commission. (2011). Equality Act 2010 Code of Practice: Services, Public Functions and Associations. https://www.equalityhumanrights.com/sites/default/files/servicescode_0.pdf

Equality and Human Rights Commission. (2019). Equality Act codes of practice. https://www.equalityhumanrights.com/en/advice-and-guidance/equality-act-codes-practice

Erben, F. (2022). Play for Health: How to Design For and With Children. https://uploadsssl.webflow.com/606644735dd12079867bdee1/61dd68d727e3775ace765635_Erben-Fabienne_Play-for-Health(2022).pdf

European Commission. (2022a). The Digital Services Act package. https://digital-strategy.ec.europa.eu/en/policies/digital-services-act-package

European Commission. (2022b, 28 June). Removing barriers for persons with disabilities: European Accessibility Act must be in national law from today. News. https://ec.europa.eu/social/main. jsp?langId=en&catId=1202&furtherNews=yes&newsId=10316

European Commission. (2023, 7 February). Child-friendly version of European strategy for a Better Internet for Kids (BIK+). https://digital-strategy.ec.europa.eu/en/library/child-friendly-version-european-strategy-better-internet-kids-bik

Gray, C. M., Kou, Y., Battles, B., Hoggatt, J., & Toombs, A. L. (2018). The dark (patterns) side of UX design. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1–14. Montreal QC, Canada. https://doi.org/10.1145/3173574.3174108

Greenbaum, J. & Kyng, M. (1991). Design at Work: Cooperative Design of Computer Systems. Lawrence Erlbaum Associates. https://books.google.co.ukbooks?id=KAoHEAAAQBAJ&printsec=frontcover#v=onepage&q&f=false

Hartung, P. (2020). The children’s rights-by-design standard for data use by tech companies(Issue brief no. 5 | November 2020 Good Governance of Children’s Data project, Issue. UNICEF. https://www.unicef.org/globalinsight/reports/childrens-rights-design-new-standard-data-use-tech-companies

Hassenzahl, M. & Tractinsky, N. (2006). User experience – A research agenda. Behaviour & Information Technology, 25(2), 91–7. https://doi.org/10.1080/014492905003

Hasso Plattner Institute of Design. (2022). Design for Belonging. Stanford University. https://dschool.stanford.edu/resources/design-for-belonging

Hart, W., Miller, N., & Voll, K. (2023). A Practical Design Playbook for Digital Thriving in Games. https://schedule.gdconf.com/session/a-practical-design-playbook-for-digital-thriving-in-games/890189

Henriques, I. & Hartung, P. (2021). Children’s rights by design in AI development for education. The International Review of Information Ethics, 29(3). https://doi.org/https://doi.org/10.29173/irie424

Hooper, L., Livingstone, S., & Pothong, K. (2022). Problems with Data Governance in UK Schools: The Cases of Google Classroom and ClassDojo. Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/wp-content/uploads/2022/08/Problems-with-data-governance-in-UK-schools.pdf

Hourcade, J. P. (2020). Child development and interaction design. Proceedings of the 2020 ACM Interaction Design and Children Conference: Extended Abstracts, 135–8. https://doi.org/10.1145/3397617.3401807

Hub na nÓg. (2021). Lundy Model. https://hubnanog.ie/wp-content/uploads/2021/04/5611-Hub_na_nOg-LundyModel.pdf

IAPP (International Association of Privacy Professionals). (2023). ISO set to adopt privacy-by-design standard. https://iapp.org/news/a/iso-set-to-adopt-privacy-by-design-standard

ICO (Information Commissioner’s Office). (2018a). Guide to the Privacy and Electronic Communications Regulations. https://ico.org.uk/media/for-organisations/guide-to-pecr-2-4.pdf

ICO. (2018b). What should our general approach to processing children’s personal data be? https://ico.org.uk/for-organisations/guide-to-data-protection/guide-to-the-general-data-protection-regulation-gdpr/children-and-the-uk-gdpr/what-should-our-general-approach-to-processing-children-s-personal-data-be

ICO. (2020). Age Appropriate Design: A Code of Practice for Online Services. https://ico.org.uk/media/for-organisations/guide-to-data-protection/key-data- protection-themes/age-appropriate-design-a-code-of-practice-for-online- services-2-1.pdf

ICO. (2021a). 1. Best interests of the child. https://ico.org.uk/for-organisations/guide-to-data-protection/ico-codes-of-practice/age-appropriate-design-a-code-of-practice-for-online-services/1-best-interests-of-the-child

ICO. (2021b). Guide to the General Data Protection Regulation (GDPR). https://ico.org.uk/media/for-organisations/guide-to-data-protection/guide-to-the-general-data-protection-regulation-gdpr-1-1.pdf

ICO. (2021c). Introduction to the Age appropriate design code. https://ico.org.uk/for-organisations/guide-to-data-protection/ico-codes-of-practice/age-appropriate-design-code

ICO. (2022a). AI and data protection risk toolkit. https://ico.org.uk/for-organisations/guide-to-data-protection/key-dp-themes/guidance-on-ai-and-data-protection/ai-and-data-protection-risk-toolkit

ICO. (2022b). Applications: Children and the GDPR. https://ico.org.uk/media/for-organisations/guide-to-data-protection/guide-to-the-general-data-protection-regulation-gdpr/children-and-the-uk-gdpr-1-0.pdf

ICO. (2022c). Best interests of the child self-assessment. https://ico.org.uk/for-organisations/childrens-code-hub/best-interests-of-the-child-self-assessment

ICO. (2022d). Bring children’s views into the design process. https://ico.org.uk/for-organisations/childrens-code-hub/childrens-code-design-guidance/bring-children-s-views-into-the-design-process

ICO. (2022e). Data privacy moments. https://miro.com/miroverse/ico-data-privacy-moments

ICO. (2022f). Design for meaningful parent or guardian–child interactions. https://ico.org.uk/for-organisations/childrens-code-hub/childrens-code-design-guidance/design-for-meaningful-parent-or-guardian-child-interactions

ICO. (2022g). The full best interests framework and UNCRC. https://ico.org.uk/for-organisations/childrens-code-hub/how-to-use-our-guidance-for-standard-one-best-interests-of-the-child/children-s-code-best-interests-framework/the-full-best-interests-framework-and-uncrc

ICO. (2022h). Meet children’s needs as they change over time. https://ico.org.uk/for-organisations/childrens-code-hub/childrens-code-design-guidance/meet-children-s-needs-as-they-change-over-time

ICO. (2023). Privacy in the product design lifecycle. https://ico.org.uk/privacy-design

IEEE. (2021). IEEE Standard for an Age Appropriate Digital Services Framework based on the 5Rights Principles for Children. https://standards.ieee.org/ieee/2089/7633

Instagram. (2022). What happens when you block someone on Instagram – Help center. https://help.instagram.com/447613741984126

Internet Governance Forum. (2019). Internet Rights & Principles Coalition: Charter of human rights and principles for the internet. https://internetrightsandprinciples.org/charter

ISO (International Organization for Standardization) Standards. (2023). ISO 31700 Consumer protection: Privacy by design for consumer goods and services. https://www.iso.org/standard/84977.html

ISO Standards. (no date-a). ISO/IEC 27001 and related standards: Information security management. https://www.iso.org/isoiec-27001-information-security.html

ISO Standards. (no date-b). ISO/IEC 27701:2019 Security techniques — Extension to ISO/IEC 27001 and ISO/IEC 27002 for privacy information management — Requirements and guidelines. https://www.iso.org/standard/71670.html

Jisc. (2018). Designing learning and assessment in a digital age. https://www.jisc.ac.uk/full-guide/designing-learning-and-assessment-in-a-digital-age

Joan Ganz Cooney Center, The. (no date). Playtest with Kids: Get actionable insights for your product. https://playtestwithkids.org

Kidmap. (no date). Kids Inclusive and Diverse Media Action Project. https://www.joinkidmap.org/#mission

Kidron, B. & Rudkin, A. (2017). Digital Childhood: Addressing Childhood Development Milestones in the Digital Environment. 5Rights Foundation. https://5rightsfoundation.com/uploads/digital-childhood—final-report.pdf

KidsKnowBest & The LEGO Group. (2022). Kids Included: Enabling Meaningful Child Participation within Companies in the Digital Era. https://www.kidsincluded.report

Lansdown, G. (2006). International Developments in Children’s Participation: Lessons and Challenges. In K. Tisdall, J. Davis, & M. Hill (eds) Children, Young People and Social Inclusion: Participation for What? (pp 138–56). Policy Press. https://doi.org/10.1332/policypress/9781861346629.003.0008

LEGO Foundation, The. (2020). Children, Technology and Play (Report Summary). https://cms.learningthroughplay.com/media/hdvjniic/children-tech-and-play_summary-report.pdf

Lenhart, A. & Owens, K. (2021). The Unseen Teen: The Challenges of Building Healthy Tech for Young People. Data & Society. https://datasociety.net/wp-content/uploads/2021/05/The-Unseen-Teen-.pdf

Lievens, E., van der Hof, S., Liefaard, T., Verdoodt, V., Milkaite, I., & Hannema, T. (2019). The child right to protection against economic exploitation in the digital world. https://www.ohchr.org/sites/default/files/Documents/HRBodies/CRC/GCChildrensDigitalEnvironment/OtherStakeholders/EvaLievensSimonevanderHofetal.pdf

Livingstone, S. & Pothong, K. (2021a). Playful by Design: Freeplay in a Digital World. November. Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/wp-content/uploads/2021/11/A-Vision-of-Free-Play-in-a-Digital-World.pdf

Livingstone, S. & Pothong, K. (2021b, 6 December). What is meant by ‘by design’? https://digitalfuturescommission.org.uk/blog/what-is-meant-by-by-design

Livingstone, S. & Pothong, K. (2023, 23 January). The compliance gap in digital products likely to be used by children. Blog, Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/blog/the-compliance-gap-in-digital-products-likely-to-be-used-by-children

Livingstone, S. & Stoilova, M. (2021). The 4Cs: Classifying Online Risk to Children. https://core-evidence.eu/updating-the-4cs-of-online-risk

Livingstone, S., Pothong, K., & Atabey, A. (2022, 7 November). Our consultation response to DCMS’s policy paper on ‘a pro-innovation approach to regulating AI’. Blog, Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/blog/our-consultation-response-to-dcmss-policy-paper-on-a-pro-innovation-approach-to-regulating-ai

Lundy, L. (2007). ‘Voice’ is not enough: Conceptualising Article 12 of the United Nations Convention on the Rights of the Child. British Educational Research Journal, 33(6), 927–42. https://www.jstor.org/stable/30032800

Lundy, L., Byrne, B., Templeton, M. & Lansdown, G. (2019). Two Clicks Forward and One Click Back: Report on Children with Disabilities in the Digital Environment. Council of Europe. https://rm.coe.int/two-clicks-forward-and-one-click-back-report-on-children-with-disabili/168098bd0f

Markopoulos, P. & Bekker, M. (2003). Interaction design and children. Interacting with Computers, 15(2), 141–9. https://doi.org/10.1016/s09535438(03)00004-3

Mascheroni, G. & Siibak, A. (2021). Datafied Childhoods: Data Practices and Imaginaries in Children’s Lives. Peter Lang. https://doi.org/10.3726/b17460

Mathur, A., Acar, G., Friedman, M. J., Lucherini, E., Mayer, J., Chetty, M., & Narayanan, A. (2019). Dark patterns at scale: Findings from a crawl of 11K shopping websites. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), 1–32. https://dl.acm.org/doi/abs/10.1145/3359183

McNally, B., Guha, M. L., Mauriello, M. L., & Druin, A. (2016, May). Children’s perspectives on ethical issues surrounding their past involvement on a participatory design team. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 3595–606.

Microsoft. (2018). Inclusive design. https://www.microsoft.com/design/inclusive/

Milkaite, I. & Lievens, E. (2020). Child-friendly transparency of data processing in the EU: From legal requirements to platform policies. Journal of Children and Media, 14(1), 5–21. https://doi.org/10.1080/17482798.2019.1701055

Mukherjee, S. & Livingstone, S. (2020). Children and Young People’s Voices. Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/wp-content/uploads/2020/10/Children-and-Young-Peoples-Voices.pdf

Mukherjee, S., Pothong, K., & Livingstone, S. (2021, March). Child Rights Impact Assessment: A Tool to Realise Children’s Rights in the Digital Environment. Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/wp-content/uploads/2022/06/Child-Rights-Impact-Assessment.pdf

Muller, M. J., Wildman, D. M., & White, E. A. (1994). Participatory design through games and other group exercises. Conference Companion on Human Factors in Computing Systems. https://dl.acm.org/doi/pdf/10.1145/259963.260530

Mumford, E. & Henshall, D. (1979/1983). Designing Participatively: A Participative Approach to Computer Systems Design. Manchester Business School.

Narayanan, A., Mathur, A., Chetty, M., & Kshirsagar, M. (2020). Dark patterns: Past, present, and future. Communications of the ACM, 63(9), 42–7. https://doi. org/10.1145/3397884

Naughton, J. (2022, 1 October). Molly Russell was trapped by the cruel algorithms of Pinterest and Instagram. The Guardian. https://www.theguardian.com/commentisfree/2022/oct/01/molly-russell-was-trapped-by-the-cruel-algorithms-of-pinterest-and-instagram

NHS England Transformation Directorate. (2022). Digital Technology Assessment Criteria (DTAC). https://transform.england.nhs.uk/key-tools-and-info/digital-technology-assessment-criteria-dtac

Norwegian Consumer Council (Forbrukerradet). (2018). Deceived by Design: How Tech Companies Use Dark Patterns to Discourage Us From Exercising Our Rights to Privacy. https://fil.forbrukerradet.no/wp-content/uploads/2018/06/2018-06-27-deceived-by-design-final.pdf

Norwegian Data Protection Authority (Datatilsynet). (2017). Software development with Data Protection by Design and by Default. https://www.datatilsynet.no/en/about-privacy/virksomhetenes-plikter/innebygd-personvern/data-protection-by-design-and-by-default/design

OECD. (2021a). OECD guidelines for digital service providers. https://www.oecd.org/mcm/OECD%20Guidelines%20for%20Digital%20Service%20Providers.pdf

OECD. (2021b). Recommendation of the Council on Children in the Digital Environment (OECD/LEGAL/0389). https://legalinstruments.oecd.org/public/doc/272/272.en.pdf

Ofcom (Office of Communications). (2017). On Demand Programme Service Rules. https://www.ofcom.org.uk/tv-radio-and-on-demand/broadcast-codes/broadcast-code/on-demand-programme-service-rules

Ofcom. (2021). Regulating video-sharing platforms: What you need to know. https://www.ofcom.org.uk/online-safety/advice-for-consumers/video-sharing-platforms

Online Safety Act 2021 (Australia). (2021). https://www.legislation.gov.au/Details/C2021A00076

Online Safety Bill. https://bills.parliament.uk/bills/3137

Pangrazio, L. (2021, 12 May). Apps that help parents protect kids from cybercrime may be unsafe too. LSE Blog – Parenting for a Digital Future. https://blogs.lse.ac.uk/parenting4digitalfuture/2021/05/12/parent-control-apps

Papert, S. & Harel, I. (1991). Situating constructionism. Constructionism, 36(2), 1–11. https://web.media.mit.edu/~calla/web_comunidad/Reading-En/situating_constructionism.pdf

Piaget, J. & Inhelder, B. (2008). The Psychology of the Child. Basic Books.

Positive Online Content Campaign. (no date). About this site and the Positive Online Content Campaign – test joelle. https://www.positiveonlinecontentforkids.eu/about

Pothong, K. & Livingstone, S. (2022, 10 October). Consulting children about their rights in a digital world to guide innovators and designers. Blog, Digital Futures Commission, 5Rights Foundation. https://digitalfuturescommission.org.uk/blog/consulting-children-about-their-rights-in-a-digital-world-to-guide-innovators-and-designs

Raber, I., McCarthy, C. P., & Yeh, R. W. (2019). Health insurance and mobile health devices: Opportunities and concerns. JAMA, 321(18), 1767–8.

Radesky, J., Chassiakos, Y. R., Ameenuddin, N., & Navsaria, D. (2020a). Digital advertising to children. Pediatrics, 146(1), 1–8. https://doi.org/10.1542/peds.2020-1681

Radesky, J., et al. (2020b). Young Kids and YouTube: How Ads, Toys, and Games Dominate Viewing. Common Sense Media. https://www.commonsensemedia.org/research/young-kids-and-youtube-how-ads-toys-and-games-dominate-viewing

RD4C (Responsible Data for Children). (2022, 15 December). Responsible Data for Children releases slides for self-guided training. https://rd4c.org/articles/new-publication-responsible-data-for-children-releases-slides-for-self-guided-training/index.html

Rood, E., & Madden, M. (2022). Understanding Youth: A Prerequisite for Creating Programs By/With/For Tweens. The Joan Ganz Cooney Center. https://joanganzcooneycenter.org/wp-content/uploads/2022/06/jgcc_understandingyouth.pdf

Save the Children Finland. (2020). Child-Centred Design. https://resourcecentre.savethechildren.net/pdf/save_the_children_child-centered_design.pdf

Schuler, D. & Namioka, A. (eds). (1993). Participatory Design: Principles and Practices. Lawrence Erlbaum Associates, Inc. https://psycnet.apa.org/record/1993-97696-000

Shier, H. (2010). Children as public actors: Navigating the tensions. Children & Society, 24(1), 24–37. https://doi.org/https://doi.org/10.1111/j.1099-0860.2008.00208.x

Skindex. (2023). Asian Minecraft Skins. https://www.minecraftskins.com/search/skin/asian/1

Sylwander, L. (2001). Child Impact Assessments: Swedish Experience of Child Impact Analyses As a Tool for Implementing the UN Convention on the Rights of the Child (Child Participation). https://resourcecentre.savethechildren.net/pdf/6728.pdf

The Consumer Contracts (Information, Cancellation and Additional Charges) Regulations (CCR) 2013, SI 2013/3134. https://www.legislation.gov.uk/uksi/2013/3134/contents/made

The Consumer Protection (Amendment) Regulations 2014. https://www.legislation.gov.uk/uksi/2014/870/made

The Consumer Protection from Unfair Trading Regulations (CPUTR) 2008. https://www.legislation.gov.uk/uksi/2008/1277/contents/made

The Consumer Rights Act 2015. https://www.legislation.gov.uk/ukpga/2015/15

The Data Protection Act 2018. https://www.legislation.gov.uk/ukpga/2018/12/contents/enacted

The Equality Act 2010. https://www.legislation.gov.uk/ukpga/2010/15/contents

Thelen, E. & Smith, L. B. (1998). Dynamic Systems Theories. In W. Damon & R. M. Lerner (eds) Handbook of Child Psychology: Theoretical Models of Human Development, Volume 1, 5th edn (pp 563–634). John Wiley & Sons Inc. https://psycnet.apa.org/record/2005-01926-011

Third, A. & Moody, L. (2021). Our Rights in the Digital World: A Report on the Children’s Consultations to Inform UNCRC General Comment 25. 5Rights Foundation and Western Sydney University. https://5rightsfoundation.com/uploads/OurRIghtsinaDigitalWorld-FullReport.pdf

Trott, P. (2001). The role of market research in the development of discontinuous new products. European Journal of Innovation Management, 4(3), 117–26. https://doi.org/10.1108/14601060110390585

Bekker, M. M., de Valk, L. C. T., & Eggen, J. H. (2014). A toolkit for designing playful interactions: The four lenses of play. Journal of Ambient Intelligence and Smart Environments, 6(3), 263–76. https://doi.org/10.3233/AIS-140259

UK Government. (2015). Equality Act 2010: Guidance. https://www.gov.uk/guidance/equality-act-2010-guidance

UK Government. (2021a). Guidance and Tools for Digital Accessibility. https://www.gov.uk/guidance/guidance-and-tools-for-digital-accessibility

UK Government. (2021b). Making Your Service Accessible: An introduction. https://www.gov.uk/service-manual/helping-people-to-use-your-service/making-your-service-accessible-an-introduction

UKIE (Association for UK Interactive Entertainment). (2014, 28 January). Need to know – OFT principles for online and app-based games. https://ukie.org.uk/resources/need-to-know-oft-principles-for-online-and-app-based-games

UN (United Nations). (2011). Guiding Principles on Business and Human Rights: Implementing the United Nations ‘Protect, Respect and Remedy’ Framework. https://www.ohchr.org/sites/default/files/documents/publications/guidingprinciplesbusinesshr_en.pdf

UN Committee on the Rights of the Child (1989). Convention on the Rights of the Child. https://www.ohchr.org/en/professionalinterest/pages/crc.aspx

UN Committee on the Rights of the Child. (2003). General Comment No 5, General Measures of Implementation of the Convention on the Rights of the Child (CRC/GC/2003/5). https://digitallibrary.un.org/record/513415?ln=en

UN Committee on the Rights of the Child. (2009). General Comment No 12 on the Right of the Child to Be Heard (CRC/C/GC/12). https://digitallibrary.un.org/record/671444?ln=en

UN Committee on the Rights of the Child. (2013). General Comment No 14 on the Right of the Child to Have His or Her Best Interests Taken as a Primary Consideration (Article 3, para 1) (CRC /C/GC/14). https://www.refworld.org/docid/51a84b5e4.html

UN Committee on the Rights of the Child. (2016). General Comment No 20 (2016) on the Implementation of the Rights of the Child During Adolescence (CRC/C/GC/20). https://www.ohchr.org/en/documents/general-comments-and-recommendations/general-comment-no-20-2016-implementation-rights

UN Committee on the Rights of the Child. (2021). General Comment No 25 on Children’s Rights in Relation to the Digital Environment (CRC/C/GC/25). https://www.ohchr.org/EN/HRBodies/CRC/Pages/GCChildrensRightsRelationDigitalEnvironment.aspx

UNICEF. (2012) Children’s Rights and Business Principles. https://www.unicef.org/media/96136/file/Childrens-Rights-Business-Principles-2012.pdf

UNICEF. (2014). Engaging Stakeholders on Children’s Rights: A Tool for Companies. https://sites.unicef.org/csr/css/Stakeholder_Engagement_on_Childrens_Rights_021014.pdf

UNICEF. (2019). Child Rights and Online Gaming: Opportunities & Challenges for Children and the Industry. https://www.unicef-irc.org/files/upload/documents/UNICEF_CRBDigitalWorldSeriesOnline_Gaming.pdf

UNICEF. (2021). Child Rights Impact Assessment: Template and Guidance for Local Authorities. https://www.unicef.org.uk/child-friendly-cities/wp-content/uploads/sites/3/2022/06/CRIA_June-2022.pdf

UNICEF & Western Sydney University. (2022). Responsible Innovation in Technology for Children: Digital Technology, Play and Child Well-Being. https://www.unicef-irc.org/ritec

Vaghri, Z., Zermatten, J., Lansdown, G., & Ruggiero, R. (2022). Monitoring State Compliance with the UN Convention on the Rights of the Child: An Analysis of Attributes. Springer International Publishing AG. https://link.springer.com/book/10.1007/978-3-030-84647-3

van der Hof, S., van Eeden, Q., Grijns, H., Kok,. R., Bilgin, M., Volman, H., va Leeuwen, T., van der Waal, S., & Hebly, L. (2021). Code for Children’s Rights [Code voor kinderechten] (The Netherlands). Ministry of the Interior and Kingdom Relations. https://codevoorkinderrechten.nl/wp-content/uploads/2021/10/Code-voor-Kinderrechten-EN.pdf

Vygotsky, L. S. (1978). Interaction between learning and development. Mind & Society, 79–91. https://innovation.umn.edu/igdi/wp-content/uploads/sites/37/2018/08/Interaction_Between_Learning_and_Development.pdf

W3C. (2018). Accessibility. https://www.w3.org/standards/webdesign/accessibility

Wetenschapsknooppunt TU Delft. (no date). Co-design with kids – A toolkit for designers. https://studiolab.ide.tudelft.nl/studiolab/codesignwithkids

Williamson, B. (2019). New power networks in educational technology. Learning, Media and Technology, 44(4), 395–8. https://doi.org/10.1080/17439884.2019.1672724

World Economic Forum. (2022, March). Artificial Intelligence for Children: Toolkit. https://www3.weforum.org/docs/WEF_Artificial_Intelligence_for_Children_2022.pdf

Zuboff, S. (2019). The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power. PublicAffairs.