“””””””””””””””””””””””AI provides a powerful tool for protecting children online, but it is also being misused by criminals to harm and exploit children online.
“”””””””””””””AI’s misuse harm children
“”””””””””””””””AI algorithms can help criminals identify weaknesses in online security measures, making it easier to access children’s personal data. AI can also be used to create fake social media accounts, which are then used by criminals to target vulnerable children. AI-enabled chatbots are being used as part of elaborate schemes to lure unsuspecting children into dangerous situations or activities. Furthermore, deepfakes generated with the help of AI technology can be used for various malicious purposes, such as blackmail, extortion, or spreading false information.
“””””””””””””AI as a tool to protect children online
“”””””””””””””””AI-based algorithms can detect inappropriate content on social media sites and automatically remove it. AI can also help prevent cyberbullying by using natural language processing (NLP) to analyse text for threatening language or toxic behaviour, allowing moderators to quickly intervene when necessary. AI can also be used to analyse content uploaded by a child’s contacts and by the child themself, helping parents identify potential risk factors associated with their child’s digital companions and the child’s own behaviour.
“”””””””””””””””In addition, AI can detect, filter and remove child sexual abuse materials (CSAM) on the internet. AI-based algorithms are trained to recognise images, videos, and language patterns (hash technologies) that correspond to CSAM, allowing them to quickly identify suspicious content. By scanning websites and social media sites for this content, AI can help prevent children from being exposed to it. Face recognition can also help law enforcement agencies detect victims more quickly. AI can moderate live-streaming events, chatrooms, and other real-time online conversations, where inappropriate interactions between minors and adults can occur. In addition, AI tools can be used to analyse uploaded photos or videos for signs of potential exploitation of children, allowing parents or moderators to intervene if necessary. Read the topic on AI and children’s rights.
“””””””””””Did you know that one in three internet users in the world is a child? Worldwide, young people were 1.24 times more likely to be connected than the rest of the population. Children’s use of the internet and digital technology has increased significantly, mainly due to the shift from television to online viewing, the accessibility and popularity of mobile devices, and the use of technology as part of the educational system. While, for many children, the distinction between the online and offline world is no longer clear, there is a worrying digital divide worldwide. Globally, two-thirds of children and young people aged 25 and under, do not have an internet connection at home. In high-income countries, 87% of children and young people have an internet connection at home, compared to only 6% in low-income countries.
“””””””””””Children around the world today use digital technologies to access the internet for learning and entertainment, to communicate with their friends and the world around them, to acquire diverse information, and to create and expand their opportunities. Yet, an increasingly complex online environment also presents risks for the safety of children online. Children are especially vulnerable to the risks of the internet, which include age-inappropriate, illegal and harmful content, interactions and activities, privacy violations, and overuse.
“”””””””””””””When it comes to promoting the benefits of technology for children while, at the same time, fostering a safe and secure online environment, stakeholders need to strike a careful balance between the need to safeguard children, and the need to respect children’s digital rights. The sections below tackle the security aspect of children’s internet use.
