Bottom-up AI and the right to be humanly imperfect | IGF 2023
Event report
Speakers
- Jovan Kurbalija, Executive Director, DiploFoundation
- Sorina Teleanu, Director of Knowledge, DiploFoundation
Table of contents
Disclaimer: This is not an official record of the IGF session. The DiploAI system automatically generates these resources from the audiovisual recording. Resources are presented in their original format, as provided by the AI (e.g. including any spelling mistakes). The accuracy of these resources cannot be guaranteed. The official record of the session can be found on the IGF's official website.
Knowledge Graph of Debate
Session report
Jovan Kurbalija, Executive Director, DiploFoundation
Jovan Kurbalija, the Director of the Diplo Foundation, professes the significant intersection of philosophy, technology, and artificial intelligence (AI), particularly concerning education, cultural context, governance, and ethics. He promotes profound understanding of technological advancements without becoming engrossed by its complexities, thereby maintaining a steadfast focus on the broader societal and philosophical effects.
At the heart of Kurbalija's argument is the Diplo Foundation's innovative development of a hybrid system. This unique construct, merging artificial intelligence with human intelligence for reporting, has been cultivated based on the Foundation's extensive experience and session management. The potential capabilities of this system in promoting dynamic learning environments and stimulating intellectual engagement were also highlighted.
Adding a fresh perspective to the discourse, Kurbalija proposed that AI models should harmonise with each community's distinct traditions and practices. He believes this would contribute to a more authentic, bottom-up AI model that does not limit itself to predominantly European philosophical traditions. In a similar vein, he emphasised the urgent need for high-quality data in developing diverse, flexible open-source AI models.
However, he stressed the importance of preserving individual and community-based knowledge rights, protecting against its potential commodification by AI. Kurbalija highlighted concerns regarding transparency and explainability within AI applications, allied with apprehensions about AI's misuse in creating disinformation.
Certain aspects of AI's current governance invoked criticism, notably the sidelining of smaller entities by larger corporations. A call was made for increased corporate responsibility due to the extant challenges related to AI usage. Despite AI's potential in preserving small communities' heritage and culture, a significant gap was recognised concerning the lack of initiatives that leverage AI to safeguard cultural diversity.
While acknowledging AI's potential in aiding individuals with disabilities, caution was raised about anthropomorphising AI, reinforcing that AI should serve as a tool, not as a master. The uniqueness and imperfection of human traits were lauded as invaluable characteristics and were claimed to be essential considerations in the development of AI.
Sorina Teleanu, Director of Knowledge, DiploFoundation
The analysis unveils an assemblage of sentiments regarding the application of Artificial Intelligence (AI) in multifaceted domains such as negotiations, decision-making, educational sectors, foreign affairs, and surmounting challenges faced by smaller and developing nations.
A positive aspect of AI is enlightened in its capacity to support complex decision-making procedures and foster critical thinking within educational environments. The effectiveness of AI in enhancing decision-making and negotiation is showcased in the global digital compact simulation. The AI advisor was utilised to refine arguments and language, whilst being trained to offer details on digital policy and internet governance. Further, in the realm of education, dismissing the use of AI in schools is argued to be counter-productive. The significance of AI in stimulating critical thinking and understanding intricate policy matters is underscored, thereby highlighting its role in shaping quality education and nurturing innovation.
However, the sentiment isn't unequivocally positive. The analysis also uncovers AI's limitations, stressing the importance of its critical application. Instances where AI hallucinates and doesn't always deliver perfect results have been pointed out, demonstrating that although AI could be a valuable tool, it must not be relied upon blindly.
The evaluation also delves into the struggles of small and developing nations, particularly in digital governance and diplomacy. The overwhelming volume of information and tasks, combined with limited resources and a dearth of time, often poses significant challenges for these countries, thereby requiring the use of AI for effective decision-making and negotiation.
AI's significance in foreign affairs emerges as it economises time and provides diplomats with a foundation for negotiations. Ministries of Foreign Affairs are encouraged to develop their own AI systems to retain control over data, relying on their knowledge base and experience. The concept of 'bottom-up AI' is proposed, arguing that it could allow a more controlled and tailored use of AI, and return AI back to users.
The potential of AI to promote underserved communities and mitigate representation inequalities is also explored. Bottom-up AI's development based on knowledge from these communities bolsters this argument, aided by the observed stance that AI can encourage more meaningful engagement for smaller countries.
Nevertheless, despite the proposed benefits, the need for transparency and accountability of AI systems is underscored, with apprehensions regarding the non-explainability of neural networks being raised. There is significant criticism regarding uncritically accepting statements from large AI systems and a generic tendency for blind trust.
The evaluation concludes by emphasising the importance of addressing current AI issues, such as regulation, before getting consumed with future challenges. Large firms are depicted as demanding future AI regulation whilst disregarding existing issues, prompting a call for allocating resources to counter today's challenges before concerning ourselves with future ordeals.
In harmony with Sustainable Development Goals (SDGs) 4, 9, 10, 16, and 17, the overall analysis accentuates the potential of AI in driving innovation, assisting in quality education, reducing inequalities, aiding in institution-building, and fostering partnerships. Nevertheless, the pivotal importance of careful, regulated, and transparent usage of AI is underscored.
Audience
The discourse unveiled a plethora of critical points spanning numerous subjects. A significant challenge was identified in Brazil with regard to technology - a substantial number of NGOs are grappling with integrating technological approaches due to lacking tech literacy. This issue hampers these organisations from fully capitalising on their potential in their operations, suggesting the necessity for dedicated digital literacy programmes.
Interestingly, the proposition was raised that augmenting participation and representation in tech-related matters could bolster the advocacy of local perspectives. This argument was underpinned by the desire to categorise knowledge in a manner that respects and supports local viewpoints, shining a spotlight on an essential consideration in the democratisation of technology and inclusivity.
The discussion then veered towards concerns about the economic ramifications of automation. Technological tools such as chatbots in Brazil's service sector usage have soared, stirring anxieties surrounding potential structural unemployment and escalating the possibility for diminished economic opportunities and job security. In view of this, there was concurrence on the need for a paradigm shift to orchestrate the origination of dignified, rewarding economic opportunities.
The discourse additionally exhibited a robust belief in innovation and its prospective benefits. Participants conveyed stout support for a bottom-up Artificial Intelligence (AI) approach and open-source methods for managing knowledge on a grander scale. The capacity of these methods to organise and categorise knowledge with sensitivity to local perspectives was seen as a hopeful potential.
However, feedback and constructive criticism were deemed essential for the amelioration of larger systems. Questions were raised about whether insights from these systems were being considered and whether prevailing systemic problems required addressing, indicating a need for rigorous examination and rectification of these systems.
A particularly thought-provoking point in the discourse was the expression of concern regarding the rapid displacement of families due to the expanding influence of modern technology. This issue particularly afflicts rural areas of Brazil, leading to a diminution of the countryside and augmentation of cities. This cultural and knowledge erosion is significant, especially in small communities.
A suggestion was forwarded in response to these challenges to utilise AI to preserve and cultivate the history and culture of small communities. This would involve AI assisting in updating and uploading knowledge about these areas, spanning physical practices, agricultural practices, stories, and mythologies.
One neutral sentiment proffered revolved around AI's design and adaptability, specifically tailored towards individuals with disabilities. Current AI systems are often trained on 'perfect' data, potentially making them less adaptable to human error. Conversely, humans are able to learn from their mistakes. Consequently, developers must cultivate more adaptable AI that can accommodate humanlike errors.
In a related argument, it was posited that AI should be enhanced to aid persons with disabilities rather than marginalising them. There is apprehension that current AI protocols might inadvertently engender a standard of 'perfection' that could be exclusionary, particularly for individuals with disabilities. However, by ensuring AI is a tool for inclusivity rather than exclusion, an opportunity arises.
In sum, these insights prompt a reassessment of how technology, specifically AI, is utilised and incorporated into diverse sectors of society. The call is widespread for more tech literacy programmes, adaptable AI, and active involvement in technology decision-making. These transformations would contribute significantly to striking a healthy balance between swift technological progression and preserving crucial aspects of our cultural heritage and humanity.
In conclusion, Kurbalija's discussions presented a potent outlook on AI's broad societal impacts, issuing an urgent summons for more inclusive and ethical AI development, whilst highlighting concerns regarding transparency, accountability, and the conservation of local cultures and individual rights.
Speakers
A
Audience
Speech speed
148 words per minute
Speech length
1035 words
Speech time
420 secs
Arguments
Problem in incorporating technological approaches by NGOs in Brazil due to lack of tech familiarity
Supporting facts:
- Many NGO's are not very tech-savvy
- Brazil sees lack of technological integration in NGO operations
Topics: Tech literacy, NGOs, Brazil
Need to increase participation and representation in tech-related matters
Supporting facts:
- Desire to categorize knowledge sensitive to local perspectives
- Increased participation can help advocating local perspectives in technology
Topics: Participation, Technology, Advocacy organizations
Concerns about structural unemployment due to increased automation
Supporting facts:
- Rise in the usage of chatbots and automation in service sectors in Brazil
- Concern about decreasing economic opportunities and job security
Topics: Structural Unemployment, Automation, Chatbot
Need to shift to economic opportunities that signify dignity and are rewarding
Topics: Economic Opportunities, Job dignity, Employment
Possible for small civil society groups to have large-scale impact through AI and reinforced learning
Supporting facts:
- Small NGOs or civil society, even with small number of representatives, can contribute effectively by utilizing AI for analyzing their discussions and progress
- The AI system used will learn and grow over time with every stage
Topics: Artificial Intelligence, Civil Society, Reinforced Learning
The concern about the cultural and knowledge loss of small communities due to modern changes and technology influence
Supporting facts:
- The rapid modern changes are displacing families and leading them move too much
- The countryside, being the majority of landmass of Brazil, is shrinking while cities are expanding
Topics: AI, Culture preservation, Displacement
AI needs to be designed to be adaptable and humanlike to cater individuals with disabilities
Supporting facts:
- AI is often trained on 'perfect' data, making it possibly less adaptable to human error
- Humans can learn from our mistakes, a trait which AI currently may lack
Topics: Artificial Intelligence, Disability, Inclusivity, Human Error
Report
The discourse unveiled a plethora of critical points spanning numerous subjects. A significant challenge was identified in Brazil with regard to technology - a substantial number of NGOs are grappling with integrating technological approaches due to lacking tech literacy. This issue hampers these organisations from fully capitalising on their potential in their operations, suggesting the necessity for dedicated digital literacy programmes.
Interestingly, the proposition was raised that augmenting participation and representation in tech-related matters could bolster the advocacy of local perspectives. This argument was underpinned by the desire to categorise knowledge in a manner that respects and supports local viewpoints, shining a spotlight on an essential consideration in the democratisation of technology and inclusivity.
The discussion then veered towards concerns about the economic ramifications of automation. Technological tools such as chatbots in Brazil's service sector usage have soared, stirring anxieties surrounding potential structural unemployment and escalating the possibility for diminished economic opportunities and job security.
In view of this, there was concurrence on the need for a paradigm shift to orchestrate the origination of dignified, rewarding economic opportunities. The discourse additionally exhibited a robust belief in innovation and its prospective benefits. Participants conveyed stout support for a bottom-up Artificial Intelligence (AI) approach and open-source methods for managing knowledge on a grander scale.
The capacity of these methods to organise and categorise knowledge with sensitivity to local perspectives was seen as a hopeful potential. However, feedback and constructive criticism were deemed essential for the amelioration of larger systems. Questions were raised about whether insights from these systems were being considered and whether prevailing systemic problems required addressing, indicating a need for rigorous examination and rectification of these systems.
A particularly thought-provoking point in the discourse was the expression of concern regarding the rapid displacement of families due to the expanding influence of modern technology. This issue particularly afflicts rural areas of Brazil, leading to a diminution of the countryside and augmentation of cities.
This cultural and knowledge erosion is significant, especially in small communities. A suggestion was forwarded in response to these challenges to utilise AI to preserve and cultivate the history and culture of small communities. This would involve AI assisting in updating and uploading knowledge about these areas, spanning physical practices, agricultural practices, stories, and mythologies.
One neutral sentiment proffered revolved around AI's design and adaptability, specifically tailored towards individuals with disabilities. Current AI systems are often trained on 'perfect' data, potentially making them less adaptable to human error. Conversely, humans are able to learn from their mistakes.
Consequently, developers must cultivate more adaptable AI that can accommodate humanlike errors. In a related argument, it was posited that AI should be enhanced to aid persons with disabilities rather than marginalising them. There is apprehension that current AI protocols might inadvertently engender a standard of 'perfection' that could be exclusionary, particularly for individuals with disabilities.
However, by ensuring AI is a tool for inclusivity rather than exclusion, an opportunity arises. In sum, these insights prompt a reassessment of how technology, specifically AI, is utilised and incorporated into diverse sectors of society. The call is widespread for more tech literacy programmes, adaptable AI, and active involvement in technology decision-making.
These transformations would contribute significantly to striking a healthy balance between swift technological progression and preserving crucial aspects of our cultural heritage and humanity.
JK
Jovan Kurbalija
Speech speed
150 words per minute
Speech length
8952 words
Speech time
3590 secs
Arguments
Jovan Kurbalija discusses the idea of bridging philosophy, technology, and AI
Supporting facts:
- Jovan Kurbalija is the Director of Diplo Foundation and Head of Geneva Internet Platform
- Jovan discusses how AI has pushed us to ponder philosophical questions
- Diplo Foundation approaches AI through technology, diplomacy, governance, and philosophy
Topics: Artificial Intelligence, Philosophy, Technology
Diplo Foundation is developing a hybrid system combining artificial intelligence and human intelligence for reporting
Supporting facts:
- The hybrid system will be used for reporting from IGF sessions
- The system has been trained on Diplo Foundation's reporting and sessions
Topics: Artificial Intelligence, Human Intelligence, Reporting
Walk the talk approach is crucial for understanding and utilizing AI
Supporting facts:
- Jovan emphasizes on using AI and understanding its workings
- The Diplo Foundation stresses the importance of understanding technology to comprehend governance
Topics: Artificial Intelligence
There is a need for balance in AI discussions - understanding technology without becoming overly technical
Supporting facts:
- Diplo Foundation explores technology to understand how it functions
- However, they emphasize that one shouldn't become too technical and miss the bigger picture
Topics: Artificial Intelligence, Technology, Balance
Understanding the historical concepts and philosophies can enrich the contemporary discourse on AI
Supporting facts:
- Jovan explored various historical and philosophical concepts related to AI
- Ancient Greek, Chinese philosophy, Vienna thinkers, Ubuntu thinkers were explored for their perspectives on knowledge, ethics, individuals and communities
Topics: Artificial Intelligence, Philosophy, History
AI can be used effectively in the field of education, enabling critical thinking and creativity among students.
Supporting facts:
- Students engage in questioning and provide feedback on AI responses, leading to an active learning environment.
- The academic community is beginning to accept the idea of AI being used as an engaging tool in education.
- The nature of AI interactions can improve the overall educational system.
Topics: AI, Education, Critical thinking, Creativity
Open source AI models and high-quality data are crucial for AI development.
Supporting facts:
- He indicates the limitations in terms of quantity of data and suggests improving the quality of data.
- AI now needs high-quality data for more performance improvements.
- Open-source AI allows for more diversity and flexibility in development.
Topics: AI, Open Source, High-quality data, AI development
AI can be used as a tool for small states to capture their interests in global governance
Supporting facts:
- The system can notify the respective countries about discussions of relevance to their interests in different global platforms.
Topics: Artificial Intelligence, Governance, Digital Diplomacy
Preservation of human uniqueness and imperfection should be a priority in the development of AI
Supporting facts:
- AI cannot yet engage in unique human activities such as negotiating at the flea market
Topics: Artificial Intelligence, Human uniqueness
Job is not only about income but also about dignity
Supporting facts:
- People are currently losing jobs to AI
- Job is a way of realizing human potential throughout civilization
Topics: AI, Unemployment, Universal income, Civilization
The need to introduce right to be imperfect
Supporting facts:
- AI-driven optimization neglects the human right to be imperfect
Topics: AI, Imperfection, Optimization
AI can help smaller entities or NGOs have a more meaningful engagement and better representation in governance discussions or in the development of AI.
Supporting facts:
- AI can help underline areas of interest and indicate potential alliance partners.
- AI can aid in building a position for meaningful engagement.
Topics: Artificial Intelligence, Representation, Governance, Development of AI
Bigger systems don't listen to smaller parties and have an element of arrogance
Supporting facts:
- smaller parties like us feel sidelined
- attention is mostly to Congress, EU Parliament and similar places
Topics: Internet Governance, AI explainability, Disinformation
AI is a magical technology that can be misused
Supporting facts:
- AI brings magic on steroids
- AI contributes to the destruction of public spaces
Topics: AI regulation, Neural Networks, Disinformation
AI applications lack transparency and create confusion
Supporting facts:
- non-explainable neural networks give rise to the feeling of magic
- the non-availability of the source of answer
Topics: AI transparency, AI explainability, Disinformation
Corporations are calling for the regulation of future AI, not the AI they have already developed
Supporting facts:
- Sam Altman and other influential individuals are talking about regulating AI but not with a focus on the AI by big corporations
Topics: AI regulation, Corporate responsibility, Future of AI
When regulating AI, consider hardware, data, algorithms, and apps
Supporting facts:
- Regulating components of AI are hardware, data, algorithms, and applications
Topics: Factors of AI, AI regulation, Data Privacy
AI can be used to preserve and develop small communities, history, and culture
Supporting facts:
- As per Jovan, it could be done with open source tools
- Jovan mentions these communities possess core knowledge which can and should be preserved like questions of family, love, purpose of life
- He confirms it being technically easy, albeit organizationally difficult.
Topics: AI, Culture Preservation, Community Development
AI offers possibility for people with disabilities
Supporting facts:
- We are seeing it with transcribing
- People with disabilities are not prominent yet in AI debates
Topics: AI, Accessibility, Disabilities
AI should be considered as a tool, not as a master
Topics: AI, Human-technology interaction
There is unease around anthropomorphizing AI
Supporting facts:
- Sophia being presented as an AI who can answer your question
Topics: AI, Anthropomorphizing
We should continue to value human imperfections and not strive for perfect AI
Supporting facts:
- Humans make mistakes and correct them
- AI trained on perfect data might not accommodate human errors
Topics: AI, Human imperfections
Report
Jovan Kurbalija, the esteemed Director of the Diplo Foundation, professes the significant intersection of philosophy, technology, and artificial intelligence (AI), particularly concerning education, cultural context, governance, and ethics. He promotes profound understanding of technological advancements without becoming engrossed by its complexities, thereby maintaining a steadfast focus on the broader societal and philosophical effects.
At the heart of Kurbalija's argument is the Diplo Foundation's innovative development of a hybrid system. This unique construct, merging artificial intelligence with human intelligence for reporting, has been cultivated based on the Foundation's extensive experience and session management. The potential capabilities of this system in promoting dynamic learning environments and stimulating intellectual engagement were also highlighted.
Adding a fresh perspective to the discourse, Kurbalija proposed that AI models should harmonise with each community's distinct traditions and practices. He believes this would contribute to a more authentic, bottom-up AI model that does not limit itself to predominantly European philosophical traditions.
In a similar vein, he emphasised the urgent need for high-quality data in developing diverse, flexible open-source AI models. However, he stressed the importance of preserving individual and community-based knowledge rights, protecting against its potential commodification by AI. Kurbalija highlighted concerns regarding transparency and explainability within AI applications, allied with apprehensions about AI's misuse in creating disinformation.
Certain aspects of AI's current governance invoked criticism, notably the sidelining of smaller entities by larger corporations. A call was made for increased corporate responsibility due to the extant challenges related to AI usage. Despite AI's potential in preserving small communities' heritage and culture, a significant gap was recognised concerning the lack of initiatives that leverage AI to safeguard cultural diversity.
While acknowledging AI's potential in aiding individuals with disabilities, caution was raised about anthropomorphising AI, reinforcing that AI should serve as a tool, not as a master. The uniqueness and imperfection of human traits were lauded as invaluable characteristics and were claimed to be essential considerations in the development of AI.
In conclusion, Kurbalija's discussions presented a potent outlook on AI's broad societal impacts, issuing an urgent summons for more inclusive and ethical AI development, whilst highlighting concerns regarding transparency, accountability, and the conservation of local cultures and individual rights.
ST
Sorina Telenau
Speech speed
207 words per minute
Speech length
1649 words
Speech time
477 secs
Arguments
Artificial Intelligence can be effectively used for negotiation and decision-making
Supporting facts:
- AI advisor was used in the global digital compact simulation to fine-tune arguments and language
- AI advisor was trained to provide information on digital policy and internet governance
Topics: AI, Negotiation, Decision-making
AI technology has limitations and should be used critically
Supporting facts:
- The use of AI in the global digital compact simulation showed that while useful, AI should not be solely relied upon
- AI sometimes 'hallucinates' and does not always produce perfect results
Topics: AI, Critical Thinking
Small and developing countries struggle to keep up with digital governance and digital diplomacy due to limited resources and lack of time
Supporting facts:
- Small missions in Geneva, a hub for international diplomacy and governance, often feel overwhelmed by the volume of information and tasks needed
Topics: Small and developing countries, Digital Governance, Digital Diplomacy
Use of AI can enable efficiency and effectiveness in foreign affairs
Supporting facts:
- AI can save time and provide a starting point for diplomats for negotiations
- A Ministry of Foreign Affairs can develop its own AI systems to retain control of their data and rely on their own knowledgebase
Topics: AI, Foreign Affairs
Bottom-up AI can help better representation from underserved communities
Supporting facts:
- AI can use knowledge from these communities when developed
- Following the reporting from the UNGA can alert smaller countries.
- AI can help build the position to get meaningful engagement
Topics: AI development, Representation in governance, Small missions
Concerns on transparency and accountability of AI
Supporting facts:
- Non-explainability of neural networks contributes to lack of transparency
- Insistence on having the source of AI conclusion
Topics: Artificial Intelligence (AI), Technology, Neural Networks
Criticism of statements from big AI systems
Supporting facts:
- Uncritically accepted statements about the risk of AI
- Desire for explanation, not blind trust
Topics: Artificial Intelligence (AI), Technology, Sam Altman
Report
The analysis unveils an assemblage of sentiments regarding the application of Artificial Intelligence (AI) in multifaceted domains such as negotiations, decision-making, educational sectors, foreign affairs, and surmounting challenges faced by smaller and developing nations. A positive aspect of AI is enlightened in its capacity to support complex decision-making procedures and foster critical thinking within educational environments.
The effectiveness of AI in enhancing decision-making and negotiation is showcased in the global digital compact simulation. The AI advisor was utilised to refine arguments and language, whilst being trained to offer details on digital policy and internet governance. Further, in the realm of education, dismissing the use of AI in schools is argued to be counter-productive.
The significance of AI in stimulating critical thinking and understanding intricate policy matters is underscored, thereby highlighting its role in shaping quality education and nurturing innovation. However, the sentiment isn't unequivocally positive. The analysis also uncovers AI's limitations, stressing the importance of its critical application.
Instances where AI hallucinates and doesn't always deliver perfect results have been pointed out, demonstrating that although AI could be a valuable tool, it must not be relied upon blindly. The evaluation also delves into the struggles of small and developing nations, particularly in digital governance and diplomacy.
The overwhelming volume of information and tasks, combined with limited resources and a dearth of time, often poses significant challenges for these countries, thereby requiring the use of AI for effective decision-making and negotiation. AI's significance in foreign affairs emerges as it economises time and provides diplomats with a foundation for negotiations.
Ministries of Foreign Affairs are encouraged to develop their own AI systems to retain control over data, relying on their knowledge base and experience. The concept of 'bottom-up AI' is proposed, arguing that it could allow a more controlled and tailored use of AI, and return AI back to users.
The potential of AI to promote underserved communities and mitigate representation inequalities is also explored. Bottom-up AI's development based on knowledge from these communities bolsters this argument, aided by the observed stance that AI can encourage more meaningful engagement for smaller countries.
Nevertheless, despite the proposed benefits, the need for transparency and accountability of AI systems is underscored, with apprehensions regarding the non-explainability of neural networks being raised. There is significant criticism regarding uncritically accepting statements from large AI systems and a generic tendency for blind trust.
The evaluation concludes by emphasising the importance of addressing current AI issues, such as regulation, before getting consumed with future challenges. Large firms are depicted as demanding future AI regulation whilst disregarding existing issues, prompting a call for allocating resources to counter today's challenges before concerning ourselves with future ordeals.
In harmony with Sustainable Development Goals (SDGs) 4, 9, 10, 16, and 17, the overall analysis accentuates the potential of AI in driving innovation, assisting in quality education, reducing inequalities, aiding in institution-building, and fostering partnerships. Nevertheless, the pivotal importance of careful, regulated, and transparent usage of AI is underscored.