This discussion, moderated by Caitlin Kraft-Buchman of Women at the Table, focused on the systemic exclusion of women from medical research and data, and the compounding effect this has as artificial intelligence is built upon this flawed foundation. Panellists Oriana Kraft of FemmeTechnology.org and Yu Ping Chan of UNDP explore how gender bias is embedded at every layer of the healthcare and technology stack.
Oriana Kraft outlined the scale of the problem in medicine, noting that there are sex differences in every single cell in the human body, yet research has historically focused almost exclusively on male subjects . Male animals outnumber female animals in studies by five-and-a-half to one, based on a false assumption that female hormonal cycles make them too unpredictable . The consequences are severe: women are diagnosed on average four years later than men across 770 diseases , are 50% more likely to die following a heart attack , and are 50-75% more likely to experience adverse drug reactions . Conditions such as endometriosis take an average of seven years to diagnose, and women must see five physicians on average before receiving an accurate diagnosis, meaning inaccurate records accumulate in medical databases .
When AI models are trained on this biased historical data, diagnostic accuracy is reduced by 11.3% , and the problem is further compounded by the use of synthetic data, which progressively erases signals relating to women's health at the margins of data distributions . Yu Ping Chan added that a UNDP survey of 80 countries found that close to 90% of both men and women hold at least one bias against women, meaning the very substrate on which digital systems are built is already skewed . She warned that a 10-15% global gender gap in internet connectivity, rising to 30-40% in developing countries, means that continued digital transformation without addressing these biases will worsen inequalities .
Proposed solutions included calling for representativeness as a scientific standard in data collection , embedding gender-disaggregated data requirements into government procurement contracts , and incentivising both female physicians and patients to contribute richer, more nuanced health data . Kraft-Buchman also suggested training women's rights groups to become data collectors and owners, enabling them to sell that data back to markets that currently lack it . An audience member from Tanzania highlighted that research grounded in diverse female populations could unlock important discoveries, such as why certain communities experience fewer menopausal symptoms .
The discussion concluded with a shared sense of urgency and frustration that awareness has not translated into sufficient action , with panellists calling for political accountability, clearer international standards, and the use of existing frameworks such as WSIS e-health indicators to drive gender-representative data practices . The overarching message was that correcting these deep-rooted biases requires coordinated commitment from governments, the private sector, and international organisations before further digital infrastructure is built upon an already unequal foundation .
Major Discussion Points
- Gender bias in medical research and AI healthcare models: The panel highlighted that medical research has historically been conducted almost exclusively on male subjects, leading to systemic gaps in women's healthcare. This bias is then compounded when AI models are trained on this flawed data. For example, troponin thresholds calibrated on men miss 42% of female heart attacks , women are diagnosed on average four years later than men across 770 diseases , and AI trained on misrepresentative data reduces diagnostic accuracy by 11.3% . The "cascade of distortion" - from preclinical research through clinical guidelines to AI models - was described in detail , with male animals outnumbering female animals 5.5 to one in studies .
- The need for richer, sex-disaggregated and life-stage data collection: A central theme was the absence of data capturing uniquely female biological experiences. There are currently no standard forms in healthcare or HR systems to capture menopause, the menstrual cycle, or postpartum experiences . Speakers argued that female life stages interact with every organ in the body and that capturing this information - including from patients themselves via wearables and cycle logs - could be transformative . Female physician notes were found to be twice as detailed as male physicians', suggesting incentivising nuanced data capture as one practical step .
- Hardwiring gender bias into digital public infrastructure: Yu Ping Chan raised the concern that as digital public infrastructure is built, it risks encoding existing societal biases. A UNDP Gender Social Norms Index found that close to 90% of men and 87% of women hold at least one bias against women, and there has been a decade of stagnation in progress . Combined with a 10-15% digital gender gap in connectivity globally - rising to 30-40% in developing countries - the panel warned that continued digital transformation without addressing these biases will worsen inequalities .
- Translating commitments into concrete action - standards, procurement, and accountability: The discussion grappled with how to move beyond declarations and documents towards real change. The Hamburg Declaration on responsible AI for the SDGs was cited as an example of a multi-stakeholder commitment that includes gender as a priority area , but speakers acknowledged the difficulty of turning paper commitments into action . Proposed mechanisms included establishing representativeness as a scientific standard , embedding gender-disaggregated data requirements into government procurement contracts , and using WSIS e-health indicators to encourage gender-representative training data .
- Empowering women as data producers and advocates for change: Rather than framing women solely as recipients of technology, the panel advocated for positioning women as data collectors, owners, and producers . Speakers suggested training women's rights groups to collect and manage data, and noted that women in FemTech contexts are already willing to donate their data to advance women's healthcare . The panel also called for political accountability, arguing that women's health should feature in electoral platforms and that lobbying efforts and celebrity advocacy have already begun to shift public awareness .
- --
Overall Purpose
- The discussion aimed to expose the systemic exclusion of women from medical research and AI training data, illustrate the real-world health consequences of this exclusion, and explore practical pathways - including data standards, procurement policy, political advocacy, and grassroots data collection - to correct these imbalances before they become further entrenched in emerging digital and AI infrastructure.
- --
Overall Tone
- The tone was predominantly urgent and concerned, reflecting the seriousness of the health disparities described. Oriana Kraft's detailed presentation of the "cascade of distortion" carried a sobering, evidence-driven quality. The tone shifted towards cautious optimism in the latter stages, particularly when speakers discussed the potential for leapfrog innovation in the Global South , the scientific opportunity represented by untapped women's health data , and the idea of a "health data race" among nations . Audience contributions - particularly from women sharing personal and cultural experiences from Tanzania and China - added a grounded, human dimension that reinforced the panel's sense of collective purpose.
Expanded Summary: Gender Bias in Medical Research, AI Healthcare Models, and Digital Public Infrastructure
#
Introduction and Context
The session was moderated by Caitlin Kraft-Buchman of Women at the Table and brought together Oriana Kraft, founder of FemmeTechnology.org, and Yu Ping Chan of UNDP . It is worth noting that Ambassador Kha had originally been scheduled to participate but was called away to moderate another panel, with his staff simultaneously engaged at the Human Rights Council negotiating a settlement; Kraft-Buchman noted that the panel would carry forward his work on representativeness in data. The discussion took place against a backdrop of growing concern about the deployment of artificial intelligence in high-risk settings - including hospitals, courtrooms, and financial systems - where decisions about who receives a diagnosis, a loan, or legal redress are increasingly shaped by algorithmic systems . Kraft-Buchman opened by observing that machine learning operates on averages and recursive self-learning, meaning that populations furthest from the privileged centre - including women, rural communities, and disabled people - are progressively erased from model outputs as the technology develops . This framing established the session's central argument: that gender bias is not merely a social problem but a structural feature of how AI systems are built, and one with profound real-world consequences.
#
The Cascade of Distortion: Gender Bias in Medical Research
Oriana Kraft provided the session's empirical foundation, presenting what she described as a "cascade of distortion" running from preclinical research through clinical guidelines to AI model training . She began with a foundational scientific observation that is widely underappreciated: there are sex differences in every single cell in the human body, meaning that the way every organ functions differs between men and women . Despite this, medical research has historically been conducted almost exclusively on male subjects - male cells, male animals, and male bodies . Male animals outnumber female animals in research studies at a ratio of 5.5 to one, a disparity rooted in a demonstrably false assumption that female hormonal cycles make female subjects too unpredictable . In reality, Kraft noted, male mice with testosterone fluctuations are less predictable than female mice, whose cycles at least follow a known pattern . The exclusion of female subjects was therefore not merely a value judgement but a scientific error.
The consequences of this exclusion are severe and well-documented. Women are diagnosed on average four years later than men across 770 diseases , are 50% more likely to die following a heart attack , and are 50-75% more likely to experience adverse drug reactions, largely because they were effectively banned from clinical trials until 1993 . Diagnostic tools have been calibrated on male physiology: troponin thresholds used to detect cardiovascular disease are set at levels appropriate for the male body and are too high for women, causing 42% of female heart attacks to be missed . Imaging technology is similarly designed around the vessels more commonly affected in men, meaning that female cardiovascular presentations are systematically overlooked at multiple points in the diagnostic process . Once diagnosed, women are less likely to be prescribed gold-standard treatment, and even those treatments have been found to be less effective in women - as Kraft noted was demonstrated by what she described as the REBOOT trial, which she recalled had come out approximately two years prior .
The misdiagnosis problem is compounded by the accumulation of inaccurate records in medical databases. Conditions such as endometriosis take an average of seven years to diagnose, and women must see an average of five physicians before receiving an accurate diagnosis . Each physician seen before the correct diagnosis records an inaccurate one, and unless a patient is in a country such as Denmark - which has invested in large-scale linked health registries - those inaccurate records are never updated . The result is a body of medical data that is not merely incomplete but actively misleading, and it is on this foundation that AI health models are being trained .
#
The Compounding Effect of AI Training on Biased Data
Kraft was direct in addressing a common assumption in AI ethics: that explainable AI - systems designed to articulate their reasoning - can compensate for biased training data. The evidence does not support this. Kraft cited figures indicating that AI trained on misrepresentative medical data reduces diagnostic accuracy by 11.3%, and that this reduction persists even when physicians use explainable AI systems . The only genuine solution is accurate, representative data at the point of training. The problem is further compounded by the increasing use of synthetic data, which major AI companies have turned to as they report running out of fresh human data . Each time a model is retrained on synthetic data, signals from the tail ends of distributions - where women, as an underrepresented group, are disproportionately located - are progressively erased . Women are not rare in reality, but they are rare in the representation of data, and this gap widens with every model iteration .
Kraft-Buchman reinforced this point by noting that de-biasing existing datasets is not a genuine solution: it can mitigate harm but cannot resolve the underlying problem . The implication is that the field must move towards building new, representative datasets and sector-specific AI models from scratch, rather than attempting to correct large language models that have already absorbed decades of skewed data . This view was echoed in the observation that sovereign AI trends and geopolitical pressures are already pushing countries towards smaller, sector-specific language models, which may create an opportunity to build health AI on a more representative foundation .
#
Hardwiring Gender Bias into Digital Public Infrastructure
Yu Ping Chan broadened the discussion from healthcare-specific data to the wider challenge of building digital public infrastructure on a biased substrate. She cited UNDP's Gender Social Norms Index, which surveyed 80 countries representing 85% of the global population, and found that close to 9 in 10 people - 90% of men and 87% of women - hold at least one bias against women, with a decade of stagnation in progress on this measure . This means that the data feeding AI models is not merely technically incomplete but socially skewed, encoding unconscious assumptions about gender roles and capabilities that have been stable for a generation.
Chan warned that a 10-15% global gender gap in connectivity and internet use - rising to 30-40% in developing countries - means that women are already underrepresented in the data that feeds digital systems . As digital public infrastructure continues to expand without addressing these biases, the inequalities are not merely preserved but hardwired and worsened . She acknowledged that the tech sector has historically resisted quotas and firm regulations, and that she was genuinely unsure what the fix is . This candour foreclosed easy reassurance and opened space for a more honest exploration of mechanisms.
#
Missing Data: Female Life Stages and Patient-Generated Information
A central theme of the discussion was the near-total absence of data capturing uniquely female biological experiences. Kraft noted that there is no standard form in healthcare or HR systems to capture whether a woman is going through menopause, experiencing menstrual cycle changes, or in a postpartum period . This is not a minor omission: female life stages interact with every organ in the body, and conditions such as preeclampsia and gestational diabetes increase lifetime cardiovascular disease risk by two to four times . Without systematic capture of this information, it is impossible to monitor women appropriately or to conduct early detection that could reduce downstream comorbidities and save lives .
The menstrual cycle itself contains clinically significant signals that current instruments are not designed to capture. A woman's immune profile changes throughout the cycle, affecting vaccination response rates, adverse drug reactions, and even chemotherapy outcomes . These are not marginal effects but potentially transformative ones, yet the data infrastructure to capture them does not exist in any systematic form . Meanwhile, women are already generating rich health data through wearables, cycle logs, and detailed personal notes, and are bringing this information to physician appointments - where it is largely dismissed . Femtech startups have found that women are willing to donate their data simply to have better care and to contribute to advancing women's healthcare as a whole . The irony, as Kraft observed, is that this willingness exists precisely at the moment when major AI companies report having run out of fresh human data .
An unspecified study cited by Kraft found that female physician notes were approximately twice as detailed as those of male physicians, suggesting that incentivising nuanced data capture - including by rewarding clinicians for richer documentation - could be a practical step towards improving the quality of training data . The broader point is that the problem is not a lack of available information but a failure to capture, value, and integrate it into the systems that matter.
#
The Intersectional Dimension: Women of Colour and the Global South
The discussion acknowledged, though did not fully resolve, the additional layers of disadvantage facing women of colour and women from the Global South. Even within the United States, maternal mortality data is insufficiently nuanced, with African-American women facing disproportionately high rates that are not adequately reflected in research or clinical guidelines . Ethnic-specific risk factors - such as the increased risk of certain forms of anaemia among women of Southeast Asian descent - are not systematically incorporated into screening protocols . The one-size-fits-all model, extrapolated from a young, healthy white man, simply does not work for the majority of the world's population .
An audience member from Tanzania offered a striking illustration of this gap, observing that her grandmother and mother had never experienced severe menopausal symptoms, and suggesting that research grounded in African women's experiences could yield transformative scientific insights - including for women in other parts of the world who are now experiencing those symptoms . She also noted that while her children aged nine and ten already wore glasses, she herself had no eye problems at nearly fifty - a further illustration of the potential value of research grounded in specific populations. This contribution reinforced the argument that the populations most excluded from research may contain the most valuable scientific information. Chan raised the additional concern that data on women from the Global South must account not only for race and ethnicity but also for language, cultural context, and the vastly different conditions in which women in developing countries live .
#
Proposed Solutions: Standards, Procurement, and Regulatory Models
The discussion generated several concrete proposals for addressing these systemic failures. Kraft-Buchman proposed establishing representativeness as a formal scientific standard, drawing on the principle of substantive equality embedded in CEDAW - the international treaty on women's rights - which holds that equality means ensuring everyone receives what is genuinely suited to their needs, rather than a one-size-fits-all provision . In a health context, this would mean ensuring that the people in a given population are sincerely represented in the data used to train models for that use case .
Chan proposed procurement requirements as a more immediately actionable mechanism, arguing that it is easier to require gender-disaggregated data and algorithmic transparency before signing a government contract than to audit for compliance after the fact . This approach would place the burden of proof on technology providers and model builders before they are awarded public contracts, rather than relying on voluntary commitments or post-hoc accountability. Nordic countries were cited as a regulatory model: several have mandated sex-disaggregated data collection across national registries, enabling researchers to track the full life-cycle impact of health conditions on women and to build the evidence base needed to drive systemic change .
Kraft also described a multi-stakeholder convening approach, bringing together health ministers, pharmaceutical companies, health systems, and financial institutions to address the siloed nature of the problem . Each actor in the healthcare system tends to point the finger at another - clinicians want better pharmaceuticals, pharmaceutical companies want government incentives, and governments want clinical evidence - meaning that collective accountability is essential . A survey of around a thousand or so physicians across six countries found that around 80% recognised sex differences in their patients but felt they lacked the tools, resources, and clinical guidelines to deliver adequate care . This suggests that the problem is not primarily one of clinician attitudes but of systemic infrastructure.
#
Empowering Women as Data Producers
One of the more original ideas to emerge from the discussion was the reframing of women from passive subjects of data collection to producers, owners, and potential sellers of health data. Kraft-Buchman proposed training women's rights groups to become data collectors, managers, and owners, enabling them to sell that data back to markets that currently lack it - and also to understand the forensics of their own information ecosystem, including in the context of misinformation and disinformation . This would work at multiple levels: improving health data quality, building local capacity, and creating economic opportunities for women's organisations . The broader vision was of women as producers of information and digital solutions, not merely as recipients of technology - a shift from measuring access to measuring women's ability to file patents, create new technologies, and own the means of digital production .
This proposal connected to a broader observation about the Global South as a potential source of innovation rather than merely a recipient. Technologies developed under resource constraints - such as a remote ultrasound device operable via a mobile phone, developed for settings without ready access to physicians - can leapfrog traditional infrastructure and subsequently be applied in the Global North, including in remote rural areas of the United States . Kraft-Buchman extended this, suggesting that African countries with diverse populations could collect nuanced health data and sell it back to the Global North, which lacks data on its own racially diverse populations . This reversal of the usual direction of technology transfer was identified as both a scientific opportunity and a potential commercial one.
An audience member from China asked specifically what individuals can do in daily life to call attention to endometriosis and the failure of the medical system to serve women - particularly in contexts where public demonstrations are difficult. Kraft responded by pointing to the role of celebrities such as Padma Lakshmi and Oprah in raising awareness of women's health conditions, and to social media as a significant driver of progress in this space, noting that women sharing their experiences publicly had helped shift the conversation in ways that formal advocacy had not always achieved.
#
AI Gender Bias in Everyday Interactions
An audience member from China introduced a vivid illustration of how AI gender bias manifests in everyday use, describing posts on Chinese social media advising women to hide their gender when interacting with AI, because AI systems respond more logically to users presenting as male and more emotionally to users presenting as female . This prompted a direct and culturally specific response from Chan, who addressed the questioner as a woman of colour and East Asian descent, acknowledging the particular cultural pressures around assertiveness and non-confrontation that compound the problem . Her practical advice was for women to write explicit standing instructions into their AI prompts, specifying that they expect logical rather than emotional responses, and not to accept gender-biased outputs as inevitable .
Kraft added important context, explaining that these biased responses emerge because AI systems have been trained on internet data that encodes generations of gender stereotypes and social norms . She also highlighted a related form of algorithmic bias: the word "vagina" is effectively the most censored word on the internet, and health conditions such as endometriosis and postpartum are shadow-banned on social media platforms, while equivalent male health terms are not . This means that the problem is not only one of training data but of the algorithmic choices embedded in content moderation systems, which actively suppress women's health information and further reduce its representation in the data used to train large language models.
#
Translating Commitments into Action
A recurring theme was the frustration shared by all speakers at the gap between international commitments and concrete outcomes. Chan described the Hamburg Declaration on responsible AI for the SDGs - a multi-stakeholder document that includes gender as a specific priority area, developed through UNDP's collaboration with the German government - as an example of a commitment that exists on paper but faces the same implementation challenge as countless other international frameworks . She acknowledged that the international community is skilled at producing documents - including WSIS, the Global Digital Compact, and the Hamburg Declaration - but consistently falls short at turning them into measurable, accountable action . An audience member articulated the shared frustration directly, noting that despite five years of sustained conversation about incorporating women's perspectives in tech and pharmaceuticals, progress has not matched the volume of discussion .
Kraft-Buchman proposed that WSIS e-health indicators could be updated to require gender-representative training data, with WHO and ITU as facilitators, creating a cascade of accountability through international standard-setting . Oriana Kraft introduced the concept of a "health data race" - in which countries compete to be the first to collect comprehensive, diverse, and nuanced health data - as a positive competitive incentive, particularly for nations seeking scientific recognition and commercial advantage . The closing message was one of cautious optimism: the scientific opportunity represented by untapped women's health data is enormous, the willingness of women to contribute their data is already demonstrated, and the policy tools - procurement requirements, scientific standards, regulatory mandates - are available . What remains is the political will and institutional coordination to deploy them before further digital infrastructure is built upon an already unequal foundation .
Biological sex differences ignored in research
Arg. 1Oriana Kraft argues that sex differences exist in every single cell of the human body, meaning that every organ functions differently between men and women. Despite this, medical research has historically studied only male cells, male animals, and male bodies, creating a fundamental gap in understanding female health.
She noted that male animals outnumber female animals in research at a ratio of 5.5 to one , and that the exclusion of female rodents was based on a false assumption that female hormonal cycles made them too complicated, when in fact male mice with testosterone fluctuations are less predictable . Women were effectively banned from clinical trials until 1993, meaning virtually all drugs on the market were never tested in women .
on: Medical research has systematically excluded women, producing biased data that harms women's health outcomes
Women's worse health outcomes due to male-centred research
Arg. 2Because medical research has centred on male bodies, women face significantly worse health outcomes across a wide range of conditions. These disparities are not incidental but are directly caused by the systematic exclusion of women from clinical research and the calibration of diagnostic tools and treatments on male physiology.
Women are diagnosed on average four years later than men across 770 diseases , are 50% more likely to die following a heart attack , and are 50-75% more likely to have adverse drug reactions due to their exclusion from clinical trials until 1993 . Women also spend five more years in poor health than men, and this burden falls during their prime working years rather than at the end of life .
on: Medical research has systematically excluded women, producing biased data that harms women's health outcomes
Diagnostic tools calibrated for men miss female conditions
Arg. 3Diagnostic tools and biomarker thresholds have been calibrated based on male physiology, meaning that conditions presenting differently in women are routinely missed. This affects both the biochemical markers used and the imaging technologies deployed in clinical settings.
Troponin levels, a biomarker for cardiovascular disease, have a cutoff rate based on the male body that is too high for women, causing many cases of female cardiovascular disease to be dismissed . Imaging technology is also designed around the vessels more commonly affected in men, missing the different vessels more likely to cause heart attacks in women . As a result, troponin thresholds calibrated on men miss 42% of female heart attacks .
Misdiagnosis cascade from lack of female-focused clinical guidelines
Arg. 4Because clinical guidelines are built on male-centred research, women are systematically misdiagnosed, generating a cascade of inaccurate medical records that then feed into AI training data. This creates a compounding problem where historical inaccuracies are never corrected and are instead perpetuated by algorithmic systems.
Endometriosis takes an average of seven years to diagnose, and women with the condition must see on average five physicians before receiving an accurate diagnosis, meaning every prior physician has recorded an inaccurate diagnosis . With a ratio of four times as much misdiagnosis as accurate diagnosis for endometriosis, and no systematic process to update records, large language models are trained on this inaccurate data .
Biased training data reduces AI diagnostic accuracy
Arg. 5AI models trained on historically biased medical data produce less accurate diagnostic outputs, and this problem cannot be resolved simply by making the AI explain its reasoning. The only genuine solution is to ensure that the underlying training data is accurate and representative from the outset.
AI trained on misrepresentative data reduces diagnostic accuracy by 11.3%, and even explainable AI - where the model explains its reasoning - still results in the same reduction in accuracy . This demonstrates that the problem lies in the data itself, not in the model's transparency mechanisms.
on: AI systems trained on biased medical and social data perpetuate and amplify existing inequalities against women
on: Whether explainable AI can compensate for biased training data
Female life stages absent from health data collection
Arg. 6Despite the profound impact of female life stages on every organ in the body, these stages are not captured in electronic health records or HR systems. This absence means that critical health signals related to menstruation, pregnancy, postpartum, and menopause are systematically excluded from the data used to train AI models and inform clinical care.
There is no standard form or button in HR systems to capture that a woman is going through menopause, and nothing to capture the menstrual cycle or postpartum experience . Pregnancy complications such as preeclampsia and gestational diabetes increase lifetime cardiovascular disease risk by two to four times, yet this information is not systematically captured and linked to long-term monitoring .
on: Current data collection is insufficiently nuanced and fails to capture female-specific health signals and life stages
Menstrual cycle signals not captured by current medical instruments
Arg. 7A woman's immune profile changes throughout the menstrual cycle, affecting vaccination response rates, adverse drug reactions, and chemotherapy outcomes. However, current medical instruments are not designed to capture these signals, meaning potentially transformative health information is being lost.
Oriana Kraft explained that vaccination response rates and adverse drug reactions vary depending on where a woman is in her menstrual cycle, and that chemotherapy responses also differ accordingly . She noted that there are many signals in the female body that instruments have not been designed to collect, and that nobody is currently incentivised to capture this information .
on: Current data collection is insufficiently nuanced and fails to capture female-specific health signals and life stages
Pregnancy complications not linked to long-term cardiovascular risk monitoring
Arg. 8Conditions experienced during pregnancy, such as preeclampsia and gestational diabetes, significantly elevate a woman's lifetime risk of cardiovascular disease, yet this information is not systematically recorded and linked to ongoing health monitoring. Capturing and acting on this data could enable early detection and potentially save lives.
Preeclampsia and gestational diabetes cause a two to four times increased lifetime risk of cardiovascular disease , yet there is no systematic capture of this information to enable long-term monitoring and early detection .
on: Current data collection is insufficiently nuanced and fails to capture female-specific health signals and life stages
Synthetic data training erases women's health signals
Arg. 9When AI models are trained on synthetic data, signals from the tail ends of distributions — where women are underrepresented — are progressively lost with each new model iteration. This means that even the limited health signals relating to women that do exist in real data are being erased rather than preserved.
Oriana Kraft explained that each time a new model is trained on synthetic data, it loses signals from the tail ends of the distribution, and since women are rare in data representation even if not in reality, their health signals are erased with each iteration . This compounds the existing problem of women's health signals not being captured in the first place .
Siloed healthcare system prevents collective accountability
Arg. 10The healthcare system is organised around separate organ specialities and institutional silos, with clinicians, pharmaceutical companies, and governments each pointing the finger at one another rather than taking collective responsibility for addressing women's health gaps. This fragmentation prevents the systemic change needed to improve women's healthcare.
Oriana Kraft described an event with health ministers where the core problem identified was that clinicians say they need better pharmaceuticals, pharmaceutical companies say governments must incentivise clinical trials, and governments do not act without public pressure . A survey of approximately 1,000 to 1,200 physicians across six countries found that around 80% see sex differences in their patients but do not feel they have the tools or clinical guidelines to deliver adequate care .
on: Systemic, multi-stakeholder solutions are required, as no single actor can resolve the problem alone
on: The role of quotas and mandates in addressing gender bias in tech and healthcare
Lack of government incentives stalls pharmaceutical innovation for women
Arg. 11Pharmaceutical companies argue that without government incentives, they have no commercial reason to run clinical trials specifically for conditions affecting women disproportionately. This creates a structural deadlock in which innovation for women's health remains commercially deprioritised.
Oriana Kraft noted that the pharmaceutical industry points to the need for government incentives to run clinical trials or innovate for diseases that disproportionately impact women . She highlighted that some Nordic countries have mandated sex-disaggregated data collection across national registries as an example of how government action can drive systemic change .
on: Systemic, multi-stakeholder solutions are required, as no single actor can resolve the problem alone
Mandatory sex-disaggregated data collection as a regulatory model
Arg. 12Nordic countries that have mandated sex-disaggregated data collection across national registries demonstrate that government regulation can drive systemic change in how health data is gathered and used. This approach enables researchers to see the full life-cycle impact of health conditions on women, including effects on lifetime earning potential and health system costs.
Oriana Kraft pointed to Nordic countries, particularly Denmark, as having done large-scale research with linked patient records and mandated sex-disaggregated data collection across national registries . She argued that this kind of data enables understanding of how health conditions impact a woman's lifetime earning potential and what it costs health systems not to innovate for women .
Rich patient-generated and female physician data being wasted
Arg. 13Female physicians produce significantly more detailed clinical notes than their male counterparts, and patients themselves bring rich health data via wearables and cycle logs. However, this information is largely dismissed rather than systematically captured, representing a major missed opportunity at a time when AI companies claim to be running out of fresh human data.
Research found that female physician notes were twice as detailed as male physician notes, suggesting that incentivising detailed data capture could improve the quality of training data . Women are already bringing data from devices such as Oura rings and cycle logs to physician appointments, and femtech startups have found that women are willing to donate their data to advance women's healthcare, yet this rich source of information is being dismissed . This is particularly ironic given that major AI companies report having run out of fresh human data and are resorting to synthetic data .
Marginalised groups erased by machine learning averages
Arg. 1Machine learning systems operate on averages and recursive learning, which means that populations further from the privileged centre of data representation are progressively erased from model outputs. This is a systemic problem that affects women globally, with compounding effects for those with multiple intersecting marginalised identities.
Caitlin Kraft-Buchman explained that the further a person is from the privileged centre - whether due to being more rural, more poor, or more disabled - the less they are represented in the data . She described how recursive learning causes the effective range of representation to shrink over time, eventually reducing even the privileged centre's prominence . She characterised this as a problem writ large for women worldwide, compounded and especially urgent for women with more intersecting identities .
on: AI systems trained on biased medical and social data perpetuate and amplify existing inequalities against women
De-biasing existing data is insufficient; new data needed
Arg. 2Caitlin Kraft-Buchman argues that de-biasing existing datasets is not a genuine solution to the problem of gender bias in AI, as it can only mitigate harm rather than resolve the underlying issue. The real solution lies in building new, representative datasets and sector-specific models from scratch.
She stated that there is broad agreement that de-biasing data is not truly possible - it can make things less bad but does not solve the problem . She pointed to the trend towards sovereign AI and smaller, sector-specific language models as a more viable path, suggesting that a health model built from scratch on representative data could work .
on: International commitments and declarations on gender and AI are insufficient without concrete, accountable action
on: Whether de-biasing existing data is a viable solution
Representativeness as a scientific standard
Arg. 3Caitlin Kraft-Buchman proposes that representativeness should be established as a scientific standard, ensuring that the populations relevant to a specific use case are genuinely and sincerely represented in the data used to build AI systems. This draws on the principle of substantive equality enshrined in CEDAW, which requires that solutions be adapted to the actual needs of different populations rather than applying a one-size-fits-all approach.
She described the concept of representativeness as a scientific standard, whereby in a general population use case half the data would reflect women, while in more specific contexts - such as a sign language application - the relevant demographic community would be fully represented . She drew an analogy to CEDAW's principle of substantive equality, comparing it to ensuring everyone gets a bicycle that fits them rather than a single standard size .
Sector-specific AI models built on representative data as a solution
Arg. 4Rather than attempting to fix large language models that are already trained on biased data, Caitlin Kraft-Buchman argues that smaller, sector-specific language models built from scratch on representative data offer a more viable and effective path forward. The growing trend towards sovereign AI for geopolitical reasons may accelerate this approach.
She noted that as countries turn to sovereign AI for geopolitical reasons, smaller language models for sector-specific purposes are increasingly seen as viable, and that a health model built from scratch on representative data could function effectively . She suggested this as a direction that avoids the intractable problem of fixing large language models with deeply embedded biases .
Women as data collectors and owners
Arg. 5Caitlin Kraft-Buchman proposes training women's rights groups to become data collectors, owners, organisers, and sellers, shifting women from passive subjects of development to producers of information and digital solutions. This approach would work across multiple domains, including health data collection and combating misinformation.
She described an idea to train women in any context - particularly women's rights groups - to go out and collect data, becoming data collectors, owners, organisers, and sellers who can also manage and sell that data back . She connected this to a broader vision of moving from protecting women to empowering women as producers of information, solutions, and digital technologies, including filing patents and owning the means of digital production .
Social norms bias already embedded in AI training data
Arg. 1Yu Ping Chan argues that the data on which AI models are trained already encodes deep-seated unconscious biases against women, reflecting social norms that have shown no meaningful progress over a decade. This means that even before any algorithmic processing, the substrate of AI training data is fundamentally skewed.
UNDP's Gender Social Norms Index, which surveyed 80 countries representing 85% of the global population in 2023, found that close to 9 in 10 people - 90% of men and 87% of women - hold at least one bias against women . She noted that there has been a decade of stagnation in progress on these norms, meaning the biases embedded in training data are not improving over time .
on: AI systems trained on biased medical and social data perpetuate and amplify existing inequalities against women
on: Whether explainable AI can compensate for biased training data
Digital gender gap compounds AI bias in infrastructure
Arg. 2A significant global digital gender gap in connectivity and internet use means that women are already underrepresented in the data that feeds digital systems. As digital public infrastructure is built on these biased foundations, inequalities are hardwired into the systems themselves, and the problem worsens as digitalisation accelerates without addressing these gaps.
Yu Ping Chan cited global surveys showing a 10-15% gap between women and men in connectivity and internet use globally, rising to 30-40% in developing countries . She argued that continuing to build digital public infrastructure without addressing these gaps means hardwiring biased assumptions into the foundations of digital systems, making the problem progressively worse .
on: Current data collection is insufficiently nuanced and fails to capture female-specific health signals and life stages
Gap between international commitments and concrete action
Arg. 3Despite numerous international documents and declarations committing to responsible AI and gender equality in digital systems, translating these commitments into concrete, accountable action remains the central unresolved challenge. Yu Ping Chan acknowledges that the international community is skilled at producing documents but consistently falls short at implementation.
She referenced the Hamburg Declaration on responsible use of AI for the SDGs, which includes gender as a specific area of action and priority for private sector companies, international development organisations, and national governments . She noted that the same challenge of translating paper commitments into action applies across the entire UN system, including WSIS and the Global Digital Compact, and that even the private sector community shares this frustration .
on: Systemic, multi-stakeholder solutions are required, as no single actor can resolve the problem alone
on: The role of quotas and mandates in addressing gender bias in tech and healthcare
Procurement as a tool to enforce gender data requirements
Arg. 4Yu Ping Chan argues that procurement requirements offer a practical and direct mechanism for enforcing gender disaggregated data and algorithmic transparency, as it is easier to build requirements into contracts before signing than to audit for compliance after the fact. This approach could hardwire gender-sensitive practices into the systems that governments and international organisations commission.
She suggested that building gender disaggregated and stratified data requirements into government contracts before signing - rather than auditing after - could be a way to hardwire fixes around gender into digital public infrastructure . She pointed to Nordic governments as examples of jurisdictions that have required sex-disaggregated data disclosure, and asked whether this could be extended to government procurement contracts more broadly .
on: Systemic, multi-stakeholder solutions are required, as no single actor can resolve the problem alone
Insufficient data on women of colour and Global South women
Arg. 1The data used in medical research and AI systems is not sufficiently nuanced to account for the specific health profiles of women of colour or women from the Global South. Ethnic-specific risk factors are not incorporated into screening protocols, and the model of a young, healthy white man has been extrapolated to the entire global population.
Speaker 1 noted that the US has shamefully high maternal mortality rates, particularly for African-American women, and that the data is not nuanced enough to address this . She gave the example that women of Southeast Asian descent are more likely to have a certain form of anaemia, which should be a risk factor in screening but is not . She described how a sample of sometimes 20 to 30 people has historically been extrapolated to a population of 7 billion, rather than collecting signals from as many diverse people as possible .
on: Current data collection is insufficiently nuanced and fails to capture female-specific health signals and life stages
Algorithmic censorship of women's health terminology online
Arg. 2Social media platforms algorithmically suppress women's health terminology, including the word 'vagina' and conditions such as endometriosis and postpartum, while equivalent male terms are not subject to the same restrictions. This algorithmic bias against women's health content limits public awareness and perpetuates the marginalisation of women's health issues.
Speaker 1 stated that 'vagina' is the most censored word on the internet and is effectively shadow-banned on social media, as are health conditions such as endometriosis and postpartum . She contrasted this with the fact that equivalent male terms such as 'semen' are not subject to the same restrictions , arguing that this reflects the fact that the majority of people shaping algorithms are making assumptions about women .
on: Whether flooding the internet with positive representations of women is an effective advocacy strategy
Public lacks awareness of AI assumptions made about them
Arg. 3There is a widespread lack of public literacy about the assumptions that AI models make about users, and citizens are not informed about the basis on which algorithmic decisions affecting them are made. Speaker 1 argues that in high-risk settings such as health and law, people should have a right to know what assumptions a model is making about them.
Speaker 1 noted that there is very low literacy when it comes to understanding the assumptions a model makes about a person , and that models are currently deployed in high-risk settings such as health and law making assumptions based on factors such as income level without users being aware . She argued that citizens should have the right to know what assumptions a model makes about them, particularly in these high-risk contexts .
Global South innovation can leapfrog and inform the Global North
Arg. 4Technologies developed under resource constraints in the Global South can leapfrog traditional infrastructure and produce innovations that are subsequently applicable in the Global North, reversing the usual direction of technology transfer. This represents a significant opportunity to address women's health gaps in both contexts simultaneously.
Speaker 1 cited the example of a remote ultrasound device operable via a mobile phone, developed for the Global South to enable remote monitoring without requiring a physician, which could then be applicable in the US or other remote rural areas . She noted that the Gates Foundation has observed this leapfrogging dynamic in women's health, where constraints in lower-resource settings are forcing innovation that is then applicable more broadly .
Women's health must become a political priority
Arg. 5Speaker 1 argues that making women's health a political issue — requiring politicians to address it on their platforms and supporting advocacy groups — is essential to creating the regulatory and financial incentives needed for systemic change. Without political will, the structural deadlocks in healthcare and pharmaceutical innovation cannot be broken.
She pointed to rising health insurance costs in Switzerland and the US as examples of women's health becoming a cost-of-living crisis that politicians must address . She noted the emergence in the US of a political action committee specifically lobbying for women's health, arguing that women's health deserves the same organised political advocacy as other special interest groups . She argued that because governments are the core buyers for the pharmaceutical industry, political incentives and regulation are the most powerful lever for change .
on: Systemic, multi-stakeholder solutions are required, as no single actor can resolve the problem alone
Celebrity and social media storytelling as advocacy tools
Arg. 6Advocacy through celebrity storytelling and social media has already driven some progress on conditions such as endometriosis and menopause by demonstrating that these issues affect women regardless of wealth or status. Amplifying diverse personal stories remains a key tool for building public awareness and political pressure, particularly in contexts where public marches are not feasible.
Speaker 1 cited celebrities such as Padma Lakshmi and Oprah speaking publicly about endometriosis and menopause respectively, noting that their visibility helped demonstrate that these conditions affect women regardless of affluence or fame . She argued that social media has been instrumental in shifting the perception of women's health conditions from individual problems to collective ones, and that encouraging people to share their stories is a key first pillar of advocacy .
on: Whether flooding the internet with positive representations of women is an effective advocacy strategy
AI models replicate gender stereotypes in their responses
Arg. 1AI chatbots respond more logically to users presenting as male and more emotionally to users presenting as female, reflecting gender stereotypes scraped from internet content. This has led to advice circulating online — including in China — encouraging women to hide their gender when interacting with AI in order to receive more rational responses.
Audience Member 1 described a post circulating on China's internet advising girls to hide their gender when talking to AI, because AI responds more logically to users presenting as male and more emotionally to users presenting as female . She asked how this bias could be changed or addressed .
on: AI systems trained on biased medical and social data perpetuate and amplify existing inequalities against women
African women's distinct health experiences overlooked by research
Arg. 1Audience Member 2 shared observations from Tanzania suggesting that older generations of African women did not experience severe menopausal symptoms, raising the possibility that research grounded in diverse female populations could yield transformative insights. She argued that basing research on the actual populations being studied — including African women — is essential.
She noted that her grandmother, mother, and older women in her community never experienced severe menopausal symptoms, and suggested that research based on women of African origin might reveal why, potentially benefiting future generations . She also observed generational changes in eyesight health in her family, suggesting that population-specific research could illuminate these trends .
on: Medical research has systematically excluded women, producing biased data that harms women's health outcomes
Women must actively resist and correct AI gender bias in their interactions
Arg. 1Yipeng argues that women — particularly East Asian women, who face additional cultural stereotypes of submissiveness — should not accept gender-biased AI outputs as inevitable but should actively instruct AI models to respond in non-stereotypical ways. She encourages women to build standing instructions into their AI models specifying how they expect to be treated.
She specifically addressed the questioner as a woman of colour of Asian descent, noting that East Asian women are particularly stereotyped as submissive and non-confrontational in AI outputs . She recommended writing explicit instructions into AI prompts - such as stating that a response is 'overly emotional' and requesting a more logical one - and making this a standing instruction in one's AI model . She urged young East Asian women in the room not to accept this as the standard they should live with .
WSIS e-health indicators should mandate gender-representative data
Arg. 1Speaker 2 proposes using the WSIS e-health indicators as a concrete mechanism to require gender-representative training data, with WHO and ITU as the facilitating bodies. Embedding this requirement in international standard-setting could create a cascade of accountability that drives change across member states and organisations.
Speaker 2 suggested that the WSIS e-health indicator could be used to encourage facilitators - WHO and ITU - to require training on gender-representative data, and that establishing a series of indicators in this space could start to change things in a cascade way . She also raised the possibility of a country choosing to lead by being the first to implement such standards, framing it as a scientific and reputational opportunity .
Advocacy for women in tech and health has not advanced at sufficient pace despite years of conversation
Arg. 1Audience Member 3 expresses frustration that despite five years of sustained discussion about incorporating women's perspectives in tech and the pharmaceutical sector, progress has not matched the volume of conversation and organisational effort. She questions where the gaps in advocacy lie and what concrete actions could accelerate change for future generations.
She noted that for the last five years there has been a lot of conversation around incorporating women in tech and women's health perspectives in the pharmaceutical sector, yet it does not feel like it is advancing at the pace it should given how many conversations and organisations have been involved . She asked specifically about where the gaps are in advocacy heading into 2026 and what can be done to move faster so that the next generation does not experience the same problems .
on: International commitments and declarations on gender and AI are insufficient without concrete, accountable action
Cultural and political constraints in China limit conventional advocacy approaches for women's health conditions such as endometriosis
Arg. 1Audience Member 4 highlights that while awareness campaigns such as marches exist in some countries to draw attention to conditions like endometriosis, these approaches are not feasible in China due to cultural and political constraints. She asks what individuals can do in their daily lives to call attention to the systemic failure of medical systems to serve women.
She noted that there is an end-of-March awareness event to promote attention to endometriosis, but that in China holding a march or parade to draw attention to the disease tends not to work in the same way . She asked what individuals could do in their daily lives to call attention not just to endometriosis but to the broader failure of the medical system to serve women, and how to promote change .
Session Knowledge Graph
Speakers · Topics · Arguments · Relationships
All speakers broadly agreed that medical research has been built on male bodies and male data, creating a cascade of harm for women. Oriana Kraft detailed how male animals outnumber female animals in research at 5.5 to one and that women were effectively banned from clinical trials until 1993 . Speaker 1 noted that even in the US, maternal mortality data is not nuanced enough, particularly for African-American women , and that a sample of sometimes 20 to 30 people has been extrapolated to a population of 7 billion . Audience Member 2 from Tanzania observed that her grandmother and mother never experienced severe menopausal symptoms, suggesting that research grounded in African women's experiences could yield transformative insights , reinforcing the consensus that the exclusion of diverse female populations from research has caused widespread harm.
Biological sex differences ignored in research
Women's worse health outcomes due to male-centred research
Insufficient data on women of colour and Global South women
African women's distinct health experiences overlooked by research
There was strong consensus that AI systems do not merely reflect existing biases but actively amplify them. Oriana Kraft demonstrated that AI trained on misrepresentative data reduces diagnostic accuracy by 11.3%, and that even explainable AI does not resolve this . Caitlin Kraft-Buchman explained that recursive machine learning causes populations further from the privileged centre to be progressively erased . Yu Ping Chan cited UNDP's Gender Social Norms Index showing that close to 9 in 10 people hold at least one bias against women , meaning the substrate of AI training data is already fundamentally skewed. Audience Member 1 described how AI responds more logically to users presenting as male and more emotionally to those presenting as female , illustrating how these biases manifest in everyday AI interactions.
Biased training data reduces AI diagnostic accuracy
Marginalised groups erased by machine learning averages
Social norms bias already embedded in AI training data
AI models replicate gender stereotypes in their responses
Multiple speakers expressed frustration at the persistent gap between stated commitments and real-world change. Yu Ping Chan acknowledged that the international community is skilled at producing documents such as the Hamburg Declaration and the Global Digital Compact but consistently falls short at implementation . Caitlin Kraft-Buchman noted broad agreement that de-biasing data is not truly possible and can only mitigate harm rather than resolve the underlying issue . Audience Member 3 articulated the shared frustration directly, noting that despite five years of sustained conversation about incorporating women's perspectives in tech and pharmaceuticals, progress has not matched the volume of discussion .
Gap between international commitments and concrete action
De-biasing existing data is insufficient; new data needed
Advocacy for women in tech and health has not advanced at sufficient pace despite years of conversation
Speakers agreed that the absence of female-specific data is not merely a historical legacy but an ongoing failure of current systems. Oriana Kraft noted that there is no standard form in HR systems to capture menopause, menstrual cycle, or postpartum experience , and that pregnancy complications such as preeclampsia increase lifetime cardiovascular disease risk two to four times yet are not systematically captured . Speaker 1 emphasised that the data is not nuanced enough to account for women of colour, citing the example that Southeast Asian descent increases risk of certain anaemia but this is not incorporated into screening . Yu Ping Chan highlighted a 10-15% global gap in connectivity between women and men, rising to 30-40% in developing countries, meaning women are already underrepresented in the data feeding digital systems .
Female life stages absent from health data collection
Menstrual cycle signals not captured by current medical instruments
Pregnancy complications not linked to long-term cardiovascular risk monitoring
Insufficient data on women of colour and Global South women
Digital gender gap compounds AI bias in infrastructure
All speakers converged on the view that the problem is structural and requires coordinated action across government, industry, civil society, and international organisations. Oriana Kraft described how clinicians, pharmaceutical companies, and governments each point the finger at one another . Yu Ping Chan proposed procurement requirements as a practical mechanism, arguing it is easier to build gender data requirements into contracts before signing than to audit after . Caitlin Kraft-Buchman suggested representativeness as a scientific standard and sector-specific AI models built from scratch . Speaker 1 argued that because governments are the core buyers for the pharmaceutical industry, political incentives and regulation are the most powerful lever for change .
Siloed healthcare system prevents collective accountability
Lack of government incentives stalls pharmaceutical innovation for women
Gap between international commitments and concrete action
Procurement as a tool to enforce gender data requirements
Women's health must become a political priority
Both Oriana Kraft and Caitlin Kraft-Buchman shared the view that the problem of biased AI in healthcare cannot be resolved by attempting to fix existing large language models, and that the genuine solution lies in building new, representative datasets and sector-specific models from scratch. Oriana Kraft demonstrated that AI trained on misrepresentative data reduces diagnostic accuracy by 11.3% and that even explainable AI does not resolve this , while Caitlin Kraft-Buchman stated that de-biasing data is not truly possible and can only mitigate harm . Both pointed to smaller, sector-specific models and representative data collection as the path forward , with Oriana Kraft highlighting Nordic countries' mandated sex-disaggregated data collection as a regulatory model . Both Yu Ping Chan and Caitlin Kraft-Buchman shared the view that building digital public infrastructure on biased foundations hardwires inequality into systems, and that proactive structural mechanisms are needed to enforce representativeness. Yu Ping Chan argued that continuing to build digital public infrastructure without addressing gender gaps means hardwiring biased assumptions into digital systems , while Caitlin Kraft-Buchman described how recursive machine learning progressively erases marginalised populations . Both proposed concrete enforcement mechanisms: Yu Ping Chan through procurement requirements and Caitlin Kraft-Buchman through representativeness as a scientific standard . Both Oriana Kraft and Speaker 1 shared the view that rich sources of women's health data and information are being actively suppressed or dismissed rather than utilised. Oriana Kraft noted that women bring data from wearables and cycle logs to physician appointments but this information is largely dismissed, and that femtech startups find women willing to donate their data, yet major AI companies claim to have run out of fresh human data . Speaker 1 highlighted that 'vagina' is the most censored word on the internet and that health conditions such as endometriosis and postpartum are shadow-banned on social media while equivalent male terms are not , demonstrating that algorithmic choices are actively suppressing women's health information. Both Caitlin Kraft-Buchman and Yu Ping Chan shared a vision of shifting women from passive subjects of development to agents in the digital ecosystem, while acknowledging the persistent gap between commitments and action. Caitlin Kraft-Buchman proposed training women's rights groups to become data collectors, owners, organisers, and sellers , connecting this to a broader vision of women as producers of information and digital technologies . Yu Ping Chan acknowledged the same frustration about the gap between paper commitments and concrete outcomes, noting that the international community consistently falls short at implementation , and proposed procurement as a direct mechanism to enforce change . Both Speaker 1 and Audience Member 4 engaged with the question of how to advocate for women's health in contexts where conventional public demonstrations are not feasible, converging on social media and personal storytelling as key tools. Audience Member 4 noted that in China, holding a march or parade to draw attention to endometriosis tends not to work and asked what individuals could do in their daily lives. Speaker 1 responded that social media has been instrumental in shifting the perception of women's health conditions from individual to collective problems, and that encouraging people to share their stories is a key first pillar of advocacy , citing celebrities such as Padma Lakshmi and Oprah as examples of how personal storytelling drives awareness . Both Yipeng and Speaker 1 agreed that women should not passively accept gender-biased AI outputs and that greater awareness of AI assumptions is essential. Speaker 1 argued that there is very low literacy about the assumptions AI models make about users, and that in high-risk settings such as health and law, citizens should have the right to know what assumptions a model makes about them . Yipeng built on this by providing practical guidance, recommending that women — particularly East Asian women — write explicit instructions into their AI prompts to correct stereotypical responses and make this a standing instruction , urging young Asian women not to accept biased AI behaviour as a standard .
While the discussion began by framing the Global South as a context of greater disadvantage and data poverty, an unexpected consensus emerged around the idea that constraints in lower-resource settings can drive innovation that is subsequently applicable in the Global North, reversing the usual direction of technology transfer. Speaker 1 cited the example of a remote ultrasound device operable via a mobile phone, developed for the Global South, which could then be applicable in the US or other remote rural areas , noting that the Gates Foundation has observed this leapfrogging dynamic . Caitlin Kraft-Buchman extended this, suggesting that African colleagues who got their data right could sell it back to the North, which lacks data on its own racially diverse populations . Yu Ping Chan added that small, tech-enabled states could collect nuanced data and export the model . This consensus was unexpected given the session's initial framing of the Global South primarily as a context of disadvantage.
An unexpected point of consensus emerged around the irony that women are actively willing to donate their health data to advance women's healthcare, yet this rich source of information is being dismissed at precisely the moment when major AI companies report having run out of fresh human data. Oriana Kraft noted that femtech startups find women willing to donate their data just to have better care and contribute to advancing women's healthcare, yet this is being dismissed as a data source . She highlighted the particular irony that major AI companies and model labs are saying they have run out of fresh human data and are resorting to synthetic data , which itself erases women's health signals with each new model iteration . Caitlin Kraft-Buchman reinforced this by proposing to train women's rights groups as data collectors and owners , suggesting that the solution to both the data scarcity problem and the gender data gap may lie in the same place.
An unexpected consensus emerged around the revelation that the exclusion of female animals from medical research - which has had profound downstream consequences for women's health - was not merely a value judgement but was based on a demonstrably false scientific assumption. Oriana Kraft explained that female rodents were excluded on the assumption that their hormonal cycles made them too complicated, but that it actually turns out male mice with testosterone fluctuations are less predictable than female mice, whose cycles are at least predictable . Speaker 1 reinforced this by noting that the entire model of a young, healthy white man has been extrapolated to everybody, and that this one-size-fits-all approach simply does not work . The consensus that the foundational exclusion was scientifically unjustified - not merely ethically problematic - was a notable and somewhat unexpected point of agreement that strengthens the case for reform.
Despite the session's initial focus on awareness-raising and advocacy, an unexpected consensus emerged around procurement and regulatory standards as more practical and direct enforcement mechanisms than voluntary commitments or post-hoc auditing. Yu Ping Chan argued that it is easier to require certain things before signing a contract than to audit for compliance after, and proposed building gender disaggregated data requirements into government procurement contracts . Caitlin Kraft-Buchman proposed representativeness as a scientific standard that could be embedded in use-case-specific requirements , drawing on CEDAW's principle of substantive equality . Oriana Kraft pointed to Nordic countries' mandated sex-disaggregated data collection across national registries as a proven model . The convergence on procurement and standards - rather than purely on advocacy or awareness - as the most actionable path forward was somewhat unexpected given the panel's composition.
The discussion revealed a remarkably high level of consensus across speakers from diverse backgrounds - including international development organisations, health technology entrepreneurs, academics, and audience members from China, Tanzania, and elsewhere. All speakers agreed that: (1) medical research has systematically excluded women, producing biased data with serious health consequences ; (2) AI systems trained on this biased data perpetuate and amplify existing inequalities ; (3) current data collection fails to capture female-specific health signals and life stages ; (4) international commitments have not translated into concrete action ; and (5) systemic, multi-stakeholder solutions are required . Speakers also converged on several proposed solutions, including mandatory sex-disaggregated data collection , procurement requirements , representativeness as a scientific standard , sector-specific AI models built from scratch , and empowering women as data collectors and owners . Unexpected consensus emerged around the potential for Global South innovation to inform the Global North , the irony of women's willingness to donate data being ignored while AI companies claim data scarcity , and the practical superiority of procurement and regulatory standards over voluntary commitments .
Caitlin Kraft-Buchman explicitly stated that de-biasing existing datasets is not a genuine solution, arguing that it can only mitigate harm rather than resolve the underlying issue , and that the real path forward lies in building new, representative datasets and sector-specific models from scratch . Oriana Kraft, while agreeing that accurate data is essential , focused more on the cascade of distortion in existing data and the need to capture new types of data , without explicitly dismissing de-biasing as an approach. Her framing implied that improving and expanding data collection - rather than abandoning existing datasets - was the primary solution, creating a subtle tension with Caitlin's more categorical rejection of de-biasing.
De-biasing existing data is insufficient; new data needed
Biased training data reduces AI diagnostic accuracy
Oriana Kraft directly addressed and dismissed the idea that explainable AI could resolve the problem of biased training data, citing evidence that even when models explain their reasoning, diagnostic accuracy is still reduced by 11.3% . Yu Ping Chan, while acknowledging the bias problem, did not engage with this specific claim and instead focused on procurement and accountability mechanisms as solutions, implicitly suggesting that governance and transparency tools - which are adjacent to explainability - could be part of the fix. This represents a divergence in how much weight each speaker placed on technical versus governance solutions.
Biased training data reduces AI diagnostic accuracy
Social norms bias already embedded in AI training data
Yu Ping Chan acknowledged that the tech sector has shunned quotas and firm regulations, and expressed genuine uncertainty about what the fix is, while tentatively suggesting that guidelines, expectations, and procurement requirements might be a start . Oriana Kraft, building on this, noted that the tech sector is not a big fan of quotas and mandates , but pointed to multi-stakeholder convening and government incentives - particularly the Nordic model of mandated sex-disaggregated data collection - as a more effective lever . While both were cautious about mandates, Oriana leaned more towards regulatory models as demonstrated solutions, whereas Yu Ping Chan remained more uncertain and open-ended about the path forward .
Gap between international commitments and concrete action
Siloed healthcare system prevents collective accountability
Speaker 1 initially described the idea of flooding the internet with positive representations of women as something that 'may or may not be the most effective' but at least gives a sense of agency . However, she then contradicted this by arguing that flooding the internet with positive representations is 'unfortunately not a solution' because the problem is not only one of data but also of the algorithm, and the majority of people shaping algorithms are making assumptions about women . This internal tension within Speaker 1's own contributions reflects a genuine unresolved disagreement about the efficacy of grassroots content strategies versus structural algorithmic reform.
Celebrity and social media storytelling as advocacy tools
Algorithmic censorship of women's health terminology online
An unexpected tension emerged between Yipeng's pragmatic advice to individual women - particularly East Asian women - to write explicit instructions into their AI prompts to counteract gender bias , and the broader structural critique advanced by Speaker 1 and Caitlin Kraft-Buchman. Speaker 1 had argued that flooding the internet with positive representations is 'unfortunately not a solution' because the problem lies in the algorithm and the people shaping it , and Caitlin had argued that de-biasing is not truly possible . Yipeng's recommendation, while well-intentioned and culturally sensitive , implicitly places the burden of correction on individual women rather than on the systems and institutions that created the bias - a position that sits in tension with the structural critique that dominated the rest of the discussion. This disagreement was unexpected because all speakers appeared to share a feminist, systemic perspective, yet diverged sharply on whether individual adaptation is an acceptable interim response.
An unexpected divergence emerged in how the Global South was framed in relation to women's health data. Yu Ping Chan, representing UNDP, consistently framed the Global South as a context of greater disadvantage and underrepresentation, noting that the digital gender gap grows to 30-40% in developing countries and asking how data accounts for women of colour from different countries . Speaker 1, by contrast, introduced the unexpected argument that the Global South could actually leapfrog the Global North in women's health innovation, citing the Gates Foundation's observations about mobile ultrasound technology developed for resource-constrained settings that could then be applied in the US . Caitlin Kraft-Buchman extended this further, suggesting that African countries with diverse populations could sell health data back to the Global North . This reframing of the Global South as a potential innovator and data exporter rather than a recipient of solutions was not anticipated given the overall framing of the discussion around underrepresentation and disadvantage.
An unexpected three-way divergence emerged on the primary lever for change. Speaker 1 argued that women's health must become a political issue requiring politicians to address it on their platforms, and that because governments are the core buyers for the pharmaceutical industry, political incentives and regulation are the most powerful lever . Caitlin Kraft-Buchman, by contrast, focused on establishing representativeness as a scientific standard , framing the solution in terms of scientific norms rather than political campaigns. Yu Ping Chan took a third position, focusing on procurement mechanisms as the most direct and practical tool . While none of these positions are mutually exclusive, the speakers did not explicitly reconcile them, and the divergence was unexpected given the apparent consensus on the urgency of the problem. The implicit disagreement about which institutional arena - politics, science, or procurement - should lead the change has significant implications for strategy.
The discussion exhibited strong consensus on the diagnosis - that gender bias is deeply embedded in medical research, clinical data, AI training datasets, and digital infrastructure, with serious consequences for women's health outcomes globally . The main areas of disagreement centred on solutions: whether de-biasing existing data is viable versus building new datasets from scratch ; whether individual behavioural adaptation or structural reform is the appropriate response to AI gender bias; whether political advocacy , scientific standards , or procurement mechanisms should be the primary driver of change; and whether the Global South is primarily a disadvantaged recipient or a potential innovator and data leader . A further tension existed around the role of quotas and mandates, with both Yu Ping Chan and Oriana Kraft expressing caution about regulatory approaches while simultaneously pointing to Nordic regulatory models as the most effective examples .
All three main speakers agreed that gender-representative data is essential and that some form of enforceable standard or requirement is needed. Caitlin Kraft-Buchman proposed representativeness as a scientific standard , Yu Ping Chan suggested procurement requirements as a practical enforcement mechanism , and Oriana Kraft pointed to Nordic countries' mandated sex-disaggregated data collection as a proven model . However, they diverged on the mechanism: Caitlin focused on scientific standards and CEDAW-based substantive equality , Yu Ping Chan on procurement contracts , and Oriana on government incentives and multi-stakeholder convening . They shared the goal but proposed different institutional levers to achieve it.
Representativeness as a scientific standard Procurement as a tool to enforce gender data requirements Mandatory sex-disaggregated data collection as a regulatory model
Both Caitlin Kraft-Buchman and Yu Ping Chan agreed that the gap between international commitments and concrete action is the central challenge , and that translating documents like the Hamburg Declaration into meaningful outcomes is deeply difficult. Caitlin pointed to smaller, sector-specific language models as a technical path forward , while Yu Ping Chan focused on procurement and accountability mechanisms . Both agreed that the problem is urgent and that existing approaches are insufficient, but differed on whether the primary fix is technical (new model architectures) or governance-based (procurement and standards).
Sector-specific AI models built on representative data as a solution Gap between international commitments and concrete action
Both Oriana Kraft and Speaker 1 agreed that the data problem is not just about sex but requires continuous stratification by ethnicity, life stage, and geography . Oriana Kraft described the need to stratify beyond sex to account for menopause, ethnicity, and life stage , while Speaker 1 emphasised that women of colour and women from the Global South are particularly underserved . Both agreed that a one-size-fits-all model extrapolated from a young healthy white man is inadequate , but Speaker 1 placed greater emphasis on the Global South dimension , whereas Oriana focused more on the biological and clinical data capture mechanisms .
Misdiagnosis cascade from lack of female-focused clinical guidelines Insufficient data on women of colour and Global South women
Both speakers agreed that women must move from being passive subjects of data collection to participants in digital systems. Yu Ping Chan highlighted the digital gender gap as a structural barrier , while Caitlin Kraft-Buchman proposed the concrete idea of training women's rights groups to become data collectors, owners, and sellers . Both agreed on the destination — women as producers of digital information — but differed in emphasis: Yu Ping Chan focused on the structural problem of underrepresentation , while Caitlin focused on an actionable programme to empower women as data producers .
Women as data collectors and owners Digital gender gap compounds AI bias in infrastructure
Both Speaker 1 and Yipeng agreed that women should not passively accept gender-biased AI outputs. Speaker 1 argued for citizens' right to know what assumptions a model makes about them, particularly in high-risk settings , while Yipeng took a more immediate and practical stance, urging women — especially East Asian women — to actively instruct their AI models to respond differently . Both agreed that acceptance of bias is not the answer , but Speaker 1 framed the solution in terms of rights and systemic transparency , whereas Yipeng focused on individual behavioural change within existing systems .
Public lacks awareness of AI assumptions made about them Women must actively resist and correct AI gender bias in their interactions
- Sex differences exist in every cell of the human body, yet medical research has historically been conducted almost exclusively on male cells, animals, and bodies, producing systemic healthcare failures for women across diagnosis, treatment, and outcomes.
- Women are diagnosed on average four years later than men across 770 diseases, are 50% more likely to die following a heart attack, and are 50–75% more likely to experience adverse drug reactions, largely because they were effectively excluded from clinical trials until 1993.
- Diagnostic tools such as troponin thresholds and cardiovascular imaging technology are calibrated on male physiology, causing 42% of female heart attacks to be missed and contributing to conditions such as endometriosis taking an average of seven years to diagnose.
- AI models trained on historically biased medical data reduce diagnostic accuracy by 11.3%, and explainable AI does not resolve this problem — accurate, representative data is the prerequisite for accurate algorithms.
- Machine learning operates on averages and recursive self-learning, progressively erasing populations furthest from the privileged centre, including women, rural communities, and disabled people, from model outputs.
- UNDP's Gender Social Norms Index found that close to 90% of both men and women hold at least one bias against women, meaning the substrate on which AI models are built already encodes unconscious bias, with a decade of stagnation in progress.
- A 10–15% global digital gender gap in connectivity and internet use, rising to 30–40% in developing countries, means that building digital public infrastructure on biased foundations hardwires and worsens existing inequalities.
- Female life stage factors — including menstrual cycle, pregnancy, postpartum, and menopause — are not captured in electronic health records or HR systems, despite profoundly affecting every organ in the female body.
- Synthetic data used to train AI models progressively loses signals from the tail ends of distributions, meaning women — already underrepresented — have their health signals further erased with each new model iteration.
- Female physicians produce notes twice as detailed as male physicians, and patients bring rich data via wearables and cycle logs, yet this information is largely dismissed rather than systematically captured.
- The healthcare system is siloed by organ speciality, with clinicians, pharmaceutical companies, and governments each deflecting responsibility rather than taking collective accountability for women's health gaps.
- Despite numerous international documents — including WSIS, the Global Digital Compact, and the Hamburg Declaration — translating commitments on paper into concrete, accountable action remains the central unresolved challenge.
- De-biasing existing data is not truly possible; mitigation can reduce harm but cannot solve the problem, pointing to the need to build new, representative datasets and sector-specific AI models from scratch.
- AI chatbots respond more logically to users presenting as male and more emotionally to users presenting as female, reflecting scraped internet stereotypes, and women are already being advised to hide their gender when using AI.
- The word 'vagina' and health conditions such as endometriosis and postpartum are shadow-banned on social media platforms, while equivalent male terms are not, demonstrating algorithmic bias against women's health content.
- Research on women of colour and women from the Global South is even less nuanced, with ethnic-specific risk factors not incorporated into screening and African-American women facing disproportionately high maternal mortality rates.
- Technologies developed under resource constraints in the Global South — such as mobile-phone-based remote ultrasound — can leapfrog traditional infrastructure and be exported back to the Global North, reversing the usual direction of innovation.
“There are sex differences in every single cell in the human body, which means the way every organ functions between men and women is functionally different. But we've only really studied men... We study male cells. We study male animals like mice. We don't even use female rodents. And we've only really functionally studied men and usually only kind of healthy 70 kilogram white men.”
“AI trained on misrepresentative data reduces diagnostic accuracy by 11.3 percent... physicians will still reduce accuracy by 11.3 percent. So you really need the accurate data to have accurate algorithms. And then... each time you train a new model, it kind of loses the signals from the tail ends of the cycle. So women are not rare in reality, but they're rare in the representation of data. So each time it gets trained, you lose that signal.”
“UNDP did a gender social norms index in 2023 where we surveyed 80 countries, 85% of the global population, and we found that close to 9 in 10 people — 90% of men, 87% of women — hold at least one bias against women, and there's been a decade of stagnation in terms of progress on this. So the data itself is based on a substrate of already inherent assumptions about men and women.”
“I'm not very frankly, very sure how to fix this besides just sort of continuously calling attention to this fact... I know there have been pushbacks against having quotas or very firm types of regulations... and in the tech circle, I know we've shunned away from this type of stuff, but I'm not actually very honestly and being very candid here, sure what is the fix for it.”
“We all have committed to these things but what is the next step to actual actionable outcomes and specific aspects that you hold people accountable to... procurement seems to me, well, not an easy, but at least a direct way of asking companies, builders and tech providers to make sure that this is at least part of what we do.”
“Women are coming to physicians with Oura rings, with cycle logs, with their own handwritten notes, and like, where's all that information going?... Women are willing to donate their data just to have better care... So it's not that people are not willing to participate. They are. It's just that we're dismissing this incredibly rich source of data, which is somewhat ironic when all the big AI companies and model labs are saying they've run out of fresh human data.”
“Technologies being able to leapfrog... if you take this remote ultrasound that you can do with a mobile phone, you don't require a physician... it was actually developed for the global south, but could then be applicable in the US or in other remote rural areas. So in some ways, the constraints that are forcing you to innovate in a lower resource setting are making innovations that could then be applicable also to the north. You could actually innovate for the south and then extrapolate it to the north.”
“I have seen on China's internet a post teaching girls to hide your gender when you are talking to AI, because if you act like a man, the AI will be more logical, but if you are a woman, the AI will be more emotional.”
“I also specifically want to answer this because you're clearly from China, a woman of colour, Asian descent, and we are in our ethnicity particularly seen as less assertive, submissive, tendency not to push back and non-confrontational. And so when you said, do we live with this? I really want to tell you don't... Write it in to say that this response that you wrote is overly emotional. I want a more logical response. Make it a standing instruction in your AI model.”
“My grandmom, my mother, and the old ones, they never experienced menopause symptoms... if the researchers were based on women of African-American origin, maybe they will find out why people do not experience worse menopausal symptoms and maybe it could have helped even our generation.”
How can we effectively de-bias existing medical data, or is building new datasets from scratch the only viable solution?
The current consensus is that de-biasing existing data is not fully possible, only mitigatable. Understanding whether new, purpose-built datasets are the only real fix is critical for directing resources and policy efforts in AI-driven healthcare.
Could 'representativeness' be established as a formal scientific standard for AI training data, and how would such a standard be defined and enforced across different use cases?
Establishing representativeness as a scientific standard could provide a concrete, enforceable benchmark for ensuring AI models reflect the populations they serve, particularly for high-risk applications in health and law.
How can international commitments such as the Hamburg Declaration on responsible AI for the SDGs be translated into concrete, accountable actions rather than remaining as documents?
There is a recognised gap between high-level declarations and real-world impact. Identifying mechanisms to enforce or incentivise follow-through is essential for any international framework to meaningfully address gender bias in AI.
Could government procurement requirements be used to mandate gender-disaggregated and sex-stratified data from AI and technology providers before contracts are signed?
Procurement is identified as a potentially direct lever for requiring gender accountability from tech companies. Exploring its feasibility and scope could offer a practical pathway to embedding gender standards into AI development.
To what extent does existing health data account for women of colour, and particularly women of colour from the Global South, including differences in language and cultural context?
Current datasets are largely built on data from white Western populations. Understanding the depth of this gap for women of colour globally is essential for designing inclusive AI health systems and avoiding compounding existing inequities.
Why do some populations, such as women of African origin, appear to experience certain conditions like menopausal symptoms differently, and what can this tell us about more nuanced, population-specific health research?
Observed differences in symptom presentation across ethnic groups suggest significant untapped scientific knowledge. Researching these variations could lead to better-targeted treatments and challenge the one-size-fits-all model currently dominating medicine.
How can female life stage data — including menstrual cycle, pregnancy, postpartum, and menopause — be systematically captured within electronic health records and clinical systems?
These life stages profoundly affect every organ system in the female body and interact with drug responses, disease risk, and immune function, yet they are almost entirely absent from current data collection infrastructure, representing a major gap in medical AI training data.
How can patient-generated data, such as cycle logs, wearable device data, and personal health notes, be formally integrated into clinical and AI training datasets?
Women are already generating rich, detailed health data through personal tracking tools, but this information is largely ignored by the medical system. Capturing and utilising it could significantly improve AI model accuracy and address data scarcity in women's health.
What financial or regulatory incentives could encourage more nuanced and detailed data capture by clinicians, particularly female physicians whose notes have been found to be significantly more detailed?
Evidence suggests female physicians produce richer clinical notes, yet there are no systemic incentives for detailed data capture. Designing such incentives could improve the quality of training data for health AI models.
Could innovations in health technology developed for low-resource settings in the Global South — such as mobile ultrasound — be scaled and applied in the Global North, reversing the usual direction of technology transfer?
Resource constraints in the Global South are driving innovative, lower-cost health technologies. Exploring whether these can be adopted more broadly could both improve global health equity and offer commercially viable models for underserved populations everywhere.
Could small or data-rich nations act as pioneers in collecting comprehensive, nuanced, and diverse health data that could then be exported or licensed to other countries?
There is a potential economic and scientific opportunity for nations with strong digital infrastructure to lead in diverse health data collection. This could create a 'health data race' that incentivises better data practices globally and generates revenue for participating countries.
How can women's rights organisations and community groups be trained and empowered to become data collectors, owners, and managers, particularly in health and information integrity contexts?
Shifting women from passive subjects of data collection to producers and owners of data could address representativeness gaps, build local capacity, and create new economic opportunities, particularly in underserved communities.
What mechanisms can be put in place to give individuals — particularly in high-risk AI contexts such as health and law — the right to know what assumptions an AI model is making about them?
AI models currently make opaque assumptions based on biased data, including assumptions tied to gender, income, and ethnicity. Establishing transparency rights would empower individuals and create accountability for model developers.
Why are health-related terms associated with female biology — such as 'endometriosis', 'postpartum', and 'vagina' — disproportionately shadow-banned or censored on social media and internet platforms, and what can be done to address this?
The censorship of female health terminology online reduces public awareness, limits patient communities, and contributes to the underrepresentation of women's health topics in the data used to train large language models.
How can AI models be prompted or instructed by users to avoid gender-biased responses, and what longer-term structural changes are needed so that users — particularly Asian women — do not have to work around built-in biases?
The observation that AI responds more 'logically' when a user presents as male reveals deeply embedded gender stereotypes in model training. While prompt-level workarounds offer short-term relief, structural solutions are needed to address the root cause.
What specific advocacy strategies are most effective in 2025–2026 for accelerating progress on women's health representation in AI and pharmaceutical research, given that progress has stalled despite years of conversation?
Despite extensive advocacy over many years, the pace of change remains slow. Identifying which advocacy approaches — political, regulatory, financial, or cultural — are most likely to produce measurable outcomes is critical for directing future efforts.
How can women in countries where public demonstrations are restricted, such as China, effectively advocate for better representation of women's health conditions in medical research and AI systems?
Traditional forms of public advocacy such as marches are not viable in all political contexts. Identifying culturally appropriate and politically feasible alternatives is essential for ensuring that advocacy for women's health is globally inclusive.
Could the WSIS e-health indicators be updated to include requirements for gender-representative training data, and how could WHO and ITU be encouraged to adopt such standards?
WSIS indicators carry significant international weight and influence national digital health strategies. Embedding gender data requirements into these indicators could create a cascading effect on how countries and organisations approach health AI development.
What is the full economic cost to health systems and national economies of failing to include women adequately in medical research and AI health models, particularly given that women's poor health disproportionately affects their prime working years?
Quantifying the economic burden of gender-biased health research could provide a compelling financial argument for governments and the private sector to invest in corrective action, complementing the existing moral and scientific case.
How does the use of synthetic data in AI model training further erode the already weak representation of women, and what safeguards can be introduced to prevent the loss of signals from underrepresented groups during model retraining?
Each iteration of training on synthetic data risks further marginalising already underrepresented groups such as women. Understanding and mitigating this compounding effect is critical as AI labs increasingly rely on synthetic data due to shortages of real human data.
