Broadcom has announced breakthrough technology aimed at accelerating custom chip performance in response to rising demand for generative AI infrastructure. The innovation, known as 3.5D XDSiP, enhances memory integration and speeds up processing by directly linking critical components. Developed in collaboration with TSMC, the technique uses advanced packaging methods, including chip-on-wafer-on-substrate, which remains a bottleneck in AI chip supply chains.
The California-based chipmaker has positioned itself as a key player in the AI hardware market, supplying custom processors to cloud providers looking to diversify beyond Nvidia’s pricier options. Although Broadcom has not disclosed its partners, industry experts suggest that major companies like Google and Meta are among its clients.
Broadcom’s CEO, Hock Tan, stated in September that the company expects AI revenue to reach $12 billion in fiscal year 2024, reflecting a significant increase from earlier forecasts. Five products using the 3.5D XDSiP technology are currently in development, with production shipments planned for early 2026.
The custom chip market, valued at $45 billion by 2028, is set to be dominated by Broadcom and rival Marvell. Analysts predict continued growth for both companies as AI infrastructure demand expands globally.
Tamar Eilam, a leading scientist at IBM, is pushing boundaries in sustainable computing. With 24 years at the company, she serves as an IBM fellow and chief scientist for sustainable computing, tackling one of AI’s most pressing challenges its immense energy consumption. Eilam’s work includes spearheading projects like Kepler, an open-source tool that quantifies the energy usage of applications, helping teams adopt greener AI practices.
AI’s energy demands are staggering, with reports showing that a single ChatGPT search consumes ten times more electricity than a typical Google search. Eilam envisions AI as a double-edged sword—capable of aiding sustainability efforts like decarbonising power grids while also requiring extensive resources to function. To address these issues, her team focuses on efficient AI training methods, high-quality data use, and platform optimisations to reduce resource drain.
Eilam advocates for transparency and trust in AI development. IBM’s approach ensures energy-efficient models, like its Granite line, while addressing intellectual property concerns with verifiable data sources. She also highlights the need for startups and companies to prioritise openness about energy impacts and guardrails to prevent misuse.
Beyond technical achievements, Eilam is a vocal advocate for gender diversity in AI. She emphasises breaking unconscious biases and encourages women to persist in leadership roles. Her passion for merging climate solutions with cutting-edge technology continues to shape sustainable computing innovations.
Italian startup iGenius and Nvidia are teaming up to launch one of the largest deployments of Nvidia’s advanced servers by mid-2025. The ‘Colosseum’ data centre in southern Italy will house around 80 GB200 NVL72 servers, each powered by 72 of Nvidia’s latest Blackwell chips, enabling unprecedented AI computing capabilities.
iGenius, a European AI unicorn with over €650 million in funding this year, specialises in open-source AI models for industries like banking and healthcare, prioritising strict data security. The Colosseum system will leverage Nvidia’s tools, including the NIM software platform, to simplify AI model distribution for businesses using Nvidia hardware.
Nvidia executives lauded the partnership, with VP Charlie Boyle highlighting its scale and uniqueness. Multiple Nvidia teams are working closely with iGenius to bring the cutting-edge system online, marking a significant milestone in AI infrastructure development.
The US-China tech export war is intensifying as both nations continue pushing their antagonistic agendas to curb the other’s technological advancements. As expected, trade tensions between the USA and China are escalating again in the semiconductor sector as four top Chinese industry associations have recently warned against purchasing US chips, claiming they are ‘no longer safe’ and threaten national security principles. The Chinese associations, representing major industries from telecommunications to the digital economy, have opted for a considerable change in the mindset of Chinese businesses. They are now advised to consider non-US suppliers to safeguard their operations and reduce reliance on US technology.
The industry associations’ response follows the latest US crackdown, targeting China’s semiconductor industry. The new restrictions, introduced by the US Department of Commerce, extend to 140 Chinese companies and cover a broad range of products, including critical semiconductor equipment and high-bandwidth memory used in AI chip development. These measures aim to limit China’s access to advanced technologies essential for its military modernisation and AI capabilities, with the Biden administration labelling the restrictions necessary for US national security.
However, Beijing is far from passive in this ‘tech conflict’. Chinese authorities have been ramping up retaliatory measures in response to the curbs. One of the most notable moves came last year when China blocked US chipmaker Micron from some government purchases following a failed security review. Similar scrutiny has been directed at other US tech giants like Intel, with significant revenue from China. Furthermore, China has increasingly turned to its ‘unreliable entity list’ to target US firms, such as PVH Corp, probed for complying with US sanctions on Xinjiang cotton, showing China’s determination to impose economic and market barriers on American companies.
China has also used its control over rare earth materials as leverage, imposing export restrictions on critical elements like gallium, germanium, and antimony. These materials are vital for semiconductor manufacturing and military applications, and their abundance means China’s strategic advantage in global supply chains. In addition to the listed, the recent imposition of new export controls on dual-use technologies to US military users or for military purposes further underscores China’s strategy to regulate products that have both civilian and military applications. The change in course aims to secure China’s rise and dominance in these sectors and limit US access to critical technologies needed for advanced military and AI applications.
Amid these tensions, the semiconductor sector has become a focal point of a global power struggle. The USA has restricted the sale of advanced chipmaking equipment to China, focusing mainly on equipment from US-based companies such as Lam Research and Applied Materials and European suppliers like ASML. While China has made strides toward becoming more self-sufficient in semiconductor manufacturing, the US curbs continue to impact China’s access to cutting-edge equipment and expertise essential for advancing its chip technology. Despite the setbacks, Chinese companies, such as Empyrean and Nata Opto-Electronic, have been building equipment stockpiles and pushing for greater localisation to mitigate the effects of the sanctions.
The expanding reach of US export controls also affects global partners, including Japan and the Netherlands, which supply critical chipmaking equipment to China. While Japan and the Netherlands have been exempt from some of the curbs, their involvement in the US rules still limits the scope of their exports to China. However, the USA seems quick to monitor and enforce these regulations, further entangling allies in the conflict.
The conclusion is that the escalating tech conflict between the USA and China provokes deepening concerns in the two governments about data security, military supremacy, and leadership in critical areas like AI and semiconductors. With both countries fiercely safeguarding their strategic priorities, this tech rivalry is poised to reshape global supply chains, innovation landscapes, and the overall power dynamics in the tech sector, undoubtedly influencing the world economy for years to come.
New export restrictions will ignite global trade tensions.
In other news..
Bitcoin breaks $100,000 for the first time
The surge follows Donald Trump’s election as US president, sparking hopes of a pro-crypto regulatory environment.
Australia begins trial of teen social media ban
Australia‘s government is conducting a world-first trial to enforce its national social media ban for children under 16, focusing on age-checking technology.
Four major Chinese industry associations have advised local companies to avoid purchasing US chips, citing them as ‘no longer safe,’ and to opt for domestic or non-US alternatives instead.
Advancing medical technology, robotic systems now learn surgical skills by watching recorded operations, paving the way for safer and more efficient autonomous procedures.
First penned by Henry David Thoreau in 1854, “brain rot” has reemerged as a digital-age critique, capturing unease over endless scrolling and low-value content.
The Geneva AI Attaché leverages cutting-edge AI technology to enhance the diplomatic capabilities of small and developing countries in multilateral negotiations.
The industry is an ecosystem emerged on the need to make the invention more available. We might be in an equilibrium moment in which all sides agree on the architecture…
Can the West’s focus on transparency and the East’s emphasis on moral accountability provide complementary tools to combat it? Aldo Matteucci investigates.
The 19th annual Internet Governance Forum will be hosted by the Kingdom of Saudi Arabia in Riyadh on 15-19 December 2024. Stakeholders are encouraged to submit thematic inputs by January…
Diplo will be actively involved in the 2023 Internet Governance Forum (IGF) in Kyoto, Japan, focusing on topics like bottom-up internet governance, knowledge management, enhancing civil society participation, and cyber norms.
Former PayPal COO David Sacks has been named as President-elect Donald Trump’s advisor on cryptocurrency and AI policy. Trump announced the appointment on Truth Social, stating Sacks would focus on creating a legal framework to support the US cryptocurrency industry and foster growth.
Sacks, a prominent venture capitalist and co-founder of Yammer, has been a longtime advocate for cryptocurrencies, describing them as aligning with PayPal’s original vision of a ‘database of money.’ His firm, Craft Ventures, has invested in major startups like SpaceX and Reddit.
While Sacks’ cryptocurrency stance is clear, his approach to AI policy remains less defined. However, his deregulatory leanings suggest a shift from the stricter policies of the outgoing Biden administration.
Asia’s data centre market is attracting global investors despite sky-high valuations, thanks to surging demand driven by artificial intelligence services. Industry leaders expect the sector to remain lucrative, with data centres critical for housing the infrastructure needed to support AI and other digital technologies.
Recent deals highlight this growth, including Blackstone’s $15.5b acquisition of Australia’s AirTrunk, which set a benchmark with valuations exceeding 20 times core earnings. Similarly, Indonesia’s NeutraDC is drawing interest from major players like Singapore Telecommunications and BDx Data Centres, with a partial sale valuing it at over $1b.
Australia has also seen significant activity, with the DigiCo IPO increasing by $100 million to meet strong investor demand. This trend underscores Asia’s AI dominance in global data centre transactions, representing over half of 2024’s deal value. However, some experts warn of risks in markets lacking robust infrastructure to keep up with capacity expansion.
While execution risks remain, Asia’s data centre market is poised for continued growth, fueled by both technological advances and the expanding needs of hyperscale customers.
Cleerly, an AI-driven cardiovascular imaging startup, has raised $106 million in a Series C extension round led by Insight Partners. The company, founded by cardiologist James Min, uses advanced software to analyze CT scans and detect early-stage coronary artery disease before symptoms appear. This innovative approach aims to improve preventive care for heart conditions, which remain the leading cause of death in the US.
The technology has already received FDA clearance for diagnosing symptomatic patients and recently gained Medicare approval for its plaque analysis test. Cleerly’s software provides a less invasive and more accurate alternative to traditional diagnostics like stress tests or angiograms. With a compounded annual growth rate exceeding 100% over the past four years, the company is poised to expand further as health insurers increasingly cover its tests.
The latest funding will support Cleerly’s ongoing multi-site clinical trials and future growth. Insight Partners’ involvement highlights the growing confidence in AI-driven solutions for healthcare. While facing competition from companies like HeartFlow and Elucid, Cleerly’s goal of screening the global population for heart disease positions it as a potential leader in this emerging market.
Apple and Baidu are collaborating to bring AI features to iPhones in China, leveraging Baidu’s Ernie 4.0 language model. However, technical challenges, including the AI’s response accuracy and understanding of prompts, have slowed progress.
Sales pressures in China are mounting for Apple, with its market share slipping and Huawei reporting significant growth. Criticism of the iPhone 16‘s lack of AI features has further strained Apple’s competitive position in the region.
Privacy policies also pose hurdles, as Apple’s restrictions prevent Baidu from collecting data from AI interactions, potentially limiting the effectiveness of these features. Siri is expected to incorporate Baidu’s AI models.
Citigroup has launched new AI tools to enhance workplace efficiency for 140,000 employees across eight countries. The tools, named Citi Assist and Citi Stylus, aim to simplify tasks such as navigating internal policies and analysing multiple documents. Initially available in countries including the US, UK, and India, the tools will be gradually introduced in more markets.
Citi Assist functions like a highly knowledgeable colleague, guiding users through HR, compliance, finance, and risk procedures. Citi Stylus, on the other hand, allows employees to summarise, compare, or search through multiple documents simultaneously, improving productivity and workflow.
Tim Ryan, Citigroup’s Head of Technology and Business Enablement, explained that staff can propose new uses for the tools, ensuring they evolve alongside employees’ needs. While separate from the bank’s broader efforts to enhance data management, the AI tools are expected to contribute to overall operational improvement.
Chief Technology Officer David Griffiths emphasised that the AI rollout aligns with Citigroup’s commitment to innovation and efficiency in a rapidly evolving financial landscape.
With organisations facing an average of 1,300 cyberattacks per week, Axiado is stepping up with a novel defence: a specialised security chip designed to protect digital infrastructure. Founded in 2017, the Silicon Valley-based startup recently secured $60M in Series C funding led by Maverick Silicon, with participation from Samsung Catalyst Fund and other investors. This brings Axiado’s total funding to $140M.
Axiado’s chip defends against boot-level and runtime security threats, ensuring the integrity of devices from data centres to 5G base stations. It uses root-of-trust technology to prevent hardware tampering and leverages AI-powered analytics to detect malicious data patterns. The company’s chip is positioned as a complement to existing software-based cybersecurity measures, acting as a last line of defence against sophisticated attacks.
The new funds will support Axiado’s go-to-market efforts and help transition its products into mass production by 2025. CEO Gopi Sirineni highlights the growing need for hardware-based security solutions, particularly as the stakes rise in the fight against cybercrime. With partnerships like the one with Jabil to develop server cybersecurity solutions, Axiado is set to expand its reach while competing with industry heavyweights and open-source projects such as Google’s OpenTitan.