The AI frenzy could fall flat as companies hoard chips without enough data centers to host them (2024)

Success in technology was once determined by speed. Moving fast, breaking things, and learning along the way. Speed still matters and those slow to commit get counted out fast. However, the race to realize artificial intelligence’s potential might be the moment this approach comes unstuck.

The hype and pace of consumer adoption are unprecedented. In 2006, it took Twitter nearly two years to reach one million users. In 2010, it took Instagram two and a half months. For ChatGPT, it took just five days, with the service reaching 100 million users in a groundbreaking two months.

The AI frenzy is upending the quieter corners of the technology industry too. Over 40,000 companies across the world are now using NVIDIA chips for AI and accelerated computing, and the waiting list to purchase the chips is up to 52 weeks. With AMD and Intel set to launch rival hardware, and Microsoft and Google just some of those announcing multi-billion-dollar investments in infrastructure this year, the race to develop AI products is shifting gears. The focus has shifted from “what can be done” to “how we do it.”

This “buy AI now, figure it out if it works later” mode is the very mindset that could put sustainable AI innovation in jeopardy. We’ve got a supply and demand issue, and it is not just the bottleneck in the production of chips. It is the design and development of the infrastructure needed to support the hardware. We’re turning on the taps without investing in the plumbing. Without this, the AI industry risks a false start which could set it back years.

A market in the making

Data centers are the “how”–and have been for many of the technology hype cycles of the last decade. Put simply, there aren’t enough of them to meet the requirements of powering generative AI on the scale chips sales would indicate. We are entering an era of high-performance computing before the infrastructure is in place to house it. Here is the crux of our supply issue. What excites about the promise of AI is its limitless possibilities. Yet, even as the supply of hardware improves, the scarcity of the necessary infrastructure to house it will limit progress.

The development timeline to build new data centers is now between three to five years, or more in some cases. Those entering the AI marketplace thinking the infrastructure they need is readily available are in for a shock. Most of the data center supply in North America supposedly coming online in 2024 has been pre-released or is under exclusivity already.

Researchers at Epoch AI estimate that AI’s computational power is doubling every six to 10 months. Despite data center construction increasing, meeting this level of demand is becoming a global problem. In Europe alone, the pipeline of data centers needs to more than double by 2025 to meet the forecasted demand. The infrastructure layer of the AI economy is critical to its success. Only those able to secure access or invest accordingly will survive, let alone secure an advantage.

Longevity in the balance

Data center operators have increased their prices by up to 30%–and this will only continue to climb. While a few have the funds to match this increase and are investing themselves, many smaller players will find it challenging to find space and power at prices they can afford. We are therefore facing market consolidation before most have even had a chance to experiment, iterate, learn, or make positive change.

AI can take inspiration from the digital asset sector in this regard. As demand for the asset has increased, capacity to meet demand has been impacted by a growing number of challenges, which weren’t necessarily evident at the outset. Crypto and its ecosystem have largely overcome these issues by retaining an agile approach–for example, by developing a great understanding of the importance of operational and energy efficiency and the optimization of hardware to ensure longevity and cost-effectiveness.

Big Tech is investing billions of dollars, seeking to seize control of the development of AI–and they are moving quickly. It’s a pattern we have all seen before. But should it be repeated? While the opportunity is real (PWC predicts a boost to the global economy of over $30 trillion by 2030), how it is realized will determine the health and longevity of the AI marketplace.

Despite the bold ambition, the potential of AI is only as great as the infrastructure capacity needed to support it. AI is in the balance, and we now face a choice to move fast and break things or build for the future.

Aroosh Thillainathan is the CEO and chairman of the management board at Northern Data Group.

More must-readcommentarypublished byFortune:

  • The race for human-AI interaction usage data is on—and the stakes are high
  • I’m a venture capitalist, and here’s why I believe we need to guarantee everyone’s basic needs: The social flooris actually a trampolinethat can propel our economy
  • Gen Zers and millennials areswitching jobs at an accelerating pace, and it’s paying off. Here’s where it can still go wrong
  • Sports leagues thought they hit the jackpot by partnering with the betting industry—but gambling scandals areturning Americans against them

The opinions expressed in Fortune.com commentary pieces are solely the views of their authors and do not necessarily reflect the opinions and beliefs ofFortune.

The AI frenzy could fall flat as companies hoard chips without enough data centers to host them (2024)

FAQs

Does AI require chips? ›

As AI technology develops, AI chips have become essential in creating AI solutions at scale. For example, delivering a modern AI application like facial recognition or large-scale data analysis using a traditional CPU—or even an AI chip from a few years ago—would cost exponentially more.

Is there enough data for AI? ›

As researchers explore potential applications for AI, they have found scenarios where AI could be really useful — such as analyzing X-ray image data to look for evidence of rare conditions or detecting a rare fish species caught on a commercial fishing boat — but there's not enough data to accurately train the ...

Who supplies chips for AI? ›

Which companies make AI chips? Nvidia dominates the AI chip manufacturing industry, but it faces competition from other major tech companies like Microsoft, Google, Intel, IBM and AMD.

Is AI useless without data? ›

AI Is Only Intelligent With Data

By taking a platform approach that supports multi-tenancy, multiple protocols, and automatic scaling, businesses can ensure their AI systems have the real-time data they need to perform optimally and reliably.

Can AI run without internet? ›

Examples of private offline AI applications include voice assistants that can perform tasks without needing to connect to the internet, image recognition systems that analyze photos locally on a smartphone, and predictive text input systems that suggest words or phrases without sending data to external servers.

Is AI 100% accurate? ›

As a business innovation specialist and data scientist, I can attest that AI systems are fallible and may produce inaccurate outcomes if trained on biased or limited datasets. Biases present in the training data can perpetuate and even amplify societal biases, resulting in unfair or discriminatory results.

Can AI work without big data? ›

AI systems rely on data, while Big Data can handle and process huge amounts of both structured and unstructured information. Therefore, it becomes the essential element that provides the nutrition for AI models.

What is required to run an AI system? ›

Central Processing Units (CPUs): General-purpose processors capable of handling various tasks. They are essential for managing the overall operation of AI systems. Graphics Processing Units (GPUs): Specialized processors designed for parallel processing are ideal for training deep learning models.

What is requirement for AI? ›

How can I become an AI after 12th? To pursue a career in AI after 12th, you can opt for a bachelor's degree in fields like computer science, data science, or AI. Focus on learning programming, mathematics, and machine learning concepts. Further, consider pursuing higher education or certifications to specialize in AI.

Why does AI need Nvidia chips? ›

A high-performance GPU can have more than a thousand cores, so it can handle thousands of calculations at the same time. Once Nvidia realised that its accelerators were highly efficient at training AI models, it focused on optimising them for that market.

Does AI use semiconductors? ›

AI servers need a large amount of electricity and might consume more than 10 percent of global electricity in 2030. This requires many power semiconductors within the server and on the actual devices.

Top Articles
Expense: Definition, Types, and How Expenses Are Recorded
Is Any Job Better Than No Job at All?
Warren Ohio Craigslist
Roblox Roguelike
Brgeneral Patient Portal
My Boyfriend Has No Money And I Pay For Everything
How Far Is Chattanooga From Here
Tribune Seymour
Joe Gorga Zodiac Sign
Where's The Nearest Wendy's
Es.cvs.com/Otchs/Devoted
De Leerling Watch Online
Oxford House Peoria Il
REVIEW - Empire of Sin
Hijab Hookup Trendy
Patrick Bateman Notebook
Average Salary in Philippines in 2024 - Timeular
Unterwegs im autonomen Freightliner Cascadia: Finger weg, jetzt fahre ich!
Jalapeno Grill Ponca City Menu
How many days until 12 December - Calendarr
Southwest Flight 238
Lovindabooty
Joann Fabrics Lexington Sc
Ihs Hockey Systems
My Reading Manga Gay
Maths Open Ref
LG UN90 65" 4K Smart UHD TV - 65UN9000AUJ | LG CA
N.J. Hogenkamp Sons Funeral Home | Saint Henry, Ohio
Hannah Jewell
Vlacs Maestro Login
Boneyard Barbers
Hypixel Skyblock Dyes
Waffle House Gift Card Cvs
Andhra Jyothi Telugu News Paper
Delaware judge sets Twitter, Elon Musk trial for October
Duff Tuff
“Los nuevos desafíos socioculturales” Identidad, Educación, Mujeres Científicas, Política y Sustentabilidad
Mvnt Merchant Services
Lake Kingdom Moon 31
FREE - Divitarot.com - Tarot Denis Lapierre - Free divinatory tarot - Your divinatory tarot - Your future according to the cards! - Official website of Denis Lapierre - LIVE TAROT - Online Free Tarot cards reading - TAROT - Your free online latin tarot re
Big Reactors Best Coolant
Gabrielle Abbate Obituary
Petfinder Quiz
Xre 00251
Human Resources / Payroll Information
Learn4Good Job Posting
Billings City Landfill Hours
Cheryl Mchenry Retirement
Scholar Dollar Nmsu
Equinox Great Neck Class Schedule
Primary Care in Nashville & Southern KY | Tristar Medical Group
Latest Posts
Article information

Author: Tish Haag

Last Updated:

Views: 6360

Rating: 4.7 / 5 (47 voted)

Reviews: 94% of readers found this page helpful

Author information

Name: Tish Haag

Birthday: 1999-11-18

Address: 30256 Tara Expressway, Kutchburgh, VT 92892-0078

Phone: +4215847628708

Job: Internal Consulting Engineer

Hobby: Roller skating, Roller skating, Kayaking, Flying, Graffiti, Ghost hunting, scrapbook

Introduction: My name is Tish Haag, I am a excited, delightful, curious, beautiful, agreeable, enchanting, fancy person who loves writing and wants to share my knowledge and understanding with you.