Home Amazon readies new AI chip to compete with Nvidia

Amazon readies new AI chip to compete with Nvidia

TLDR

  • Amazon is developing its own AI chips, led by its Annapurna Labs, to compete with Nvidia.
  • The new Trainium 2 chip aims to train AI models faster and reduce Amazon's reliance on Nvidia.
  • Amazon and other tech giants are heavily investing to boost AI performance and data infrastructure.

Nvidia might have some serious competition in the AI chip space coming. Amazon is now seeking to bring its own chips to the market, as it attempts to break away from the chipmaking giant.

This effort is being led by Amazon’s 2015 purchase, Annapurna Labs, which it acquired for $350 million. The company is best known for providing Amazon’s Web Services (AWS) with its hypervisor (virtual machine management) hardware, Nitro.

It also built Graviton, a lower-power ARM-based alternative to AMD and Intel’s traditional server chips.

Now, Annapurna is testing Trainium 2, the latest bit of kit set to cement Amazon’s footing in the AI sphere. Unveiled in 2023, the name “Trainium” relates to its purpose in the AWS pipeline. Amazon intends to train AI models, supposedly providing four times faster training than the previous version, which launched in 2020.

Anthropic, the firm behind the ChatGPT alternate AI bot Claude, is currently testing the Trainium 2. The OpenAI competitor has received a $4 billion investment from Amazon.

It is also now trying to work a deal with Anthropic, where it will have the company train its AI models on the new Trainium 2, even though it prefers Nvidia hardware.

Amazon, much like OpenAI and Microsoft, is desperately trying to build its own set of chips. Nvidia is dominating the market right now, with a whopping $26.3 billion in sales in the second quarter of 2024.

By removing Nvidia from the equation, it aims to not only reduce spending on production but on running the chips too.

Speaking with The Financial Times, Dave Brown, vice-president of compute and networking services at AWS said, “When you save 40 per cent of $1000, it’s not really going to affect your choice. But when you are saving 40 per cent on tens of millions of dollars, it does.”

Tech giants spend big for total control in AI rat race

Another goal is to have more control over the chips themselves. We’ve already seen Apple take back a vast majority of control over its products, as it eliminated Intel from its Mac machines in 2020. It spent $1 billion on the M3 chip’s development alone.

Apple’s M-series chip has been hailed as one of the best on the market, with the latest M4 model specifically designed to increase performance when using artificial intelligence.

However, Amazon, much like its competitors in the AI space, has dramatically increased its spending. In 2023, the shopping giant spent $48 billion and is expected to increase this to a massive $75 billion in 2024.

Microsoft saw an even larger increase, as it went from $10.7 billion in 2023 to an incredible $56 billion by August 2024. The race isn’t just to produce the best AI offering, but also to fight against the ongoing issues with power infrastructure and data centers.

Amazon is expected to spend around $150 billion on data center infrastructure in the coming fifteen years. AWS powers a vast majority of the internet at this point and with the constant rise of AI needs, it is seeking to expand that exponentially.

About ReadWrite’s Editorial Process

The ReadWrite Editorial policy involves closely monitoring the tech, gambling and blockchain industries for major developments, new product and brand launches, AI breakthroughs, game releases and other newsworthy events. Editors assign relevant stories to in-house staff writers with expertise in each particular topic area. Before publication, articles go through a rigorous round of editing for accuracy, clarity, and to ensure adherence to ReadWrite's style guidelines.

Joel Loynds
Tech Journalist

Joel Loynd’s obsession with uncovering bad games and even worse hardware so you don’t have to has led him on this path. Since the age of six, he’s been poking at awful games and oddities from his ever-expanding Steam library. He’s been writing about video games since 2008, writing for sites such as WePC and PC Guide, as well as covering gaming for Scan Computers, More recently Joel was Dexerto’s E-Commerce and Deputy Tech Editor, delving deep into the exploding handheld market and covering the weird and wonderful world of the latest tech.

Get the biggest tech headlines of the day delivered to your inbox

    By signing up, you agree to our Terms and Privacy Policy. Unsubscribe anytime.

    Tech News

    Explore the latest in tech with our Tech News. We cut through the noise for concise, relevant updates, keeping you informed about the rapidly evolving tech landscape with curated content that separates signal from noise.

    In-Depth Tech Stories

    Explore tech impact in In-Depth Stories. Narrative data journalism offers comprehensive analyses, revealing stories behind data. Understand industry trends for a deeper perspective on tech's intricate relationships with society.

    Expert Reviews

    Empower decisions with Expert Reviews, merging industry expertise and insightful analysis. Delve into tech intricacies, get the best deals, and stay ahead with our trustworthy guide to navigating the ever-changing tech market.