Google broadens its AI hardware portfolio with two new specialized chips

Glass Epoch DeskOriginal digestSource: TechCrunch AI

AI-assisted digest, checked against the original source before publishing. How we work

Google adds two specialized eighth-gen TPUs — a confidential-training chip built with AMD and a doubled-memory inference package — as hyperscalers and AI labs push further into custom silicon.
Google broadens its AI hardware portfolio with two new specialized chips
Photo: Pawel Czerwinski · free stock license

Google on Monday unveiled two new variants of its tensor processing units (TPUs), extending its in-house chip lineup into confidential inference and larger-memory workloads as the company works to cut its reliance on externally made chips for its cloud computing business.

The two units, TPU 8tx and TPU 8i Max, belong to Google's eighth generation of TPUs, which was introduced in April and originally emphasized inference capacity and support for large training requirements. The new parts build on that generation rather than starting a new one, broadening the range of use cases the portfolio covers.

TPU 8i Max takes a different approach: it packages two of the inference-focused TPU 8i chips from April into a single unit, doubling memory capacity, processing power and bandwidth. The result is a chip that lets models consider a wider range of information during queries, addressing memory pressure for large workloads rather than adding new security features.

The launch lands amid a broader scramble for AI-specific semiconductors. Microsoft, Amazon and AI labs including OpenAI and Anthropic are all developing their own chips and supporting software to reduce dependence on Nvidia's dominance of the market. TechCrunch's report also flagged a personal controversy involving Nvidia CEO Jensen Huang disclosed over the weekend, arriving at what it characterized as a vulnerable moment for the company.

What remains open is how and when these chips reach customers: Google did not outline availability, pricing, or which cloud regions will carry them, nor how the confidential-training features will be billed relative to existing TPU tiers. Also unaddressed is whether TPU 8tx's on-chip reasoning loop will become a distinct product surface for distilled-model workflows or stay a feature inside the standard training stack, and how quickly rivals respond with comparable memory-doubling inference parts.

Key facts

  • • Google announced TPU 8tx and TPU 8i Max on Monday.
  • • TPU 8tx was co-designed with AMD, based on the TPU 8t.
  • • TPU 8i Max doubles TPU 8i memory, power and bandwidth.
  • • Both new chips join the eighth TPU generation launched in April.
  • • Microsoft, Amazon, OpenAI and Anthropic are developing their own AI chips.

Why it matters

Builders gain two new option types: hardware-isolated confidential training for proprietary data, and doubled-memory inference that widens what a query can hold. If confidential training ships as a distinct, billable tier, data-sensitive workloads may move off Nvidia-centric stacks faster. Watch for availability, pricing and region details, since the announcement shipped without them.

Spotted an error? Send a correction.

Get the day's AI news in one email

The Daily Epoch · 60-second read · unsubscribe anytime

Related

Google broadens its AI hardware portfolio with two new… | Glass Epoch