Google Unveils TPU 8t and TPU 8i Chips

Google announced two eighth-generation tensor processing units, the TPU 8t for training and the TPU 8i for inference, in a Google Cloud Next blog post on April 22, 2026 (cloud.google.com). Media coverage including CNBC and TechCrunch reports the split design and says both chips will become available later this year (CNBC). TechCrunch and other outlets report Google claims up to 3x faster training, 80% better performance per dollar, and support for clusters of more than 1 million TPUs (TechCrunch). The Google Cloud blog also introduced related infrastructure: A5X bare metal instances powered by Nvidia Vera Rubin NVL72, Axion N4A Arm CPUs, the Virgo Network fabric, and managed Lustre storage (cloud.google.com). Amin Vahdat, Google SVP and chief technologist for AI and infrastructure, is quoted on the need for chips specialised for agentic workloads (CNBC).
What happened
Google announced two new eighth-generation tensor processing units, the TPU 8t (training) and the TPU 8i (inference), in a Google Cloud Next blog post on April 22, 2026 (cloud.google.com). The blog post also listed expanded infrastructure offerings including A5X bare metal instances powered by NVIDIA Vera Rubin NVL72, Axion N4A VMs, powered by our custom Axion Arm-based CPUs, the Virgo Network data-center fabric, Google Compute Engine 4th-generation VMs, and Google Cloud Managed Lustre (cloud.google.com).
Tech press coverage frames the announcement as a renewed effort to provide an alternative to Nvidia for large-scale AI compute. CNBC reports the company is splitting training and inference across distinct chips and says both TPUs will become available later this year (CNBC). TechCrunch and other outlets report Google-stated performance claims: up to 3x faster model training, 80% better performance per dollar, and the ability to link more than 1 million TPUs in a single cluster (TechCrunch).
Technical details
Editorial analysis - technical context
Public reporting emphasizes the architectural choice to separate training and inference silicon. Industry coverage notes this mirrors parallel moves by other hyperscalers to build purpose-built processors for specific AI workloads (TechCrunch; CNBC). Reported performance claims-training speedups and cost-per-performance improvements-are presented by media as Google-provided figures rather than independent benchmarks (TechCrunch).
Context and significance
Commercial positioning and market dynamics
What to watch
Editorial analysis
The split-training/inference approach reflects an industry pattern where providers optimise for divergent workload profiles. Training workloads are memory- and compute-intense with long-lived precision needs; inference workloads prioritize latency, memory bandwidth, and cost-efficiency. Companies adopting separate silicon for these roles typically aim to reduce end-to-end cost and energy use for large-scale agentic applications, a trend highlighted across coverage of this announcement (cloud.google.com; TechCrunch; CNBC).
Reporting places Google's move in the broader competitive landscape where hyperscalers and chip firms (notably Nvidia) coexist in customer clouds. Several outlets note Google will continue to offer Nvidia-powered instances, including the Vera Rubin NVL72, alongside its TPUs (cloud.google.com; TechCrunch; Barron's). Coverage cites prior commercial traction for Google TPUs with customers such as Meta and Anthropic, and frames the new chips as an attempt to expand that ecosystem (Bloomberg).
Observers and practitioners should track independently verified benchmarks for the TPU 8t and TPU 8i, cloud pricing and instance availability, and real-world scaling behavior when integrated into multi-accelerator training and agentic inference pipelines. Also watch third-party support across frameworks and model vendors, and whether customers port large frontier models to Google TPUs at scale-these outcomes will determine competitive impact more than vendor claims alone.
Quoted material
Amin Vahdat, Google SVP and chief technologist for AI and infrastructure, is quoted in CNBC: "With the rise of AI agents, we determined the community would benefit from chips individually specialized to the needs of training and serving," (CNBC).
Key Points
- 1Industry pattern: Providers are splitting training and inference silicon to optimise diverse workload characteristics and reduce cost per operation.
- 2What happened: Google announced TPU 8t and TPU 8i plus networking and instance offerings to support large-scale agentic pipelines.
- 3Practical impact: Independent benchmarks, pricing, and ecosystem support will determine whether these TPUs meaningfully alter cloud compute economics versus Nvidia GPUs.
Scoring Rationale
The announcement is a notable infrastructure development with potential to affect cloud AI economics and deployment choices. It is not a paradigm shift by itself; impact depends on benchmarks, pricing, and adoption.
Sources
Public references used for this report.
View 9 more sources
- 04Google Eyes New Chips to Speed Up AI Results, Challenging Nvidiabloomberg.com
- 05Nvidia Stock Faces Google AI Chip Threat. How They Can Both Win.barrons.com
- 06Google announces 2 AI chips as competition with Nvidia heats upfinance.yahoo.com
- 07Google debuts two custom chips in latest bid to challenge Nvidia’s dominancemarketwatch.com
- 08Google's new chips are a shot at Nvidia - AI - Business Insiderbusinessinsider.com
- 09Google Unveils 2 New AI Chips to Take on Nvidiafool.com
- 10Google unveils two new TPUs designed for the "agentic era"arstechnica.com
- 11Google doesn't pay the Nvidia tax. Its new TPUs explain why.venturebeat.com
- 12Google unveils new TPU chips to challenge Nvidia in AI hardware racecryptobriefing.com
Practice interview problems based on real data
1,625 SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems
