Apple says its AI models were trained on Google's custom chips

🌈 Abstract

The article discusses Apple's use of Google's Tensor Processing Units (TPUs) to train the artificial intelligence models underlying its AI system, Apple Intelligence. This signals that major tech companies are exploring alternatives to Nvidia's graphics processing units (GPUs) for AI training.

🙋 Q&A

[01] Apple's Use of Google's TPUs

1. What did Apple reveal about the AI models powering its Apple Intelligence system?

• Apple said in a technical paper that the two AI models underpinning Apple Intelligence were pretrained on Google-designed Tensor Processing Units (TPUs) in the cloud.
• Apple used a single "slice" of 2048 TPU v5p chips to train the on-device AFM model, and 8192 TPU v4 chips configured into 8 slices for the AFM-server model.

2. Why is Apple's decision to use Google's TPUs significant?

• Nvidia's GPUs have dominated the market for high-end AI training chips, but they have been in short supply.
• Apple's use of Google's TPUs signals that major tech companies are looking for alternatives to Nvidia's GPUs for AI training.

3. How do the costs of Google's TPUs compare to Nvidia's GPUs?

• According to Google's website, the latest TPUs cost under $2 per hour when booked for 3 years in advance.
• This suggests Google's TPUs may be a more cost-effective option for AI training compared to Nvidia's pricey GPUs.

[02] Broader Trends in AI Infrastructure

1. What comments have tech CEOs made about AI infrastructure investment?

• Meta CEO Mark Zuckerberg and Alphabet CEO Sundar Pichai have suggested that their companies and others in the industry may be overinvesting in AI infrastructure.
• However, they acknowledged the business risk of falling behind in this critical technology area.

2. How are other major tech companies using Nvidia's GPUs for AI?

• OpenAI, Microsoft, Anthropic, Google, Meta, Oracle, and Tesla are all using Nvidia's GPUs to build out their AI systems and offerings.

3. What are Apple's plans for incorporating generative AI into its products?

• Over the next year, Apple plans to roll out functions based on generative AI, including image generation, emoji generation, and an enhanced Siri that can access personal information and take actions within apps.