The AI Arms Race Is Over: Why The Multimodal GPT-4o Is The Future Of AI

🌈 Abstract

The article discusses the importance of speed in AI development, and how OpenAI's new model GPT-4o is addressing this issue. It also compares GPT-4o to Google's Gemini Pro model and analyzes the performance and pricing of these AI models.

🙋 Q&A

[01] The Importance of Speed in AI

1. What is the main problem facing AI according to the author?

• The main problem for AI is speed, not intelligence. The author states that speed is the "number one problem facing AI" and has plagued all of their AI features.

2. How has AI improved through reinforcement learning from human feedback?

• Using human reviewers to rate responses, AI models can be tuned to sound as smart as desired in terms of hallucinations, reasoning, and math. This method has been a primary way AI has improved significantly.

3. What is the author's proposal for OpenAI instead of focusing on GPT-5?

• The author proposes that OpenAI should focus on developing GPT-4.5, which would be significantly smaller and faster, similar to how GPT-3.5 was to GPT-3.

[02] Comparison of GPT-4o and Gemini Pro

1. How does the pricing of GPT-4o compare to GPT-4 Turbo and Gemini 1.5 Pro?

• GPT-4o is significantly cheaper than GPT-4 Turbo, costing only $5 per million input tokens and $10 per million output tokens, compared to $10 and $20 for GPT-4 Turbo. It is also cheaper than Gemini 1.5 Pro.

2. How does the performance of GPT-4o compare to other models?

• The performance graph shows that GPT-4o achieves slightly better performance than GPT-4 Turbo, with only the Claude 3 Opus model coming close in terms of performance.

3. What improvements does GPT-4o have in its tokenization algorithm?

• GPT-4o improves the tokenization algorithm, providing 1.1-1.2x improvements for Latin-based languages and significantly better improvements for languages like Chinese (1.4x), Korean (1.7x), and Arabic (2.0x).

[03] Multimodal Capabilities of GPT-4o

1. What are the key multimodal capabilities of GPT-4o?

• GPT-4o integrates speech interactions, allowing users to speak with the AI without the need for a keyword or tap, and even interrupt the AI while it is talking. This is a significant improvement over the previous speech-to-text integration in the ChatGPT app.

2. How does GPT-4o's multimodal capabilities compare to Google Gemini?

• The author notes that Google Gemini's original demo of multimodal capabilities was faked, but now it seems that OpenAI can finally deliver on this feature with GPT-4o.

3. What is the author's view on the future of AI development?

• The author believes that the future of AI is not in intelligence, but in multimodal capabilities and improving the user experience. They suggest that GPT-4o is more of a refinement compared to GPT-4 Turbo, focusing on the user experience rather than just raw performance.