The New, Smartest AI: Claude 3 – Tested vs Gemini 1.5 + GPT-4
Episode details
Episode description
Claude 3 is out and Anthropic claim it is the most intelligent language model on the planet. The paper was released 90 minutes ago, and I’ve read it in full and the release notes. I’ve tested the model and compared it to Gemini 1.5 and GPT-4 in image analysis, business use cases, long context, logic, mathematics, JSON outputting, risqué content, creative writing, official benchmarks and more. In short, I think the model will be popular … but why so, and what does that mean for AGI? AI Insiders: https://www.patreon.com/AIExplained Claude 3 Opus: https://claude.ai/chats Paper, w/ Opus, Sonnet and Haiku: https://www-cdn.anthropic.com/de8ba9b01c9ab7cbabf5c33b80b7bbc618857627/Model_Card_Claude_3.pdf Release Notes: https://www.anthropic.com/news/claude-3-family Pricing, Opus, Sonnet and Haiku: https://www.anthropic.com/api#pricing Amodei Interview: https://www.dwarkeshpatel.com/p/dario-amodei NYT Anthropic: https://www.nytimes.com/2023/07/11/technology/anthropic-ai-claude-chatbot.html LLM Leaderboard: https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard Gemini 1.5: https://storage.googleapis.com/deepmind-media/gemini/gemini_v1_5_report.pdf GPQA: https://arxiv.org/pdf/2311.12022.pdf GPT-4 Turbo Benchmark, Kinda: https://arxiv.org/html/2401.02985v1 AI Insiders: https://www.patreon.com/AIExplained Non-Hype, Free Newsletter: https://signaltonoise.beehiiv.com/