Grok-2 Actually Out, But What If It Were 10,000x the Size?
Episode details
Episode description
Grok-2 is finally live online, but what does it change? No paper (so much for 'open') but what if it were scaled 10,000x, as a research paper from yesterday showed could happen by 2030? The key question seems to be whether LLMs are developing models of the world, and my new SIMPLE bench website could show a tentative test of this incipient ability. Plus, Ideogram 2, Flux, Hassabis Interviews and Real-time deepfakes. AI Insiders: https://www.patreon.com/AIExplained Chapters: 00:00 Intro 00:40 Grok-2, Flux, ideogram Workflow (02:30 Simple Bench) 04:36 Gemini ‘Reimagine’ and the Fake Internet 05:32 Personhood Credentials 06:09 Madhouse Creativity 08:00 Overhyped or Underhyped 09:27 Epoch research 10:30 Emergent World Mini-Models? Release Post: https://x.ai/blog/grok-2 System Prompt: https://x.com/elder_plinius/status/1826291411408334852 Runway text to Video Gen 3: https://runwayml.com/ Ideogram 2: https://ideogram.ai/t/explore Simple Bench Website Preview: https://simple-bench.com/ Mad Max Muppets: https://www.youtube.com/watch?v=BfqOYVco0CM GPT-4o Yells ‘No’: https://openai.com/index/gpt-4o-system-card/ Real-time Deepfakes: https://www.youtube.com/watch?v=py4Tc-Y8BcY Personhood Credentials: https://arxiv.org/pdf/2408.07892 Zero-knowledge Proof: https://www.youtube.com/watch?v=fOGdb1CTu5c&t=370s Hassabis Interview: Unreasonably Effective AI with Demis Hassabis Hassabis Creator Comments (12.17): https://www.youtube.com/watch?v=RDpR9iluI_k Epoch Research: https://epochai.org/blog/can-ai-scaling-continue-through-2030 World Model: https://news.mit.edu/2024/llms-develop-own-understanding-of-reality-as-language-abilities-improve-0814 Inferring Programs: https://arxiv.org/pdf/2305.11169 Probing Hidden States: https://arxiv.org/pdf/2407.13765 LLMs Can Infer Functions: https://arxiv.org/pdf/2406.14546 Unfiltered Flux: https://www.reddit.com/r/ChatGPT/comments/1etkx1d/its_kind_of_crazy_how_uncensored_grok_2flux_is/ My New Coursera Course! The 8 Most Controversial Terms in AI: https://imp.i384100.net/m57g3M Non-hype Newsletter: https://signaltonoise.beehiiv.com/ GenAI Hourly Consulting: https://www.theinsiders.ai/