Aditi Raghunathan
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Is It Time to Rethink LLM Pre-Training? with Aditi Raghunathan
- Published
- September 16, 2025
- Duration
- 58:26
- Summary source
- description
- Last updated
- Apr 21, 2026
Discusses llm.
Summary
Today, we're joined by Aditi Raghunathan, assistant professor at Carnegie Mellon University, to discuss the limitations of LLMs and how we can build more adaptable and creative models. We dig into her ICML 2025 Outstanding Paper Award winner, “Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction,” which examines …
Show notes
Today, we're joined by Aditi Raghunathan, assistant professor at Carnegie Mellon University, to discuss the limitations of LLMs and how we can build more adaptable and creative models. We dig into her ICML 2025 Outstanding Paper Award winner, “Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction,” which examines why LLMs struggle with generating truly novel ideas. We dig into the "Roll the dice" approach, which encourages structured exploration by injec
Themes
- llm