Excited to present our paper arxiv.org/abs/2407.03321 at #NAACL this Friday, May 2, at 10am in Ballroom A! If you're interested in LLMs and Planning, I hope you'll join us to hear about our work!
- We've started benchmarking OpenAI's new O1 model on the Planetarium dataset—excited to share some early results!Is o1 really better at reasoning? Or is it just reinforcing what it already knows? We put o1-preview to the test on (some of) our planning problem generation dataset, planetarium🪐. Here’s what we found: 💻repo: github.com/BatsResearch/p… 🧵Thread 👇
- I'm thrilled to share our latest research on LLMs and planning! 🚀🪐 A huge thanks to @max_zuo and @jacobli99 for their outstanding work, and to @stevebach and @mlittmancs for their invaluable mentoring and excellent insights.Ever wonder if LLMs use tools🛠️ the way we ask them? We explore LLMs using classical planners: are they writing *correct* PDDL (planning) problems? Say hi👋 to Planetarium🪐, a benchmark of 132k natural language & PDDL problems. 📜 Preprint: arxiv.org/abs/2407.03321 🧵1/n
