An Experimental Design Approach to Evaluating Agentic AI's Autonomous Model Discovery

Large language model coding agents increasingly perform open-ended data modeling and analysis.

Large language model coding agents increasingly perform open-ended data modeling and analysis. These agents are stochastic and adaptive, and therefore their autonomous model discovery behavior cannot be adequately characterized by a single benchmark run. In this work, we propose…