Learning AI Agents the Hard Way (So You Don't Have To)