When AI Gets to Play Judge, Jury, and Executioner