The Curious Case of Inverse Predictions: When Being Wrong Makes You Right