You'll need to lose "an excessive amount of times" for the difficulty to come down ...