Add retrying of failed tests by default to reduce flaky tests (#5461)