As noted in NDS-841, we have an issue with the LOOCV implementation when there are ties for a given metric. In the event of a tie, we should instead:
- Remove one query (randomly) until the tie is broken
- If the tie isn't broken, randomly select from the list if ties