Uploaded image for project: 'National Data Service'
  1. National Data Service
  2. NDS-890

Add tie-breaking to cross-validation framework

XMLWordPrintableJSON

    • Icon: Task Task
    • Resolution: Won't Do
    • Icon: Normal Normal
    • None
    • None
    • None
    • NDS Sprint 27, NDS Sprint 28, NDS Sprint 29, NDS Sprint 30, NDS Sprint 31

      As noted in NDS-841, we have an issue with the LOOCV implementation when there are ties for a given metric. In the event of a tie, we should instead:

      • Remove one query (randomly) until the tie is broken
      • If the tie isn't broken, randomly select from the list if ties

       

              willis8 Craig Willis
              willis8 Craig Willis
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved:

                  Estimated:
                  Original Estimate - 4 hours
                  4h
                  Remaining:
                  Remaining Estimate - 4 hours
                  4h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified