rbv2_* and iaml_*

[pfistfl]

• Better capping of targets
• Figure out what to do about F1 (rbv2_) rbv2 f1 #55
• Hardware metrics might be problematic:
  • Often assumes constant memory for rbv2_
  • Perhaps check "learning curves"?
• should be named is_multiclass and be used to trigger a warning when using f1 for multiclass tasks

[sumny]

yahpo_gym/yahpo_gym/yahpo_gym/benchmarks/rbv2.py

Line 11 in 665c4d0

'is_multicrit': {"3": False, "11": True, "12": True, "14": True, "15": False, "16": True, "18": True, "22": True, "23": True, "24": False, "28": True, "29": False, "31": False, "32": True, "37": False, "38": False, "42": True, "44": False, "46": True, "50": False, "54": True, "60": True, "151": False, "181": True, "182": True, "188": True, "300": True, "307": True, "312": False, "334": False, "375": True, "377": True, "458": True, "469": True, "470": False, "1040": False, "1049": False, "1050": False, "1053": False, "1056": False, "1063": False, "1067": False, "1068": False, "1111": False, "1220": False, "1457": True, "1461": False, "1462": False, "1464": False, "1468": True, "1475": True, "1476": True, "1478": True, "1479": False, "1480": False, "1485": False, "1486": False, "1487": False, "1489": False, "1494": False, "1497": True, "1501": True, "1510": False, "1515": True, "1590": False, "4134": False, "4135": False, "4154": False, "4534": False, "4538": True, "4541": True, "6332": False, "23381": False, "23512": False, "40496": True, "40498": True, "40499": True, "40536": False, "40668": True, "40670": True, "40701": False, "40900": False, "40966": True, "40975": True, "40978": False, "40979": True, "40981": False, "40982": True, "40983": False, "40984": True, "40994": False, "41138": False, "41142": False, "41143": False, "41146": False, "41156": False, "41157": False, "41159": False, "41161": False, "41162": False, "41163": True, "41164": True, "41212": True, "41278": True},

should be named is_multiclass and be used to trigger a warning when using f1 for multiclass tasks

[pfistfl]

Lookup table: https://github.com/slds-lmu/randombot_ng/blob/master/input/tasks.info.csv