[Documentation] [Question] Exhaustive Search

[bbudescu]

Hi,

Is there a way to get smac3 to run the target function on all valid configurations in a ConfigSpace that consists entirely of Categorical, Ordinal and Constant HyperParameters and some forbidden clauses (maybe some Conditions, too)?

Thanks!

[benjamc]

You need to set an adequate number of trials to ensure all valid combinations are evaluated. Simply multiply the number of choices of each HP with each other. With forbiddens/conditions you should obtain more trials than necessary. You should be able to use the random facade. SMAC should terminate when no new configuration is proposed or if every proposed configuration already was evaluated (I did not verify this). Otherwise, use the ask and tell interface to control which configurations are passed yourself. Hope this helps.