How to search a list of distinct numbers for hidden layer sizes more efficiently? #1028
Unanswered
yuntaowu2000
asked this question in
Q&A
Replies: 2 comments 4 replies
-
Hi @yuntaowu2000. CFO/CFOCat (#175) supports hierarchical search space. Since your search space is entirely discrete, I suggest using CFOCat instead of CFO. |
Beta Was this translation helpful? Give feedback.
0 replies
-
@yuntaowu2000 Hi, are you still stuck in this difficulty? |
Beta Was this translation helpful? Give feedback.
4 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I would like to search for a list of hidden layer sizes using the code below. Both the list size and the elements are unknown.
I want it to search for a list of optimal hidden sizes, e.g. [1, 2, 3, 4, 5] or [7, 5, 3] rather than a list of fixed numbers like [3,3,3] or [5,5,5,5].
The default
flow2
search algorithm will throw exception for this kind of sampling, so I have to useRandomSearch
, but the result may not be optimal. Is there a better search algorithm for this kind of list search?Beta Was this translation helpful? Give feedback.
All reactions