How to sample full architectures from defined Search Spaces?

[geantrindade]

I want to sample random architectures from the defined Search Spaces such as DARTS and ENAS.

Is it possible to sample the entire PyTorch object representing the whole architecture? If not, is it possible to sample all the possible cells from the search spaces? Can you provide some code examples for doing this?

I found some code examples from ENAS and DARTS but the model returned include all the "layer choices" that I assume the Trainer would select then generate the final architecture, but I am more interested in just sample random architectures from the search spaces, I mean, the full architectures without these "decisions to be made" included. Can you pleaseeee help me with that?

[ultmaster]

You can use random strategy in multi-trial NAS, which will sample one architecture in each trial.

[geantrindade]

Could you show me some code examples of how to do that? I just want to sample some architectures or cells from DARTS actually...

[geantrindade]

I tried to use the Random strategy but the documentation says that "Do not dry run to get the full search space. Used when the search space has variational size or candidates" which is not the case for the defined search spaces such as DARTS. Could you please give me an example of how to simply sample at random the cells or entire architectures from DARTS space? I'm still waiting...

[ultmaster]

I don't think DARTS search space has a variational number of candidates.

You can refer to multi-trial/mnist example on how to use Random strategy.