We support the following logging "keys":
fuzz: fuzzing loop;mgen: model generation;smt: constraints in smt solving;exec: model execution;viz: graphviz visualization;dtest: dtype_test;core: seed setting, etc;
The show messages above "INFO" level (see Python's logging module). To show debug level message, add hydra.verbose=[${keys}] (also see hydra.logging).
# Show debug information related to `fuzz`:
${NNSMITH_CMD} hydra.verbose=fuzz
# Show debug info for `fuzz` and `exec`:
${NNSMITH_CMD} hydra.verbose="[fuzz,exec]"By default, NNSmith logs things both in console and file. You can find the loggings in outputs/${DATE}/${APP}.log (current working directory).
See nnsmith/error.py:
ConstraintError: Unsatisfiable constraints which is a hint to re-try;InternalError: NNSmith has some internal bugs that should be fixed.
Takeways:
- Catch
ConstraintErroras a hint to re-try graph generation (no satisfiable solution yet); - Never catch
InternalError-- but let the maintainer know the issue and fix it.