fix: avoid double traversal in assign visitor

fix: avoid double traversal in assign visitor #1071