There shouldn't be any skip connections for inverted residual blocks having input channel != output channel. ref : https://github.com/pytorch/vision/blob/main/torchvision/models/mobilenetv2.py#L32 https://github.com/transmuteAI/trailmet/blob/b595b988131d59fce756af50f9e177b376075fde/trailmet/models/mobilenet.py#L74