Once a enemy harbour was destroyed often a nearby places forester or shipyard uses the place of the harbour for their buisness.
Depending of the gametype, level could not be won anymore. I am not sure if it is possible but keep out zone from harbour places might fix the issue.