If not, when doing reload, we may listen to the same port, we'll get error about listen to already used address.