I just had a look at the config.ini (in %appdata%/factorio/config or your operating system's equivalent) and there's a line in it to define the port. Try playing around with it?