[0.14.8] [Twinsen/cube] Downloading map hangs at 100%

[flonussi]

I'm really annoyed by this bug, so I spent the whole day narrowing the issue down.

As I was already saying, I'm able to connect to our server from my Macbook and my Notebook with Linux on it, but I was not able to connect to it from my Gaming PC with Windows on it.
To work around this issue I now tried installing Linux (dualboot) on my PC to be able to connect to the server... As I finished setting everything up I tried to connect to the server and AGAIN it was hanging at 100%, now with Linux.

My next thought was, that it has to do something with the hardware configuration/network chipset. I installed my old usb->RJ45(Asix AX88772B chipset) network adapter (instead of the onboard one) and tried to connect to the server and NOW everything works just fine... with Windows and also with Linux on my Gaming Rig.
After that, I was curious and also tried a usb->wireless lan adapter and it also worked.

By now I'm pretty sure it has something to do with the network chipset/adapter.
My mainboard is a GA-Z77-D3H which is using an Atheros GbE LAN chip (AR8151).

Maybe someone in this thread with this issue has a similar mainboard/network chip?!

[Cathillach]

I have tried 0.14.10 and 0.14.11.

14.10 let me join the game and I didn't encounter the hanging at 100% bug but that may be because I only tried to join a game twice as Factorio was unplayable. Rubber banding and constant server not responding popups meant that I could not play at all.

14.11 did not let me join a game a single time. It constantly hung at 100%.

After both updates I had to go back to version 0.14.9 to be able to play at all.

A strange interaction that may or may not be related was that I tried joining the game on 0.14.9 and got the hang error 5 times in a row which was unusual. Everytime while downloading the map I clicked off the windowed factorio to browse the internet. The 6th time when I tried joining I stayed focused on Factorio and it let me join the game.

This is not the overall problem as I still get the hanging bug even if I stay focussed on Factorio. But it seems to increase the frequency.

[Rippie]

By now I'm pretty sure it has something to do with the network chipset/adapter.
My mainboard is a GA-Z77-D3H which is using an Atheros GbE LAN chip (AR8151).

Maybe someone in this thread with this issue has a similar mainboard/network chip?!

I own a Z87-G45 which has Killer ethernet.
The Killer ethernet is known to cause issues... I had to update the drivers recently because Steam's In-Home-Streaming did not detect anything.

[flonussi]

I own a Z87-G45 which has Killer ethernet.
The Killer ethernet is known to cause issues... I had to update the drivers recently because Steam's In-Home-Streaming did not detect anything.

I just looked up this "Killer Ethernet" and it seems that it is also a Qualcom Atheros chipset under the hood :-/ So I think we are on to something!

[Cathillach]

I have an Asus Maximus VIII Hero Motherboard that uses an Intel(R) Gigabit Ethernet Driver V20.2.4001.0 driver

[Rippie]

I have an Asus Maximus VIII Hero Motherboard that uses an Intel(R) Gigabit Ethernet Driver V20.2.4001.0 driver

Hmm, there goes our theory. You have stated that this happened when your friend hosted, and you try to join. Could you discover which ethernet adapter your friend uses? Maybe for you the issue is on the server's end.

After the 0.14.10 release I can make a special exe that does verbose logging for map download/map upload logic.

Any chance this is still happening?

[Arcania85]

I've had the same exact same problem when playing with a friend who lives in scotland, he was hosting.
the game was freshly started without mods.
The game would download very fast and when the bar hit 100% the speed would just decrease till it hit 0kb/sec and it got stuck.

my ISP is ziggo.
speedtest.net: http://www.speedtest.net/my-result/5684156863
TP-LINK TL-WDR4300-N750 draadloze dual-band gigabit router

hope its usefull

Edit: just happend again.
http://imgur.com/htO8cJc

Edit 2:
This happens when He is hosting the game, and he's on killer networks.
I'm currently hosting, and he could join immediatly.

this is his speedtest:
http://www.speedtest.net/my-result/5684292845

Log is down here

log

0.002 2016-10-03 19:10:54; Factorio 0.14.12 (build 24932, win64, steam)
0.002 Operating system: Windows 8.1
0.002 Not rotating logs.
0.002 Program arguments: "C:\Games\Steam\steamapps\common\Factorio\bin\x64\Factorio.exe"
0.002 Read data path: C:/Games/Steam/steamapps/common/Factorio/data
0.002 Write data path: C:/Users/User/AppData/Roaming/Factorio
0.002 Binaries path: C:/Games/Steam/steamapps/common/Factorio/bin
0.032 System info: [CPU: Intel(R) Core(TM) i7-3630QM CPU @ 2.40GHz, 8 cores, RAM: 16331MB]
0.033 Display options: [FullScreen: true] [VSync: false] [UIScale: 100%] [MultiSampling: OFF] [Screen: 255]
0.035 Available display adapters: 1
0.035 [0]: \\.\DISPLAY1 - NVIDIA GeForce GT 650M {0x05, [0,0], 1920x1080, 32bit, 60Hz}
0.036 Create display on adapter 0. Size 1280x720 at position [310, 162].
0.109 Initialised Direct3D:[0] NVIDIA GeForce GT 650M ; driver: nvd3dumx.dll 10.18.13.6519
0.111 Video memory size (dedicated video/dedicated system/shared system/available): 1985/0/2048/4026 MB
0.159 Device reset internal.
0.163 Desktop composition is active.
0.163 Graphics options: [Graphics quality: normal] [Video memory usage: high] [Light scale: 100%] [DXT: false]
0.289 Loading mod core 0.0.0 (data.lua)
0.296 Loading mod base 0.14.12 (data.lua)
0.471 Checksum for core: 1620335853
0.471 Checksum for mod base: 2833886813
1.064 Info PlayerData.cpp:55: Local player-data.json available, timestamp 1475514508
1.064 Info PlayerData.cpp:60: Cloud player-data.json available, timestamp 1474386659
1.275 Initial atlas bitmap size is 16384
1.278 Created atlas bitmap 16384x5589
1.860 Created atlas bitmap 4096x968
1.899 Created atlas bitmap 4096x3652
14.672 Sprites loaded
14.672 Convert atlas 4096x968 to: trilinear-filtering
14.725 Convert atlas 4096x3652 to: mipmap
15.533 Loading sounds...
17.767 Custom inputs active: 0
17.823 Factorio initialised
31.929 Info WindowsUDPSocket.cpp:61: Opening socket at port (0)
38.018 Info WindowsUDPSocket.cpp:161: Socket closed
38.019 Joining game 81.147.90.19:34197
38.019 Info WindowsUDPSocket.cpp:61: Opening socket at port (0)
38.020 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(Ready) to(Connecting)
38.079 Warning ClientRouter.cpp:115: Received NatPunch from 81.147.90.19:34197 as a client
38.131 Connection refused
38.132 Info ClientMultiplayerManager.cpp:177: Quitting multiplayer connection.
38.132 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(Connecting) to(Disconnected)
38.133 Info HttpSharedState.cpp:44: Downloading https://auth.factorio.com/generate-user-server-key
38.633 Info HttpSharedState.cpp:108: Status code: 200
38.633 Info AuthServerConnector.cpp:132: Received key(mVESiLbFko8LyKLkPCqtqg==) for username(Arcania85) from auth server.
38.634 Info WindowsUDPSocket.cpp:161: Socket closed
38.634 Joining game 81.147.90.19:34197
38.634 Info WindowsUDPSocket.cpp:61: Opening socket at port (0)
38.635 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(Ready) to(Connecting)
38.678 Warning ClientRouter.cpp:115: Received NatPunch from 81.147.90.19:34197 as a client
38.732 Connection refused
38.732 Info ClientMultiplayerManager.cpp:177: Quitting multiplayer connection.
38.732 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(Connecting) to(Disconnected)
38.735 Info WindowsUDPSocket.cpp:161: Socket closed
41.716 Joining game 81.147.90.19:34197
41.716 Info WindowsUDPSocket.cpp:61: Opening socket at port (0)
41.716 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(Ready) to(Connecting)
41.768 Warning ClientRouter.cpp:115: Received NatPunch from 81.147.90.19:34197 as a client
41.847 Info ClientSynchronizer.cpp:33: Initialized Synchronizer local peer(1) latency(32).
41.847 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(Connecting) to(ConnectedWaitingForMap)
41.847 Info ClientRouter.cpp:217: ConnectionAccepted
42.932 Info ClientMultiplayerManager.cpp:660: Received mapReadyForDownload
42.932 Downloading file C:\Users\User\AppData\Roaming\Factorio\temp\mp-download.zip (11203442 B, 22274 blocks)
42.934 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(ConnectedWaitingForMap) to(ConnectedDownloadingMap)
49.898 Info TransferTarget.cpp:280: TIMEOUT!
50.399 Info TransferTarget.cpp:280: TIMEOUT!
51.398 Info TransferTarget.cpp:280: TIMEOUT!
53.399 Info TransferTarget.cpp:280: TIMEOUT!
56.858 Info ClientMultiplayerManager.cpp:129: Disconnecting multiplayer connection.
56.858 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(ConnectedDownloadingMap) to(DisconnectScheduled)
56.882 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(DisconnectScheduled) to(WaitingForDisconnectConfirmation)
56.998 Info ClientMultiplayerManager.cpp:530: MapTick(-1) changing state from(WaitingForDisconnectConfirmation) to(Disconnected)
56.998 Info ClientMultiplayerManager.cpp:763: Disconnect notification for peer (2)
56.998 Info ClientSynchronizer.cpp:191: nextHeartbeatSequenceNumber(794943352) cannot process synchronizer action(MapDownloadingProgressUpdate)
57.002 Info WindowsUDPSocket.cpp:161: Socket closed
57.921 Steam API shutdown.
57.923 Goodbye

[Riverchimp]

I have an Asus Maximus VIII Hero Motherboard that uses an Intel(R) Gigabit Ethernet Driver V20.2.4001.0 driver

Hmm, there goes our theory. You have stated that this happened when your friend hosted, and you try to join. Could you discover which ethernet adapter your friend uses? Maybe for you the issue is on the server's end.

After the 0.14.10 release I can make a special exe that does verbose logging for map download/map upload logic.

Any chance this is still happening?

Cathillach is connecting to me. I have a Gigabyte G1.Sniper Z87 which has a Killer E2200.

[Rippie]

So the current "common thing" we all share is the ethernet adapter, e.g. Killer Ethernet E2200 (which is a Qualcomm Atheros AR8161 under the hood) and Atheros GbE LAN chip (AR8151).

To summarize from all the people that have reported the problem in this thread:
- Cathillach (Intel(R) Gigabit Ethernet) connects to a server hosted by Riverchimp (Killer Ethernet E2200 -> Qualcomm Atheros AR8161)
- Rippie has Killer Ethernet E2200 -> Qualcomm Atheros AR8161
- flonussi has Qualcomm Atheros AR8151 and is unable to connect to servers from both Windows and Linux. Installed USB network adapter (Asix AX88772B chipset), connected fine on both Windows and Linux.
- Arcania85 connects to a friend who has "killer networks" (Killer Ethernet? -> Qualcomm Atheros AR8161)
- nexyon connects to flonussi (Qualcomm Atheros AR8151)

For anyone else having this issue, please also post which ethernet adapter you have, and if you are playing with a friend please also mention his/her ethernet adapter.

All credits for pinpointing the ethernet adapter so far go to flonussi.

[Twinsen]

After the 0.14.10 release I can make a special exe that does verbose logging for map download/map upload logic.

Any chance this is still happening?

I'm exploring different solutions(including completely replacing the downloader code), so be patient. Also I'll be away for 2 weeks so this will be on hold unless someone takes over.

Meanwhile there was a minor fix in 0.14.13. From changelog "Fixed map downloader getting stuck and flooding the network after a big timeout.". Big timeout means 20 seconds. This will probably not fix this issue but let me know if it does.

[nexyon]

- flonussi has Qualcomm Atheros AR8151
- nexyon has ???

I was connecting to flonussi, he was connecting to me and both of us to a dedicated server. The issue definitely happens on the client no matter if the server or client has the faulty network chip.

[Rippie]

- flonussi has Qualcomm Atheros AR8151
- nexyon has ???

I was connecting to flonussi, he was connecting to me and both of us to a dedicated server. The issue definitely happens on the client no matter if the server or client has the faulty network chip.

Thanks, I updated the post.

Also, can anyone confirm if the issue still exists on 0.14.13? I have not had the time to test it.

[Cathillach]

The same hanging bug occurred to me last night in 0.14.13. Didn't have time to get the logs but if it happens again today then I will put up the log of it.

[Twinsen]

The map download algorithm was tweaked in Version 0.14.17.
Please test download speeds before/after and let me know if the 100% hang still persists.

[Rippie]

So I decided to have another go at Factorio multiplayer.
First server I tried to join, it happened again.
Map download speed reached up to 2MB/s.
Download again hanging at 100%.
Using version 0.14.19.
Log file attached.

[Twinsen]

So it was not fixed ...

I made an executable that will log lots of data related to the file transfers on the client side.
Copy the 2 files in your bin folder and run the game using factorio-run.exe

Every time you connect to do a test, do it on a fresh run of the game, so you get one separate log file per test.
Then upload the log(s) somewhere.(they could end up quite large).

Thanks for the help.

[Rippie]

I made an executable that will log lots of data related to the file transfers on the client side.
Copy the 2 files in your bin folder and run the game using factorio-run.exe

Thanks for supplying these!
Got the issue again, but Steam has updated Factorio to 0.14.20.
The executable now complains about the version mismatch 0.14.19 vs 0.14.20.

[Loewchen]

I made an executable that will log lots of data related to the file transfers on the client side.
Copy the 2 files in your bin folder and run the game using factorio-run.exe

Thanks for supplying these!
Got the issue again, but Steam has updated Factorio to 0.14.20.
The executable now complains about the version mismatch 0.14.19 vs 0.14.20.

You could roll back using the beta settings, see the update issue link in my signature.

[Smarty]

I made an executable that will log lots of data related to the file transfers on the client side.
Copy the 2 files in your bin folder and run the game using factorio-run.exe

Thanks for supplying these!
Got the issue again, but Steam has updated Factorio to 0.14.20.
The executable now complains about the version mismatch 0.14.19 vs 0.14.20.

You could roll back using the beta settings, see the update issue link in my signature.

the transfer logger twinsen made is for 0.14.19

[Twinsen]

Updated executable for 0.14.20, see above for instructions.