100MB+ map caused huge debug output

[darklich14]

I run on linux from a console and so I don't know if this is normal for other platforms, but I get a lot of log messages. I loaded a multiplayer game which appeared to have a 100MB+ map and the game essentially used all available ram (16GB here) and locked up. I ended up with a lot of this kind of output on the command line. My scrollback is 10k lines and it seems like it filled all 10k lines in less than a second (all timestamps are the same second, within half a second or so):

Code: Select all

1468.701 Info BlueprintLibrary.cpp:796: Player shelf: playerIndex = 2027, nextRecordID = 1; timestamp = 1519160848; records:
1468.701 Info BlueprintLibrary.cpp:796: Player shelf: playerIndex = 2028, nextRecordID = 51; timestamp = 1518117808; records: (id: 2028, 7; label: "", preview: true, empty: false; book [id: 2028, 8; label: "", preview: true, empty: true]) (id: 2028, 49; label: "Chernobyl Diaries", preview: false, empty: false; book [id: 2028, 24; label: "1.4 GW No Waste Dome  [WonderSpaceship]", preview: false, empty: false] [id: 2028, 25; label: "480 MW No Waste Square", preview: false, empty: false] [id: 2028, 26; label: "480 MW No Waste Rectangle", preview: false, empty: false] [id: 2028, 27; label: "480 MW No Waste Circle [WonderSpaceship]", preview: false, empty: false] [id: 2028, 28; label: "Half Connector

It just goes on and on and on and on. Unfortunately I can't tell how much there was because I had to kill the process, but 10k lines per half second seems a bit much! I'm not sure if that's what locked up the machine or if it was something else, but either way, maybe it's worth considering the verbosity of the logging there.

[Loewchen]

That is just content of a blueprint library, if a player has lots in it, it will be big. Post the complete log and the save please.

[quyxkh]

I pipe factorio through an awk which contains these two lines very near the start:

Code: Select all

/^Running/{next}
/^ *[0-9.]* Info (Blueprint|AppManager|AsyncScenarioSaver)/{next}

[Rseding91]

Thanks for the report. You appear to be running an older version of the game - that information isn't logged anymore in the latest experimental version of the game unless you have verbose logging enabled.

Regarding the memory usage: if you can upload the save file I can look at it.

[darklich14]

I wasn't able to reconnect to that server until now and now I got a crash rather than a lockup, so maybe that's better, maybe it's not:

Code: Select all

Factorio crashed. Generating symbolized stacktrace, please wait ...
#0  0x0000000000809540 in CrashHandler::writeStackTrace(CrashHandler::CrashReason) [clone .constprop.109762] at /tmp/factorio-VwM6F3/src/Util/CrashHandler.cpp:122
#1  0x00000000008099d4 in CrashHandler::SignalHandler(int) at /tmp/factorio-VwM6F3/src/Util/CrashHandler.cpp:389
#2  0x00007f28cd40c030 in ?? at ??:0
#3  0x0000000000b51aad in InputHandler::addListener(InputListener*) at /tmp/factorio-VwM6F3/src/Input/InputHandler.cpp:18
#4  0x0000000000e0f460 in Scenario::loadFactory(boost::filesystem::path const*, boost::filesystem::path const&, MapDeserialiser*, InputType, InputHandler*, MultiplayerManagerBase*, bool, ProgressObserver*, bool, InputListener*) [clone .constprop.115968] at /tmp/factorio-VwM6F3/src/Scenario/Scenario.cpp:243
#5  0x0000000000e109ea in ParallelScenarioLoader::doLoad(ParallelScenarioLoader*, MapDeserialiser*, InputType, InputHandler*, MultiplayerManagerBase*, bool) at /tmp/factorio-VwM6F3/src/Scenario/ParallelScenarioLoader.cpp:116
#6  0x00000000013aa470 in execute_native_thread_routine at ??:?
#7  0x00007f28cef7e494 in ?? at ??:0
#8  0x00007f28cd4c1aff in ?? at ??:0
 286.904 Error Util.cpp:80: Unexpected error occurred. If you're running the latest version of the game you can help us solve the problem by posting the contents of the log file on the Factorio forums.
Please also include the save file(s), any mods you may be using, and any steps you know of to reproduce the crash.

------------- Error -------------
Unexpected error occurred. If you're running the latest version of the game you can help us solve the problem by posting the contents of the log file on the Factorio forums.
Please also include the save file(s), any mods you may be using, and any steps you know of to reproduce the crash.

Log file location: /home/buddy/Downloads/factorio/factorio/factorio-current.log

Would you like to copy the path to the clipboard?
---------------------------------
 290.288 Error CrashHandler.cpp:387: Received SIGSEGV
Segmentation fault

I'm not sure I'll be able to get the save file since it crashed. I ran the binary again so it looks like the temp directory is gone now. Does the map download stick around anywhere?