[0.17.5] huge about 10 second lag every few minutes fps and ups drops to around 30 then goes back up

[factoriouzr]

This has been happening since the release of 0.17.0. Every few minutes the game slows town and fps and ups drops to about 30 for about 10 seconds then goes back up.

OS: Windows 7 64 bit 32 GB ram.
Graphics GeForce GTX 970

[Rseding91]

Thanks for the report however without a save file and steps to reproduce the problem there's nothing we can do.

[brunzenstein]

This has been happening since the release of 0.17.0. Every few minutes the game slows town and fps and ups drops to about 30 for about 10 seconds then goes back up.

OS: Windows 7 64 bit 32 GB ram.
Graphics GeForce GTX 970

Same for a high end equipped MacBook Pro

[luc3k]

I was seeing same thing yesterday.
It was a 3h gameplay. Straight from 0.17.6 after migrating save from 0.17.5. I have 8th gen i7 and GeForce GTX 1050 TI. It was not happening at the start. It was visible after some time. It is hard to say when, first I was thinking that this is because of auto save. But then I was standing in the same place as in save and it was going like:
FPS/UPS=60/60
FPS/UPS=30/60 (stays like this, visible lag)
FPS/UPS=60/60
FPS/UPS=30/45 (ups drop too after some time)
FPS/UPS=60/60
FPS/UPS=30/60
and so on

https://www.dropbox.com/s/q86sp0bk4e6oh ... s.zip?dl=0

Edit:
I was able to reproduce this on above save. New info:
Yesterday and Today I was playing in window mode.
Today it is happening after 10-15 minutes every 2 minutes but it is around 1 second lag. My guess is that after let say 3h it simply take longer. Its exponential or so. I was simply standing/doing nothing.

Log:

Code: Select all

0.002 2019-03-06 08:20:49; Factorio 0.17.6 (build 43339, win64, alpha)
   0.002 Operating system: Windows 10 (version 1803) 
   0.002 Program arguments: "D:\Program Files\Factorio\bin\x64\factorio.exe" 
   0.002 Read data path: D:/Program Files/Factorio/data
   0.002 Write data path: C:/Users/lucek/AppData/Roaming/Factorio [42640/121624MB]
   0.002 Binaries path: D:/Program Files/Factorio/bin
   0.047 System info: [CPU: Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz, 12 cores, RAM: 4978/8036 MB, page: 12163/18788 MB, virtual: 4254/134217727 MB, extended virtual: 0 MB]
   0.047 Display options: [FullScreen: 0] [VSync: 1] [UIScale: custom (100.0%)] [MultiSampling: OFF] [Screen: 255] [Lang: en]
   0.059 Available displays: 1
   0.059  [0]: \\.\DISPLAY1 - Intel(R) UHD Graphics 630 {0x05, [0,0], 1920x1080, 32bit, 60Hz}
   0.323 [Direct3D11] Display: 0, Output: 0, DisplayAdapter: 0, RenderingAdapter: 0; d3dcompiler_47.dll
   1.185 Initialised Direct3D[0]: NVIDIA GeForce GTX 1050 Ti with Max-Q Design (10de-1c8f); driver: nvldumdx.dll 24.21.13.9921
   1.185   D3D Feature Level: 11.1, DXGI 1.5+
   1.185   [Local Video Memory] Budget: 3417MB, CurrentUsage: 1MB, Reservation: 0/1809MB
   1.185   [Non-Local Vid.Mem.] Budget: 3616MB, CurrentUsage: 0MB, Reservation: 0/1908MB
   1.185   Tiled resources: Tier 2
   1.185   Unified Memory Architecture: No
   1.185   BGR 565 Supported: Yes
   1.185   MaximumFrameLatency: 3, GPUThreadPriority: 0
   1.290 Desktop composition is active.
   1.290 Graphics settings preset: very-high
   1.290   Dedicated video memory size 4021 MB
   1.290 Graphics options: [Graphics quality: high] [Video memory usage: all] [Light scale: 25%] [DXT: high-quality]
   1.290                   [Max load threads: 32] [Max texture size: 0] [Tex.Stream.: 0] [Low quality rotation: 0]
   1.576 DSound: Starting _dsound_update thread
   1.577 DSound: Enter _dsound_update; tid=15632
   1.739 Loading mod core 0.0.0 (data.lua)
   1.853 Loading mod base 0.17.6 (data.lua)
   2.485 Loading mod base 0.17.6 (data-updates.lua)
   2.580 Checksum for core: 2038926808
   2.580 Checksum of base: 3541142062
   3.088 Loading sounds...
   5.186 Info PlayerData.cpp:67: Local player-data.json available, timestamp 1551856611
   5.186 Info PlayerData.cpp:74: Cloud player-data.json unavailable
   5.411 Initial atlas bitmap size is 16384
   5.436 Created atlas bitmap 16384x16384 [none]
   5.439 Created atlas bitmap 16384x11296 [none]
   5.440 Created atlas bitmap 16384x2116 [decal]
   5.441 Created atlas bitmap 16384x3808 [low-object]
   5.441 Created atlas bitmap 16384x1888 [mipmap, linear-minification, linear-magnification, linear-mip-level, no-crop, no-scale]
   5.442 Created atlas bitmap 16384x6880 [terrain, mipmap, linear-minification, linear-mip-level, no-crop]
   5.442 Created atlas bitmap 16384x480 [smoke, mipmap, linear-minification, linear-magnification]
   5.442 Created atlas bitmap 16384x456 [not-compressed, mipmap, linear-minification, linear-magnification, linear-mip-level, no-crop, no-scale]
   5.443 Created atlas bitmap 16384x748 [alpha-mask]
   5.445 Created atlas bitmap 16384x12640 [shadow, linear-magnification, alpha-mask]
   5.445 Created atlas bitmap 16384x1264 [shadow, mipmap, linear-magnification, alpha-mask]
   5.450 Texture processor created. GPU accelerated compression Supported: yes, Enabled: yes/yes. Test passed. YCoCgDXT PSNR: 35.83, BC3 PSNR: 33.82
  43.467 Parallel Sprite Loader initialized (threads: 5)
  53.411 Sprites loaded
  53.630 Generated mipmaps for atlas of size 16384x3808
  53.673 Generated mipmaps for atlas of size 16384x1888
  53.707 Generated mipmaps for atlas of size 16384x6880
  53.729 Generated mipmaps for atlas of size 16384x480
  53.751 Generated mipmaps for atlas of size 16384x456
  53.763 Generated mipmaps for atlas of size 16384x1264
  53.948 Custom inputs active: 0
  54.301 Factorio initialised
  54.347 Info HttpSharedState.cpp:54: Downloading https://updater.factorio.com/updater/get-available-versions?username=luc3k&token=<private>&apiVersion=2
  55.460 Info HttpSharedState.cpp:147: Status code: 200
  55.464 0 packages available to download (experimental updates disabled).
 119.358 Loading map C:\Users\lucek\AppData\Roaming\Factorio\saves\no_enemy_many_resources.zip: 8691227 bytes.
 119.576 Loading Level.dat: 16606416 bytes.
 119.592 Info Scenario.cpp:147: Map version 0.17.6-1
 120.376 Loading script.dat: 328 bytes.
 120.416 Checksum for script C:/Users/lucek/AppData/Roaming/Factorio/temp/currently-playing/control.lua: 1848333929
 487.842 Info AppManager.cpp:267: Saving to _autosave3 (blocking).
 488.389 Info AppManagerStates.cpp:1766: Saving finished
 857.716 Info AppManager.cpp:267: Saving to _autosave1 (blocking).
 858.299 Info AppManagerStates.cpp:1766: Saving finished
1061.462 Quitting: user-quit.
1061.602 DSound: Stopping voice
1061.602 DSound: Joining thread
1061.605 DSound: Exit _dsound_update; tid=15632
1061.605 DSound: Waiting for voice to stop ... signaled
1061.606 DSound: Joined thread
1061.606 DSound: Destroying thread
1061.606 DSound: Thread destroyed
1061.606 DSound: Releasing buffer
1061.606 DSound: Voice stopped
1061.606 DSound: Deallocating voice
1061.606 DSound: Deallocated voice
1061.632 Goodbye

Screenshots based on viewtopic.php?f=7&t=3638#p299295 are in attachments.


Edit:
This is still an issue for me on 0.17.8.
If you need some more/different data please let me know.

[factoriouzr]

Any update on this? Is this being worked on. It's a huge issue and it's still happening frequently on 0.17.14. The latest 0.16 was working perfectly without these slowdowns.

[Rseding91]

Any update on this? Is this being worked on. It's a huge issue and it's still happening frequently on 0.17.14. The latest 0.16 was working perfectly without these slowdowns.

As I said: without a save and steps to reproduce *from you* there's nothing I can do.

[factoriouzr]

Any update on this? Is this being worked on. It's a huge issue and it's still happening frequently on 0.17.14. The latest 0.16 was working perfectly without these slowdowns.

As I said: without a save and steps to reproduce *from you* there's nothing I can do.

Can you not see the post back from Wed Mar 06, 2019 2:06 am by luc3k? that was 11 days ago and he was kind enough to provide the screenshots, detailed stats and a save. You have had everything you need for 11 days.

[Rseding91]

Any update on this? Is this being worked on. It's a huge issue and it's still happening frequently on 0.17.14. The latest 0.16 was working perfectly without these slowdowns.

As I said: without a save and steps to reproduce *from you* there's nothing I can do.

Can you not see the post back from Wed Mar 06, 2019 2:06 am by luc3k? that was 11 days ago and he was kind enough to provide the screenshots, detailed stats and a save. You have had everything you need for 11 days.

His system and his save file are completely unrelated to your system and your save file. The reason his game runs slow is he's using an integrated intel GPU to run the game - which has no dedicated video memory and an incredibly tiny amount of GPU power to render with - way below minimum system requirements for Factorio.

[luc3k]

I disagree. But if I am not right you could point me to report another issue. I have 2 graphic cards. 1 integrated and second is dedicated, from log:
1.185 Initialised Direct3D[0]: NVIDIA GeForce GTX 1050 Ti with Max-Q Design (10de-1c8f); driver: nvldumdx.dll 24.21.13.9921

I have exact same problem. Also on 0.17.14. I am able to run games like Witcher 3 in almost max setup. I cant agree that I do not meet minimum requirements.

Also from the log:
1.290 Dedicated video memory size 4021 MB

I am not sure if somebody actually was looking at my log file...

also to be clear:
the game is not running slow for me. It is running for 90% of the time as 60/60 fps/ups then afer some time it is going back to 30/60 and then back to 60/60 as stated in first comment. After really long plays it looks like after some time it is happening more often. From the screenshoot I can confirm that "flip[on]" and "frame" are going up at the same time when this problem is happening.

So again, sad to write this but It looks like nobody was looking carefully at what I uploaded or wrote here. Also I mentioned that I can do more to help.

[factoriouzr]

Any update on this? Is this being worked on. It's a huge issue and it's still happening frequently on 0.17.14. The latest 0.16 was working perfectly without these slowdowns.

As I said: without a save and steps to reproduce *from you* there's nothing I can do.

Can you not see the post back from Wed Mar 06, 2019 2:06 am by luc3k? that was 11 days ago and he was kind enough to provide the screenshots, detailed stats and a save. You have had everything you need for 11 days.

His system and his save file are completely unrelated to your system and your save file. The reason his game runs slow is he's using an integrated intel GPU to run the game - which has no dedicated video memory and an incredibly tiny amount of GPU power to render with - way below minimum system requirements for Factorio.

I'm not sure how providing another save would help.

It seems luc3k is having the exact same problem I am.

You will presumably take the save we provide and run it on a machine you have in the office. Well the specs of that machine will almost certainly be different then both of our machines, so that invalidates the need for a different save it would seem as your specs will be different then ours regardless.

Keep in mind as well that this problem did not occur in the latest 0.16 and on top of that we both can run the game at 60/60 fps/ups constantly except for frequent and it seems very regular dips at almost the exact same frequency for what seems like about the same time of 10 seconds or so each time it happens. This to me suggests you have a process running in the background periodically that takes up a lot of processing power. For eg. maybe you have a garbage collector, a cleanup task, or a longer running task that calculates something for the game (biter paths perhaps, or something else), a task related to your new graphics pipeline perhaps, or the new fluid calculation, etc.

[factoriouzr]

I disagree. But if I am not right you could point me to report another issue. I have 2 graphic cards. 1 integrated and second is dedicated, from log:
1.185 Initialised Direct3D[0]: NVIDIA GeForce GTX 1050 Ti with Max-Q Design (10de-1c8f); driver: nvldumdx.dll 24.21.13.9921

I have exact same problem. Also on 0.17.14. I am able to run games like Witcher 3 in almost max setup. I cant agree that I do not meet minimum requirements.

Also from the log:
1.290 Dedicated video memory size 4021 MB

I am not sure if somebody actually was looking at my log file...

also to be clear:
the game is not running slow for me. It is running for 90% of the time as 60/60 fps/ups then afer some time it is going back to 30/60 and then back to 60/60 as stated in first comment. After really long plays it looks like after some time it is happening more often. From the screenshoot I can confirm that "flip[on]" and "frame" are going up at the same time when this problem is happening.

So again, sad to write this but It looks like nobody was looking carefully at what I uploaded or wrote here. Also I mentioned that I can do more to help.

I also tried to look at the debug in game when this was happening and I saw the frame going up as well when the slowdown happened.

I'm actually quite disappointed how this issue was completely ignored given how we provided the information you requested. I didn't have the time to do it back then, and I am grateful that you luc3k, provided it.

I thought this issue was being looked at as there was no comment from the devs for more information until I asked about it's status again. This is a serious issue that is obviously not an isolated issue, you had all the information you asked for and it's just disappointing that the issue was completely ignored. It's also obviously an issue introduced in 0.17 as I (and I'm quite sure luc3k) didn't have this issue on the latest 0.16. Another reason for more frequent releases I guess (something we, the players have been asking for, and mind you was promised by the devs over a year ago).

[TruePikachu]

You will presumably take the save we provide and run it on a machine you have in the office. Well the specs of that machine will almost certainly be different then both of our machines, so that invalidates the need for a different save it would seem as your specs will be different then ours regardless.

Actually, if the issue is due to part of the game (e.g. biter pathfinding code), while they won't experience the same degree of slowdown as you, there will still be enough of a slowdown that such an issue can really stand out. Even if the game itself continues to run at 60FPS/60UPS, the amount of time it took to process some update will be magnitudes larger than the surrounding updates -- a major warning flag that there's an issue somewhere.



If the issue is not game-code related, my first guess would be a background service (and my first guess of those would be Superfetch, assuming Windows).

[Bilka]

In the second screenshot posted by luc3k, you have an abnormally high flip time. Try turning off vsync.

Without anything to go from by factoriouzr (no log, no save, no screenshots), there is no way for me to provide any kind of advice for them how to work around the issue.

Note: I am not qualified to fix anything that might cause this from our side, I can only provide advice.

[luc3k]

Rseding91, Bilka should I create new post in that case if I am the only one giving some logs, saves etc.?

Some more notes based on suggestions:
I didnt change my setup, so still window mode etc. I was using different save. This time scenario was sandbox, doing nothing, full cheat (or almost full, not sure) mode 12 hours map. Same thing. The issue was happening every 5 minutes. I tested this for 20 minutes. First occurance after 5 minutes,second after another 5, etc. Then I changed the settings: Wait for VSync from on to off. I noticed change in debug from Flip[on] to Flip[off].

When Flip[on] it was going around 6-11, when the problem was happening it was around 23-25. (I am talking about Flip[on] value here)
When Flip[off] it was around 1-2. It was looking fine.

Also this is not so visible at start. After long plays it is more visible and it is happening more often than every 5 minutes and longer (I was not seeing 10 seconds lags, but 5 seconds for sure). The game is playable, it simply drops fps from 60 to 30. After some time that 5 minutes mark was not consistent also.

So if that option is the case here and the solution/fix then great.

Also that 5 minutes mark at srat might have something to do with background processes but in that case nothing unusual is happening on my machine. Simply saying that I can live with it if this my laptop/OS problem.

There is a night for me here so no more info. If needed I can check this also on fullscreen with both "wait for VSync" values (on/off).

Game is installed on HDD. Saves are in default user directory on SDD.

Fans are not doing any noise so cpu or gpu are fine. I can run factorio and multiple different things that are eating my cpu or memory but game is running fine except that issue every few minutes with fps droping.

I think this has nothing to do with particular save.

[denebarry]

I have exactly the same problem as these guys. All symptoms are the same. Similar systems. What can I do to assist.

[Zavian]

I have exactly the same problem as these guys. All symptoms are the same. Similar systems. What can I do to assist.

I recommand providing all of the info requested in viewtopic.php?f=7&t=3638#p299295.

[Bilka]

Rseding91, Bilka should I create new post in that case if I am the only one giving some logs, saves etc.?

So if that option is the case here and the solution/fix then great.

So, if I understand correctly, turning of V-sync solves the issue? In that case, I don't think we need more info from you, it sounds like a simple user configuration problem. (Though there is really no reason for v-sync to wait so long for the next frame, it could wait < 16ms to stay at 60FPS, yet it waits > 16ms to stay at 30FPS. But like I said, me = no graphics dev :P). One thing that might be relevant is whether you have a g-sync monitor - posila asks about it in a similar thread here: 66602

[denebarry]

The big question is, what changed? I had no issues at all with 0.16 right up to 1000 spm.

[luc3k]

I do not have g-sync monitor. This is on laptop integrated display. Also I cant test this on any monitor to be clear. Only that setup.
I didnt turn off vsync globally in my laptop. My NVIDIA setup is set to use settings from the 3D application. In that case it is Factorio. So I only changed "Wait for VSync" inside Factorio. I cant test full screen now (I am at work) but also maybe that window mode is a problem here on my end. Also it was not happening on 0.16 at all. I didnt change "wait for Vsync" ever on 0.16 (actually I do not know if that feature ever existed in 0.16). I am playing in window mode to simply alt+tab fast or do something else during playing.

Later (not sure if Today) I want to check this case with "wait for Vsync" off and playing longer and as close as possible to my normal gameplay. Currently all my tries to reproduce this were only straight from the start and I am not sure how it will work after 1-2 hours of gameplay.

Also as I said in most cases it looks very consistant. Drop is always to 30, every paricular amount of minutes. If you need I can even check this with stopwatch. It looks like 5 minutes or 300 seconds. So basically at fresh run it looks like: consistent 60/60 for 5 minutes and then drop to 30/60 for 1-5 seconds or so. Then back to 60/60 for another 5 minutes and again drop to 30/60 for 1-5 seconds.

[Rseding91]

The big question is, what changed? I had no issues at all with 0.16 right up to 1000 spm.

More high resolution sprites/more sprites in general, a completely new graphics engine, the default graphics settings - pretty much everything graphics wise changed with 0.17.