UPS optimization - 100vs500 lanes (spoiler: 500 lanes results are more stable)

This board is to show, discuss and archive useful combinator- and logic-creations.
Smart triggering, counters and sensors, useful circuitry, switching as an art :), computers.
Please provide if possible always a blueprint of your creation.
Post Reply
Belter
Fast Inserter
Fast Inserter
Posts: 128
Joined: Sun Mar 14, 2021 12:38 pm
Contact:

UPS optimization - 100vs500 lanes (spoiler: 500 lanes results are more stable)

Post by Belter »

Problem
- Seeking for more stable benchmarking results I'd expect a bigger load to give more accurate results
- Like a smelting benchmark testing w/100 lanes (1000 UPS) vs w/500 lanes (160 UPS): 500 lanes should be better
Test
- I took 3 blueprints and ran them 5 x 25.000 ticks for each (see this interesing thread about smelting opt)
- Turned off running apps and let it run alone, using Win10 and an old i5 CPU
Results
- 500 lanes tests give better accuracy and separates the results a bit better from each other
- I recommend scaling the benchmarks to the 100 UPS range instead of 1000 UPS to have more reliable results
Details
- Some calculations 500 lanes/100 lanes follow:
- UPS Max difference in Avg UPS withing the 5 runs of the same BP: 0.77% / 1.39% (smaller is better. 500 wins)
- UPS difference between the avg UPS between the different BPs: 4.75% / 3.24% (higher is better, 500 wins)
- Y axis: marks are set to 1% - hence the odd numbers. The 1% yellow rectangle is accurate this time
Attachments
UPS-500.png
UPS-500.png (67.26 KiB) Viewed 829 times
UPS-100.png
UPS-100.png (69.66 KiB) Viewed 829 times
B002 results.csv
(3.25 KiB) Downloaded 139 times
B002 Saves.zip
(19.02 MiB) Downloaded 170 times

Tallywort
Burner Inserter
Burner Inserter
Posts: 13
Joined: Thu Mar 25, 2021 11:57 am
Contact:

Re: UPS optimization - 100vs500 lanes (spoiler: 500 lanes results are more stable)

Post by Tallywort »

Interesting, though I wonder how those test results stack up if you take into account that you could run that 100 lane test 6 times longer than the 500 lane one.

User avatar
Khagan
Fast Inserter
Fast Inserter
Posts: 141
Joined: Mon Mar 25, 2019 9:40 pm
Contact:

Re: UPS optimization - 100vs500 lanes (spoiler: 500 lanes results are more stable)

Post by Khagan »

Tallywort wrote:
Thu Feb 24, 2022 1:17 am
I wonder how those test results stack up if you take into account that you could run that 100 lane test 6 times longer than the 500 lane one.
This assumes that Factorio is ergodic. :ugeek:

Tallywort
Burner Inserter
Burner Inserter
Posts: 13
Joined: Thu Mar 25, 2021 11:57 am
Contact:

Re: UPS optimization - 100vs500 lanes (spoiler: 500 lanes results are more stable)

Post by Tallywort »

How is the system we're looking at non-ergodic? We can get nice means out of it, AND expect those means to be the same between tests.

If the system were non-ergodic, what even are we measuring?

User avatar
Khagan
Fast Inserter
Fast Inserter
Posts: 141
Joined: Mon Mar 25, 2019 9:40 pm
Contact:

Re: UPS optimization - 100vs500 lanes (spoiler: 500 lanes results are more stable)

Post by Khagan »

Tallywort wrote:
Mon Feb 28, 2022 8:30 am
How is the system we're looking at non-ergodic?
I fear you are taking my tongue-in-cheek comment more seriously than intended.

The assumption of ergodicity is entirely reasonable. Major mathematical kudos if you can actually prove it ...

Post Reply

Return to “Combinator Creations”