Combining, Splitting, and Balancing Large Numbers of Belts

Post your ideas and suggestions how to improve the game.

Moderator: ickputzdirwech

User avatar
Therax
Filter Inserter
Filter Inserter
Posts: 471
Joined: Sun May 21, 2017 6:28 pm
Contact:

Re: Wide Splitter (3 belt splitter)

Post by Therax »

eradicator wrote:
Therax wrote:As far as I can tell from my testing, Factorio uses the collision box only to determine which tiles the entity covers. Setting a tiny collision box on one side of the tile and pointing the inserter pickup/drop_position to the opposite side of the tile will still frequently result in the loader being selected as the pickup/drop target.
This makes me very sad :|. I guess you tried spawning them in in the "right" order? Or do they reselect new targets even after being built? (And what about if the loader wasn't active when the inserter is placed...)
I think i'm down to wild guessing.
So it turns out that "internal iteration order" isn't strictly build order once you start mixing building and mining. I think there are internal structures where slots are opened up when entities are destroyed, and the first empty slot is used when building, so it's not possible to reliably build things in the "right" order to get the desired behavior.
Let's hope Therax at least succeeds in making the splitter :).
If my interface request isn't implemented, your loader-based version would probably be more than sufficient for the OP's purposes. :)
Miniloader — UPS-friendly 1x1 loaders
Bulk Rail Loaders — Rapid train loading and unloading
Beltlayer & Pipelayer — Route items and fluids freely underground
User avatar
eradicator
Smart Inserter
Smart Inserter
Posts: 5207
Joined: Tue Jul 12, 2016 9:03 am
Contact:

Re: Wide Splitter (3 belt splitter)

Post by eradicator »

Therax wrote:So it turns out that "internal iteration order" isn't strictly build order once you start mixing building and mining. I think there are internal structures where slots are opened up when entities are destroyed, and the first empty slot is used when building, so it's not possible to reliably build things in the "right" order to get the desired behavior.
As long as the internal order doesn't change later on you can brute-force it.
  1. Build all the things you need for the complete structure. This will "reserve" the slots you need.
  2. Destroy them all.
  3. Rebuild them in the correct order.
Though...if that approach worked it should really work in step one already.
And a slot-based system kinda doesn't sound like a good internal structure. Didn't they say it was a ring in some ancient FFF? If they only purge empty "slots" from the ring once a tick that might still behave as you observed i guess.

My loader based cross-splitter does have some benefits yea. Amongst all...it's easy to implement :p.
At least if you don't want a custom 4-way filter gui. Or multi-item support. If you use an unfiltered chest: Imagine if you have a two sided ore belt coming in. Now you filter ore1 north and ore2 south. But if ore1 isn't used at the same rate as ore2 one of them will fill up the internal buffer and eventually block all transfer.
screenshot_11620.png
screenshot_11620.png (213.85 KiB) Viewed 6143 times
Author of: Belt Planner, Hand Crank Generator, Screenshot Maker, /sudo and more.
Mod support languages: 日本語, Deutsch, English
My code in the post above is dedicated to the public domain under CC0.
User avatar
eradicator
Smart Inserter
Smart Inserter
Posts: 5207
Joined: Tue Jul 12, 2016 9:03 am
Contact:

Re: Wide Splitter (3 belt splitter)

Post by eradicator »

So. After testing many things i've come to the conclusion that 1x1, 3x1, or anything else with width Nx1 seems to be unfeasible. 3x2 or 3x3 might still be possible.
Did anyone else have more success?
Author of: Belt Planner, Hand Crank Generator, Screenshot Maker, /sudo and more.
Mod support languages: 日本語, Deutsch, English
My code in the post above is dedicated to the public domain under CC0.
User avatar
eradicator
Smart Inserter
Smart Inserter
Posts: 5207
Joined: Tue Jul 12, 2016 9:03 am
Contact:

Re: Wide Splitter (3 belt splitter)

Post by eradicator »

I think i've found a diamond on the bottom of a lake of despair. It's pretty dirty and looks fragile, so i hope it doesn't break during polishing. Because it'll need a lot of polishing. Does not use on_tick, and works somewhat like a normal splitter (except filtering is required not optional, and priority is impossible).
loop.gif
loop.gif (1.01 MiB) Viewed 5851 times
Author of: Belt Planner, Hand Crank Generator, Screenshot Maker, /sudo and more.
Mod support languages: 日本語, Deutsch, English
My code in the post above is dedicated to the public domain under CC0.
User avatar
Therax
Filter Inserter
Filter Inserter
Posts: 471
Joined: Sun May 21, 2017 6:28 pm
Contact:

Re: Wide Splitter (3 belt splitter)

Post by Therax »

eradicator wrote: As long as the internal order doesn't change later on you can brute-force it.
  1. Build all the things you need for the complete structure. This will "reserve" the slots you need.
  2. Destroy them all.
  3. Rebuild them in the correct order.
Though...if that approach worked it should really work in step one already.
Unfortunately I don't think this will work because as soon as you build an entity in a pickup/drop location, it is immediately "adopted" by the inserter as its pickup/target. So for this use case in particular, where there are 3 inserters, a chest, and two loaders in the same tile, whichever is built last becomes both pickup and drop target for every inserter.
eradicator wrote:And a slot-based system kinda doesn't sound like a good internal structure. Didn't they say it was a ring in some ancient FFF? If they only purge empty "slots" from the ring once a tick that might still behave as you observed i guess.
It's fairly common to have such a ring have each segment of the ring contain multiple items, to amortize the cost of managing the ring structure. I.e., if you need more room, you allocate an array of 32 slots, and put that into the ring, and then you can track another 31 objects before another allocation and insertion into the ring is required. I'm just speculating though.
[quote="eradicator"If you use an unfiltered chest: Imagine if you have a two sided ore belt coming in. Now you filter ore1 north and ore2 south. But if ore1 isn't used at the same rate as ore2 one of them will fill up the internal buffer and eventually block all transfer.
[/quote]
eradicator wrote:filtering is required not optional
How are you getting around the backlog problem? Are you using a car entity to get filtered inventory slots?
Miniloader — UPS-friendly 1x1 loaders
Bulk Rail Loaders — Rapid train loading and unloading
Beltlayer & Pipelayer — Route items and fluids freely underground
User avatar
eradicator
Smart Inserter
Smart Inserter
Posts: 5207
Joined: Tue Jul 12, 2016 9:03 am
Contact:

Re: Wide Splitter (3 belt splitter)

Post by eradicator »

Therax wrote:
eradicator wrote:filtering is required not optional
How are you getting around the backlog problem? Are you using a car entity to get filtered inventory slots?
Over all the things i tried i actually forgot about cars in the middle of it all. Also i read somewhere that cars are significantly (more than factor 100(?)) more expensive than chests. So for now it uses ordered construction. But i've already hit some weird throughput problems which may force me to make the thing wider than 1 tile. So i'll definetly give cars a try.

Can anyone explain to me how exactly performance testing works? @Optera had those "this vs that" for x ticks numbers.
Author of: Belt Planner, Hand Crank Generator, Screenshot Maker, /sudo and more.
Mod support languages: 日本語, Deutsch, English
My code in the post above is dedicated to the public domain under CC0.
User avatar
Therax
Filter Inserter
Filter Inserter
Posts: 471
Joined: Sun May 21, 2017 6:28 pm
Contact:

Re: Wide Splitter (3 belt splitter)

Post by Therax »

eradicator wrote:Can anyone explain to me how exactly performance testing works? @Optera had those "this vs that" for x ticks numbers.
The only access to real time is via log() messages, so the basic technique is something like

Code: Select all

game.speed=10000 -- run as fast as possible
script.on_nth_tick(10000, function() log("--- MARK ---") end)
Then in factorio-current.log you'll see the succession of these log lines with their timestamps, which tells you how long it took to process 10000 ticks worth of game time in real time.
Miniloader — UPS-friendly 1x1 loaders
Bulk Rail Loaders — Rapid train loading and unloading
Beltlayer & Pipelayer — Route items and fluids freely underground
User avatar
Optera
Smart Inserter
Smart Inserter
Posts: 2920
Joined: Sat Jun 11, 2016 6:41 am
Contact:

Re: Wide Splitter (3 belt splitter)

Post by Optera »

eradicator wrote:Can anyone explain to me how exactly performance testing works? @Optera had those "this vs that" for x ticks numbers.
Make a savegame and start factorio.exe with parameters --benchmark "%SaveFile%" --benchmark-ticks 10000

I made a batch file writing several passes of the same save to a logfile. Then I manually pick the times and normalize them to filter out noise from background activity.

Code: Select all

set FactorioPath=D:\Factorio_0.16
set SaveFile=bench_save.zip
"%FactorioPath%\bin\x64\Factorio.exe" --mod-directory "%FactorioPath%\mods" --disable-audio --benchmark "%SaveFile%" --benchmark-ticks 10000 >> "%FactorioPath%\Bench 10k - %SaveFile%.log" 2>&1
"%FactorioPath%\bin\x64\Factorio.exe" --mod-directory "%FactorioPath%\mods" --disable-audio --benchmark "%SaveFile%" --benchmark-ticks 10000 >> "%FactorioPath%\Bench 10k - %SaveFile%.log" 2>&1
"%FactorioPath%\bin\x64\Factorio.exe" --mod-directory "%FactorioPath%\mods" --disable-audio --benchmark "%SaveFile%" --benchmark-ticks 10000 >> "%FactorioPath%\Bench 10k - %SaveFile%.log" 2>&1
"%FactorioPath%\bin\x64\Factorio.exe" --mod-directory "%FactorioPath%\mods" --disable-audio --benchmark "%SaveFile%" --benchmark-ticks 10000 >> "%FactorioPath%\Bench 10k - %SaveFile%.log" 2>&1
"%FactorioPath%\bin\x64\Factorio.exe" --mod-directory "%FactorioPath%\mods" --disable-audio --benchmark "%SaveFile%" --benchmark-ticks 10000 >> "%FactorioPath%\Bench 10k - %SaveFile%.log" 2>&1
if you don't know what the pipes mean
>> redirect stdout to a gven file in append mode
2>&1 redirects stderr to stdout
VisualCSharp
Manual Inserter
Manual Inserter
Posts: 2
Joined: Wed Dec 19, 2018 1:37 am
Contact:

New item: Balancer (or Combiner)

Post by VisualCSharp »

Hey, all. First of all, I built a new gaming rig just to play this game, so you can tell how excited I am about it! Factorio is awesome and is my new addiction. However, I am noticing one huge quality-of-life issue with the game: balancing lanes and gigantic balancer designs.

I realize that balancer designs are impressive feats of in-game engineering, but to me they are a huge time-waster and expensive resource sink, making my base needlessly large and my bus super drawn-out to accommodate the balancer designs. In my opinion, this could all be simplified by introducing a new item: the Balancer.

https://imgur.com/a/Msut7R3

Here's how it works: The Balancer is a 1x1 item that can be placed anywhere and acts the same as a Splitter in that it has an input and an output. However, the big difference between the Balancer and the Splitter is that Balancers can be placed next to each other and work in concert as a result. Additionally, the player can click the arrows you see in the image (or via some other appropriate mechanism) to turn on and off inputting and outputting from the associated lane. This allows any number of input lanes to balance to any number of output lanes.

Balancers also have an additional mode when in 1x1 configuration: balancing a single lane.

https://imgur.com/a/UgXmaD2

For 1x1 balancing, each belt lane could be balanced independently, or, if that is too complex, the Balancer could simply balance the two lanes' contents. Theoretically (although the UX for this might be far too cumbersome), one could go as far as assigning individual lanes on all input belts to split to specific output lanes on output belts. It's all a matter of how far the developer would want to take the idea.

I realize this would fundamentally alter an aspect of gameplay loved by many, but for me, lane balancing is a real pain and definitely detracts from my enjoyment of the game. I think such an item makes sense in the "lore" of Factorio when you consider that Splitters already sort-of accomplish the opposite function. Balancers can also be thought of as "Combiners" if that makes more sense.

Curious to hear everyone's thoughts.
Koub
Global Moderator
Global Moderator
Posts: 7784
Joined: Fri May 30, 2014 8:54 am
Contact:

Re: New item: Balancer (or Combiner)

Post by Koub »

More or less like this : https://mods.factorio.com/mods/msu320/compoundsplitters ?
Also [Koub] Merged into older topic with similar/same suggestion
Koub - Please consider English is not my native language.
Hannu
Filter Inserter
Filter Inserter
Posts: 850
Joined: Thu Apr 28, 2016 6:27 am
Contact:

Re: New item: Balancer (or Combiner)

Post by Hannu »

VisualCSharp wrote: Wed Dec 19, 2018 2:02 am I realize this would fundamentally alter an aspect of gameplay loved by many, but for me, lane balancing is a real pain and definitely detracts from my enjoyment of the game
Devs have rejected many times this kind of ideas. Factorio's core philosophy is to build complex things from simple standard blocks.

What if you just do not balance your lines, if you hate to build it? In most situations there is not technical reason to balance and priority splitters gives better, simpler and cheaper options to handle many belt buses. Assemblers and furnaces do not care if some of them work more than others at partial load situations. Those huge balancers are mostly aesthetic things and I think most of players who use them would not like simple trivial solution. It is nice to watch how material flows through a complex balancer.
VisualCSharp
Manual Inserter
Manual Inserter
Posts: 2
Joined: Wed Dec 19, 2018 1:37 am
Contact:

Re: New item: Balancer (or Combiner)

Post by VisualCSharp »

Hannu wrote: Wed Dec 19, 2018 11:19 am
VisualCSharp wrote: Wed Dec 19, 2018 2:02 am I realize this would fundamentally alter an aspect of gameplay loved by many, but for me, lane balancing is a real pain and definitely detracts from my enjoyment of the game
Devs have rejected many times this kind of ideas. Factorio's core philosophy is to build complex things from simple standard blocks.

What if you just do not balance your lines, if you hate to build it? In most situations there is not technical reason to balance and priority splitters gives better, simpler and cheaper options to handle many belt buses. Assemblers and furnaces do not care if some of them work more than others at partial load situations. Those huge balancers are mostly aesthetic things and I think most of players who use them would not like simple trivial solution. It is nice to watch how material flows through a complex balancer.
It's unfortunate you so readily dismiss the idea. Perhaps if the devs have rejected this kind of idea "many times," there may be some people who want it? I know I'm not alone in my distaste for managing balancers. I disagree that Balancers somehow conflict with the game's core philosophy. These things are all matters of taste and scale. Frankly, your strawman is in bad faith and discourages me from further participating on these forums. That's sad, really.

If other players like balancers, they can use balancers; what did I suggest that would prevent that?
Zavian
Smart Inserter
Smart Inserter
Posts: 1649
Joined: Thu Mar 02, 2017 2:57 am
Contact:

Re: Combining, Splitting, and Balancing Large Numbers of Belts

Post by Zavian »

VisualCSharp wrote: Wed Dec 19, 2018 12:18 pm It's unfortunate you so readily dismiss the idea. Perhaps if the devs have rejected this kind of idea "many times," there may be some people who want it? I know I'm not alone in my distaste for managing balancers.
Factorio still gives you choices, you can design a base that doesn't need massive balancers. Personally I almost never use balancers wider than 4 belts eg this 32 belt unload station only uses 4 belt balancers (and if you manage the takeoffs properly, you don't need more balancers).
32BeltUnload.jpg
32BeltUnload.jpg (869.49 KiB) Viewed 5423 times
Or you can do as Hannu suggested and use priority splitters, and not bother with balancers.
VisualCSharp wrote: Wed Dec 19, 2018 2:02 am I realize this would fundamentally alter an aspect of gameplay loved by many, but for me, lane balancing is a real pain and definitely detracts from my enjoyment of the game.
Unless you are deliberately blocking lanes with undergrounds, or loading belts in an unbalanced fashion, or wanting to downgrade the speed of a belt after an unbalanced draw, or combining multiple belts into one after an unbalanced draw, you almost never need lane balancers. If you are using lane balancers for anything else, then you can probably probably simply remove most of them. The major exception is wanting the belts to look balanced, which is an aesthetic choice. (Even then, if you keep your supply and demand inherently balanced across lanes, you even achieve belts that are inherently lane balanced, without using lane balancers).
Darinth
Filter Inserter
Filter Inserter
Posts: 323
Joined: Wed Oct 17, 2018 12:17 pm
Contact:

Re: Combining, Splitting, and Balancing Large Numbers of Belts

Post by Darinth »

Honestly, I'm right there with you CSharp. Lane balancers are one of those things that I simply have no actual interest in. I simply went and downloaded a blueprint book of x to x balancers to deal with the rare occasion they're useful for a technical reason (in order to make sure multiple train cars get unloaded as quickly as possible, you need to perform balancing at some point in the process.) Beyond that, I actually use splitters in priority mode to funnel belts down into as condensed a format as I can manage rather than balancing lanes which is actually often pointless or worse detrimental to production.

However, I also recognize the psychological flaw in telling people 'if you don't like it, just don't use it'. The game's general difficulty needs to be setup in such a fashion that if you use all of your tools, it hits an appropriate challenge for some most of it's users. If such a feature were to be implemented, I'd want an option to see it *entirely* disabled during world creation. But that also opens up a whole can of worms in determining what should have such options, what shouldn't, what is disabled by default, what is enabled by default, etc... My base inclination on this issue is to actually recommend downloading a set of balancers. The space taken up by balancers can easily by justified from a game-play difficulty perspective as 'balancing lanes uses x quantity of land', and just keeping a belt balancing book removes the tedium of designing balancers yourself.
mysticdreamer76
Burner Inserter
Burner Inserter
Posts: 8
Joined: Mon Apr 13, 2020 10:46 pm
Contact:

New modular splitters

Post by mysticdreamer76 »

I'd love to see splitters that were customizable. Starting off as they are, as a two lane, then allowing for many more lanes by combining them in more expensive recipes.

It would be nice to have a 6 lane splitter, where you could filter 6 things, with only a single (or up to 6) input belts.

For example, if you have coal, iron, copper, stone, and uranium coming into a single splitter, and being able to split it
iron iron copper copper stone uranium uranium or something, that would be amazing! instead of having 39 (or however many) current splitters to do this.
Koub
Global Moderator
Global Moderator
Posts: 7784
Joined: Fri May 30, 2014 8:54 am
Contact:

Re: Combining, Splitting, and Balancing Large Numbers of Belts

Post by Koub »

[Koub] Merged into older topic with same suggestion.
Unlikely to ever happen, but there's an abandonned mod for that : https://mods.factorio.com/mods/msu320/compoundsplitters
You might want to take it over and update it for 0.18.
Koub - Please consider English is not my native language.
User avatar
Optera
Smart Inserter
Smart Inserter
Posts: 2920
Joined: Sat Jun 11, 2016 6:41 am
Contact:

Re: Combining, Splitting, and Balancing Large Numbers of Belts

Post by Optera »

Koub wrote: Tue Apr 21, 2020 5:49 am [Koub] Merged into older topic with same suggestion.
Unlikely to ever happen, but there's an abandonned mod for that : https://mods.factorio.com/mods/msu320/compoundsplitters
You might want to take it over and update it for 0.18.
Compound splitters does everything in tick. The performance is terrible even compared to base splitter builds.
For decent performance use (mini)loader + large chests.

Since Eradicators way of placing loader - chest - output loader on the same tile no longer works, there is no reason to even make this a dedicated mod.
User avatar
ssilk
Global Moderator
Global Moderator
Posts: 12889
Joined: Tue Apr 16, 2013 10:35 pm
Contact:

Re: Combining, Splitting, and Balancing Large Numbers of Belts

Post by ssilk »

I see that similarly. Any reasons against moving this to won't implement?
Cool suggestion: Eatable MOUSE-pointers.
Have you used the Advanced Search today?
Need help, question? FAQ - Wiki - Forum help
I still like small signatures...
mysticdreamer76
Burner Inserter
Burner Inserter
Posts: 8
Joined: Mon Apr 13, 2020 10:46 pm
Contact:

Re: Combining, Splitting, and Balancing Large Numbers of Belts

Post by mysticdreamer76 »

There's another active mod for it also: viewtopic.php?f=87&t=4822
User avatar
eradicator
Smart Inserter
Smart Inserter
Posts: 5207
Joined: Tue Jul 12, 2016 9:03 am
Contact:

Re: Combining, Splitting, and Balancing Large Numbers of Belts

Post by eradicator »

Optera wrote: Tue Apr 21, 2020 8:33 am Since Eradicators way of placing loader - chest - output loader on the same tile no longer works, there is no reason to even make this a dedicated mod.
That was never save-stable btw. - completely unusable in multiplayer. I've done some experiments with inserters too, but they don't balance inheritly. And they can't be speed-controlled at runtime so that approach would require pre-generating a large amount of speed-fractions for all possible belt-count combinations and even then it would only work for fully compressed belts. Aka a perfect even-count splitter isn't moddable without active scripting (as far as i understand not even wide-chest+loader can do it for starved belts). For weird or very large splitting/joining problems that the user wants to solve with perfect ratio circuit based splitters probably work best. Ofc this is not a "modding" thread and it would certainly be possible on an engine level, but...
ssilk wrote: Tue Apr 21, 2020 5:01 pm I see that similarly. Any reasons against moving this to won't implement?
Devs have stated often enough that they don't intend to introduce "shortcuts" to the logistic puzzle. So go ahead and move it.
Author of: Belt Planner, Hand Crank Generator, Screenshot Maker, /sudo and more.
Mod support languages: 日本語, Deutsch, English
My code in the post above is dedicated to the public domain under CC0.
Post Reply

Return to “Ideas and Suggestions”