Blueprint Diffusion Model

[Scorchchamp]

Hi,

I wanted to showcase a Blueprint Diffusion model that I have been working on for the past couple weeks.

Basically, the model takes a query as input, and uses a specifically-designed diffusion model that I developed to eventually generate a blueprint json (which is converted into a blueprint string). Below is an image of the best result thusfar:

02-17-2025, 22-56-26.png (1.36 MiB) Viewed 432 times

Cool right?

Current issues:
1. Its a diffusion model, so it often results in a random building overlapping with another building 4x the size
2. It does seem to know when to use which belts as input, but often scrambles them up later on in the pipeline (yay for spaghetti base trainingdata)
3. It takes quite a bit of time to 'render' - currently it takes about 3 minutes to generate a full contraption (maybe because i'm running on cpu ;-;)
4. Not enough datasets to be 'creative' - I need more different types of trainingdata (other people's bases basically)

But yay for progress!

[eugenekay]

Neat concept! Now we can automate being drunk and making broken factory additions…


I would be interested in seeing the “thought process” and code involved… Screenshots of localhost looks like a good Minimum Viable Page.

How are you loading Input Data? Blueprint strings all the way down, or decoding Save files and modeling game state directly?