Blueprint Diffusion Model
Posted: Mon Feb 17, 2025 10:00 pm
Hi,
I wanted to showcase a Blueprint Diffusion model that I have been working on for the past couple weeks.
Basically, the model takes a query as input, and uses a specifically-designed diffusion model that I developed to eventually generate a blueprint json (which is converted into a blueprint string). Below is an image of the best result thusfar:
Cool right?
Current issues:
1. Its a diffusion model, so it often results in a random building overlapping with another building 4x the size
2. It does seem to know when to use which belts as input, but often scrambles them up later on in the pipeline (yay for spaghetti base trainingdata)
3. It takes quite a bit of time to 'render' - currently it takes about 3 minutes to generate a full contraption (maybe because i'm running on cpu ;-;)
4. Not enough datasets to be 'creative' - I need more different types of trainingdata (other people's bases basically)
But yay for progress!
I wanted to showcase a Blueprint Diffusion model that I have been working on for the past couple weeks.
Basically, the model takes a query as input, and uses a specifically-designed diffusion model that I developed to eventually generate a blueprint json (which is converted into a blueprint string). Below is an image of the best result thusfar:
Cool right?
Current issues:
1. Its a diffusion model, so it often results in a random building overlapping with another building 4x the size
2. It does seem to know when to use which belts as input, but often scrambles them up later on in the pipeline (yay for spaghetti base trainingdata)
3. It takes quite a bit of time to 'render' - currently it takes about 3 minutes to generate a full contraption (maybe because i'm running on cpu ;-;)
4. Not enough datasets to be 'creative' - I need more different types of trainingdata (other people's bases basically)
But yay for progress!