INSUBCONTINENT EXCLUSIVE:
The LegoGPT system works in three parts, shown in this diagram.
Credit:
Pun et al.
The researchers also expanded the system's abilities by adding texture and color options
For example, using an appearance prompt like "Electric guitar in metallic purple," LegoGPT can generate a guitar model, with bricks assigned
a purple color.To prove their designs worked in real life, the researchers had robots assemble the AI-created Lego models
They used a dual-robot arm system with force sensors to pick up and place bricks according to the AI-generated instructions.Human testers
also built some of the designs by hand, showing that the AI creates genuinely buildable models
"Our experiments show that LegoGPT produces stable, diverse, and aesthetically pleasing Lego designs that align closely with the input text
prompts," the team noted in its paper.When tested against other AI systems for 3D creation, LegoGPT stands out through its focus on
The team tested against several alternatives, including LLaMA-Mesh and other 3D generation models, and found its approach produced the
highest percentage of stable structures.A video of two robot arms building a LegoGPT creation, provided by the researchers.
A video of
two robot arms building a LegoGPT creation, provided by the researchers.
Still, there are some limitations
"Our method currently supports a fixed set of commonly used Lego bricks," the team acknowledged
"In future work, we plan to expand the brick library to include a broader range of dimensions and brick types, such as slopes and tiles."The
researchers also hope to scale up their training dataset to include more objects than the 21 categories currently available
