ProxyBuild: Text-Guided Structured 3D Building Generation with Mesh-Anchored Procedural Proxies

TL;DR

ProxyBuild is a novel framework for text-guided 3D building generation, introducing Mesh-Anchored Procedural Proxies to decouple generation into proxy prediction and instantiation. This approach mitigates common issues like over-smoothing and component collisions. It generates structurally clear and detail-rich buildings.

Why It Matters

ProxyBuild's ability to generate editable 3D buildings from text has significant implications for virtual reality, digital twins, and other downstream applications. It provides a reliable and interactive content foundation, enabling more efficient and accurate content creation. This can lead to cost savings and improved user experiences.

Key Findings

• Mesh-Anchored Procedural Proxies enable decoupling of generation tasks
• Face-edge bigraph encoder accurately infers semantic roles of faces and edges
• ProxyBuild outperforms prior baselines in generating structurally clear and detail-rich buildings