Tim Fu makes use of "Midjourney for structure" to remodel crumpled paper into starchitect buildings

Designer Tim Fu has used LookX, a man-made intelligence software educated on structure, to show squashed paper into constructing fashions that evoke designs by architects Frank Gehry and Zaha Hadid.

The LookX platform, which simply launched, is a man-made intelligence-generated content material (AIGC) software that was designed particularly for “structure lovers”.

Prime picture: an AI-designed constructing within the type of SANAA. Above: Tim Fu used paper crumpled in several methods as a immediate for AI software LookX

It’s educated on an architectural database known as ArchiNet and has been “geared up with [the] business’s semantics and annotations,” LookX stated.

“By integrating multimodality and self-developed algorithms, the big mannequin can be utilized extra broadly in structure,” the corporate added.

Frank Gehry AI building made from crumpled paper
One constructing was designed utilizing the immediate Frank Gehry

The truth that it’s educated on structure units LookX aside from current synthetic intelligence (AI) instruments, in keeping with Zaha Hadid designer Fu.

“As a result of it is educated particularly on structure fashions, it has much more capabilities in producing completed outcomes and resolved geometry, versus what you’ll usually get from Midjourney or DALL-E or Secure Diffusion even proper now,” Fu advised Dezeen.

Zaha Hadid building made from crumpled paper
One other constructing was designed within the type of Zaha Hadid

Fu used LookX to design a sequence of buildings utilizing a visible immediate of crumpled paper, which drew on each architect Gehry’s “squashed brown paper bag” constructing for UTS Enterprise Faculty and The Simpsons TV sequence episode that referenced it.

“It [came from] realizing that there is a legacy of Gehry’s crumbling paper design, and The Simpsons episode immortalised that side; that was at the back of my head,” he stated.

“However I additionally wished to showcase how the arbitrariness of an enter could be interpreted by the AI to supply very refined outcomes, thus showcasing how the stark distinction between whimsicality and intention can each play a task in design.”

Crumpled paper used as AI architecture prompt for LookX
Fu has labored extensively in AI

Fu, who has labored extensively in AI and is doing a analysis collaboration with LookX, created designs that resembled these by Gehry in addition to ones by structure studios Zaha Hadid Architects, SANAA, OMA, and Santiago Calatrava.

The designs have been made utilizing LookX’s versatile Discover mode, which lets customers select foundations and elegance fashions, add photos, enter key phrases and regulate management parameters.

“That exact mannequin was me utilizing one of many LoRA [low-rank adaptation] fashions,” Fu stated. “They’re localised clusters of machine studying algorithms, on high of their baseline algorithms, which you could choose from the crowd-sourced pool of LoRA fashions.”

OMA-design AI made using crumpled paper
He additionally created an AI-generated design utilizing the immediate OMA

“Then I chosen the one which was specifically educated for structure fashions, wooden, acrylic; the entire database is educated on that,” he added.

“I hooked up that mannequin to the primary mannequin, after which I generated these photos simply based mostly on picture enter, pictures of the crumpling papers.”

LookX has three core modules: Inspiration Generator, Mannequin Coaching and Sharing Neighborhood. Customers can prepare their very own AI fashions after which share them on the platform.

Fu additionally used LookX to create visuals of architectural fashions based mostly on sketches and massing, in addition to renders based mostly on massing.

Calatrava-design based on crumpled paper
Santiago Calatrava’s designs knowledgeable one other constructing

In keeping with the designer, the closest current AI platform is Secure Diffusion, however he argued that the standard is just not comparable.

“The closest factor now we have is Secure Diffusion ControlNet, the place you enter picture geometry and its ready to select the contours,” he stated.

“From the contours, it generates a Secure Diffusion picture outcome, which isn’t not like what we do right here with this LookX algorithm, however it has an inferior high quality output.”

Piece of crumpled paper used for AI prompt
The LookX platform lets customers add photos to make use of as prompts

Fu referred to LookX as “the Midjourney killer for the structure business,” saying he believes it’ll solely proceed to develop.

“I used to be utterly captivated by the potential of the place that is going as a result of we actually wanted a Midjourney model for the structure business,” he stated.

“It has a lot potential, not solely within the current however the future, as a result of it is solely going to be moving into a way more developed route.”

AI-design made using crumpled paper
One other Zaha Hadid design was knowledgeable by a special crumpled paper

Quite a lot of structure studios have been utilizing AI of their work, together with Zaha Hadid. In a roundtable dialogue, its principal Patrik Schumacher stated the studio is growing “most” initiatives utilizing AI-generated photos.

Structure studio Hickock Cole just lately unveiled photos of a mixed-use constructing designed utilizing ChatGPT that encompasses a inexperienced roof and a swimming pool.

The photographs are courtesy of Tim Fu.

Illustration by Selina Yau


This text is a part of Dezeen’s AItopia sequence, which explores the affect of synthetic intelligence (AI) on design, structure and humanity, each now and sooner or later.