Conference Paper: Peer Reviewed

Augmenting Craft With Mixed Reality: A Case Study Project of AR-driven Analogue Clay Modelling

by Fong. J., Ho C.H., Ngan W., Poon A., Goepel G., and Crolla K.

ABSTRACT | This paper discusses novel methods for and advantages from integrating Augmented Reality (AR) and photogrammetry in hand-clay-sculpting workflows. These techniques permit non-trained users to achieve higher precision during the sculpting process by holographically overlaying instructions from digital 3D source geometry on top of the sculpting material. By employing alternative notational systems in design implementation methods, the research positions itself in a Post-Digital context aimed at humanizing digital technologies. Throughout history, devices have been developed to increase production, such as Henry Dexter’s 1842 “Apparatus for Sculptors” for marble sculpting. Extrapolating from this, the workflow presented in this paper uses AR for overlaying extracted information from 3D models directly onto the sculptor’s field of vision. This information can then become an AR-driven guidance system that assists the sculptor. Using the Microsoft HoloLens, holographic instructions are introduced in the production sequence, connecting the analogue sculpture fabrication directly with a digital environment, thus augmenting the craftspeople’s agency. A series of AR-aided sculpting methods were developed and tested in a demonstrator case study project that created a small-scale clay copy of Henry Moore’s “Sheep Piece” (1971-2). This paper demonstrates how user-friendly soft- and hardware tools have lowered the threshold for end-users to develop new methods that straightforwardly facilitate and improve their crafts’ effectiveness and agency. This shows that the fusion of computational design technology and AR visualization technology can innovate a specific craft’s design and production workflow, opening the door for further similar application developments in more architecture-specific fabrication contexts.

KEYWORDS | Collaborative Design; Augmented-Reality; Mixed Reality; Human-Computer Interaction; Tolerances And Error; Clay modelling

CITATION |Chun Hin Fong, Jacky, Adabelle Long Wun Poon; Wing Sze Ngan, Chung Hei Ho, Garvin Goepel and Kristof Crolla, “Augmenting Craft with Mixed Reality” in B. Slocum, V. Ago, S. Doyle, A. Marcus, M. Yablonina, and M. del Campo (eds.), ACADIA 2020: Distributed Proximities / Volume I: Technical Papers [Proceedings of the 40th Annual Conference of the Association of Computer Aided Design in Architecture (ACADIA), Online and Global, 24-30 October 2020, pp. 436-444.