Virtually Physical Immaterial

DC I/O 2022 Paper and slides by Kenneth Yuqi CAI. https://doi.org/10.47330/DCIO.2022.MQMZ7444 | Watch | |

Abstract

This research investigates the potential benefits and drawbacks of Augmented Reality (AR) in architecture and how it can transform architecture’s spatial properties and performance. Consequentially, it also investigates how this potential transformation might affect AR users and how they navigate the physical architecture. The definition of AR as an enhanced version of reality is problematic. The word ‘augmented’ in itself suggests an increase of value of the subject. The thesis disputes those definitions and considers the composite state that AR creates, neither fully virtual nor fully physical, and, in particular, what this might mean in the context of architecture and architectural production. Thus considering how the properties and applications of AR can (and should) be leveraged to create a new form of spatial conception. Consequently, it proposes strategies for how this can impact architecture programmatically and cognitively. This research is organised to introduce the current developments in the field by first presenting a literature review, then using this research to formulate a hypothesis that is finally tested. Two complementary experiments were conducted and the initial findings seem to suggest a higher effect in spatial navigation through augmented environments. The conclusion chapter elaborates on the impact this research might have in architectural and spatial design production, reflecting on possible future avenues of research.

Keywords

Augmented Reality, Extended Realities, Human-Computer Interaction, Spatial Perception, Ethics, Axiology.

Bibliography

• ALSOP, T. 2021. Global mobile augmented reality (AR) users 2024. Statista. https://www.statista.com/statistics/1098630/global-mobile-augmented-reality-ar-users/.
• ANDREESSEN, M. 2011. Why Software Is Eating The World. Wall Street Journal. https://online.wsj.com/article/SB10001424053111903480904576512250915629460.html.
• ANDREW, H. 2018. How augmented reality affects the brain. Zappar. https://www.zappar.com/blog/how-augmented-reality-affects-brain.
• APPLE INC. 2021. ARKit - Augmented Reality. Apple Developer. https://developer.apple.com/augmented-reality/arkit/.
• AR_MR_XR. 2022. realtime reflections in augmented reality. r/AR_MR_XR. www.reddit.com/r/AR_MR_XR/comments/slagt3/realtime_reflections_in_augmented_reality/.
• ARMSTRONG, M.M. 2020. Cheat sheet: What is Digital Twin? Internet of Things blog. IBM Business Operations Blog. https://www.ibm.com/blogs/internet-of-things/iot-cheat-sheet-digital-twin/.
• BASHIR, H. AND BHAT, S. 2016. Effects of Social Media on Mental Health: A Review. The International Journal of Indian Psychology 4, 125–131.
• BERRYMAN, D.R. 2012. Augmented Reality: A Review. Medical Reference Services Quarterly 31, 2, 212–218.
• BOLTER, J.D., ENGBERG, M., AND MACINTYRE, B. 2021. Reality Media: Augmented and Virtual Reality.
• BOND, M. 2017. The hidden ways that architecture affects how you feel. https://www.bbc.com/future/article/20170605-the-psychology-behind-your-citys-design.
• BOOK, A. 2020. Why “Augmented Reality” is dangerous. ArcadeUK. https://medium.com/arcadeuk/why-augmented-reality-is-dangerous-fbb60c7963b5.
• CANNAVÒ, A. AND LAMBERTI, F. 2021. How Blockchain, Virtual Reality, and Augmented Reality are Converging, and Why. IEEE Consumer Electronics Magazine 10, 5, 6–13.
• CHOPINE, A. 2011. Chapter 1 - A History of Computer Graphics and Special Effects. In: A. Chopine, ed., 3D Art Essentials. Focal Press, Boston, 1–12.
• CHUNG, J. 2010. Analysis of Break in Presence During Game Play Using a Linear Mixed Model. ETRI Journal 32, 5, 687–694.
• CREATIVETOOLS. 2013. FFF 3D-printable Utah Teapot with separate lid by CreativeTools. https://www.thingiverse.com/thing:68880.
• DALTON, J. 2022. Legal and regulatory challenges in the enterprise application of virtual and augmented reality: What lies ahead. PwC. https://www.pwc.co.uk/issues/intelligent-digital/virtual-reality-vr-augmented-reality-ar/legal-regulatory-challenges-enterprise-application-virtual-augmented-reality.html.
• DAY, M. 2021. Why are we still waiting for Augmented Reality? AEC Magazine. https://aecmag.com/technology/waiting-for-augmented-reality-ar-for-aec-architecture-construction/.
• DEPTH MASK TEST. 2015.
• GOOD, O.S. 2022. Epic Games launches Unreal Engine 5. Polygon. https://www.polygon.com/23011548/unreal-engine-5-release-date-launch.
• GOODALE, M.A. AND MILNER, A.D. 1992. Separate visual pathways for perception and action. Trends in Neurosciences 15, 1, 20–25.
• GOSLING, S.D., KO, S.J., MANNARELLI, T., AND MORRIS, M.E. 2002. A room with a cue: Personality judgments based on offices and bedrooms. Journal of Personality and Social Psychology 82, 3, 379–398.
• HAHM, S. 2019. STEAMPUNK PAVILION. SoomeenHahm Design. https://soomeenhahm.com/portfolio-item/steampunk-pavilion/.
• HAPPA, J., STEED, A., AND GLENCROSS, M. 2021. Privacy-certification standards for extended-reality devices and services. 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), IEEE, 397–398.
• HUETTEL, S. 2019. Spatial Navigation and Gender. Brain Connection. https://brainconnection.brainhq.com/2019/11/01/spatial-navigation-and-gender/.
• HUFF, T., MAHABADI, N., AND TADI, P. 2022. Neuroanatomy, Visual Cortex. In: StatPearls. StatPearls Publishing, Treasure Island (FL).
• JIN, Y., SEO, J., LEE, J.G., AHN, S., AND HAN, S. 2020. BIM-Based Spatial Augmented Reality (SAR) for Architectural Design Collaboration: A Proof of Concept. Applied Sciences 10, 17, 5915.
• KAAS, J.H. AND BALARAM, P. 2014. Current research on the organization and function of the visual system in primates. Eye and Brain 6, Suppl 1, 1–4.
• KANT, I. 1781. The Critique of Pure Reason. 2011 CreateSpace Independent Publishing Platform.
• KANT, I. AND KORSGAARD, C.M. 1998. Kant: Groundwork of the Metaphysics of Morals. Cambridge University Press, Cambridge, U.K.; New York.
• KATLAV, E.Ö. 2020. QR Code Applications in Tourism. Handbook of Research on Smart Technology Applications in the Tourism Industry, 89–114. https://www.igi-global.com/chapter/qr-code-applications-in-tourism/www.igi-global.com/chapter/qr-code-applications-in-tourism/248550.
• KELLERT, S.R., HEERWAGEN, J., AND MADOR, M. 2011. Biophilic Design: The Theory, Science and Practice of Bringing Buildings to Life. John Wiley & Sons.
• KOZUCH, K. 2022. Apple Glasses: Everything we’ve heard so far. Tom’s Guide. https://www.tomsguide.com/uk/news/apple-glasses.
• LI, Z., LIN, P., HUANG, Y.-W., ET AL. 2020. 40-3: Invited Paper: A Large RGB-achromatic Metalens for Virtual/Augmented Reality Applications. SID Symposium Digest of Technical Papers 51, 1, 575–578.
• LINN, M.C. AND PETERSEN, A.C. 1985. Emergence and Characterization of Sex Differences in Spatial Ability: A Meta-Analysis. Child Development 56, 6, 1479–1498.
• MACHON, S. 2022. The Ultimate Guide to ISO 19650 in 2022. 12d Synergy. https://www.12dsynergy.com/iso-19650-guide/.

library/ar-will-be-bigger-than-vr-but-we-shouldnt-be- comparing-them-7946e573ca0c.

• SKARREDGHOST. 2021. HoloLens 2 Review: The Best In Class For AR, But... The Ghost Howls. https://skarredghost.com/2021/08/12/hololens-2-review/.
• SLATER, M., GONZALEZ-LIENCRES, C., HAGGARD, P., ET AL. 2020. The Ethics of Realism in Virtual and Augmented Reality. Frontiers in Virtual Reality 1.
• SMITH, W. 2022. A Brief History of AR. GMW3. https://www.gmw3.com/2022/04/a-brief-history-of-ar/.
• SPERGEL, D. 2022. Introduction to Augmented, Virtual & Mixed Reality. Microsol Resources. https://microsolresources.com/tech-resources/article/introduction-to-augmented-virtual-mixed-reality/.
• MANOVICH, L. 2005. The Poetics of Augmented Space. 28.
• MATSUDA, K. 2016. Hyper-Reality. Hyper-Reality. http://hyper-reality.co/.
• MICROSOFT. 2021. https://docs.microsoft.com/en-us/hololens/hololens1-hardware.
• MICROSOFT. 2022. Introducing Microsoft Mesh | Here can be anywhere. https://www.microsoft.com/en-us/mesh.
• MILGRAM, P. AND COLQUHOUN, H. 2001. A Taxonomy of Real and Virtual World Display Integration.
• NICKOLS, H. 2022. What’s the difference between AR, VR, XR and MR? Bunnyfoot. https://www.bunnyfoot.com/2022/01/whats-the-difference-between-ar-vr-xr-and-mr/.
• OPSAHL, K.R. AND K. 2020. Augmented Reality Must Have Augmented Privacy. Electronic Frontier Foundation. https://www.eff.org/deeplinks/2020/10/augmented-reality-must-have-augmented-privacy.
• OSPINO, L. 2021. The Myth of King Midas and His Golden Touch. GreekReporter.com. https://greekreporter.com/2021/10/06/myth-king-midas/.
• POPE, H. 2018. Chapter 1. Introduction to Virtual and Augmented Reality. Library Technology Reports 54, 6, 5–7.
• PORTER, M.E. AND HEPPELMANN, J.E. 2017. Why Every Organization Needs an Augmented Reality Strategy. Harvard Business Review. https://hbr.org/2017/11/why-every-organization-needs-an-augmented-reality-strategy.
• RAUSCHNABEL, P.A. 2021. Augmented reality is eating the real-world! The substitution of physical products by holograms. International Journal of Information Management 57, 102279.
• RAY, S. 2021. AR Cloud: What Is An Augmented Reality Cloud And Why Does It Matter? Lansaar. https://medium.com/lansaar/ar-cloud-what-is-an-augmented-reality-cloud-and-why-does-it-matter-e680ac829959.
• RICCI, N. 2017. The Psychological Impact of Architectural Design. 44.
• ROTOLO, D., HICKS, D., AND MARTIN, B.R. 2015. What is an emerging technology? Research Policy 44, 10, 1827–1843.
• SADOWSKI, W. AND STANNEY, K. 2002. Presence in Virtual Environments. In: Handbook of Virtual Environments. CRC Press.
• SHARMAN, T. 2019. AR will be bigger than VR. But we shouldn’t be comparing them. Virtual Library. https://medium.com/virtual-library/ar-will-be-bigger-than-vr-but-we-shouldnt-be-comparing-them-7946e573ca0c.
• SKARREDGHOST. 2021. HoloLens 2 Review: The Best In Class For AR, But... The Ghost Howls. https://skarredghost.com/2021/08/12/hololens-2-review/.
• SLATER, M., GONZALEZ-LIENCRES, C., HAGGARD, P., ET AL. 2020. The Ethics of Realism in Virtual and Augmented Reality. Frontiers in Virtual Reality 1.
• SMITH, W. 2022. A Brief History of AR. GMW3. https://www.gmw3.com/2022/04/a-brief-history-of-ar/.
• SPERGEL, D. 2022. Introduction to Augmented, Virtual & Mixed Reality. Microsol Resources. https://microsolresources.com/tech-resources/article/introduction-to-augmented-virtual-mixed-reality/.
• STATISTA. 2022. Ethereum energy consumption 2022. Statista. https://www.statista.com/statistics/1265891/ethereum-energy-consumption-transaction-comparison-visa/.
• STEVENS, B. AND JERRAMS-SMITH, J. 2001. The sense of object-presence with projection-augmented models. In: S. Brewster and R. Murray-Smith, eds., Haptic Human-Computer Interaction. Springer Berlin Heidelberg, Berlin, Heidelberg, 194–198.
• TAHAN, L. AND GRANCINI, A. 2021. The Potential of Augmented Reality, From the Perspective of an Architect-Turned-AR/VR Specialist at Facebook Reality Labs. https://archinect.com/features/article/150248539/the-potential-of-augmented-reality-from-the-perspective-of-an- architect-turned-ar-vr-specialist-at-facebook-reality-labs.
• THORPE, B. AND RUTLAND, C. 2021. BIM and Digital Twins. RHDHV | Digital. https://global.royalhaskoningdhv.com/digital/resources/blogs /bim-and-digital-twins.
• TMD STUDIO, L. 2020. Spatial Perception and Architecture. TMD STUDIO’s Insights. https://medium.com/studiotmd/spatial-perception-and-architecture-4f8ab99eeb41.
• TORRENCE, A. 2006. Martin Newell’s original teapot. ACM SIGGRAPH 2006 Teapot Copyright restrictions prevent ACM from providing the full text for the Teapot exhibits, Association for Computing Machinery, 29-es.
• UK BIM FRAMEWORK. 2019. UK BIM Framework – BIM Standards, Guides & Resources. https://www.ukbimframework.org/.
• WALTERS, A. 2019. National Digital Twin Programme. https://www.cdbb.cam.ac.uk/what-we-do/national-digital-twin-programme.
• XRSI. 2020. The XRSI Privacy and Safety Framework. XRSI – XR Safety Initiative. https://xrsi.org/publication/the-xrsi-privacy-framework.
• ZUBOFF, S. 2019. The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power: Barack Obama’s Books of 2019. Profile Books, London.