The social promise of augmented reality

May 6, 2019

The social life of young people increasingly takes place in the virtual world. In the coming years, society will become more divided over highly immersive videogames that contain more and more social activities. Consequently, connecting the virtual and physical world through an augmented reality interface will gain momentum. This will create new types of social networks.

Our observations

  • The popularity of virtual worlds or videogames cannot be understood without their social elements. Popular Nintendo games (e.g. Mario Kart, Mario Party, Super Smash Bros), as well as sports games such as FIFA, are especially popular for their local multiplayer or “couch coop”, i.e. people in the same room playing against each other. Twitch, a streaming platform for watching others play videogames, satisfies people’s desire to watch and learn from each other. Subgenres of videogames are built on social mechanisms, like massively multiplayer online videogames (MMOs) that bring people together with liveevents that have to be played cooperatively.
  • People are increasingly finding a meaningful “second life” in virtual worlds. The social function of these worlds is expanding as they provide opportunities for meetups, friendship, self-expression, live entertainment, shopping, and education. In the not-too-distant future, the emergence of a “metaverse”could enable entertainment, labor and education – all in the same virtual world.
  • There is a growing backlash against the immersive, addictive, attention–grabbing, and financiallyextractive nature of virtual worlds. For example, Prince Harry has heavily criticized Fortnite, saying the videogame should be banned. It is increasingly feared that, as a result of their spending more and more time in virtual worlds, young people have less face-to-face contact and fewer intimate relationships, and are more prone to addiction, sleep deprivation, and depression.
  • Innovation in augmented reality seeks to overcome many problems that currently afflict virtual worlds. Pokémon Go, for example, requires players to leave their homes and interact with others; one studyfinds that people with strong social skills tend to be more successful at the game. Healthcare professionals have praised Pokémon Go for its positive impact on physical activity.
  • According to Jay Bolter, “immediacy” represents our desire for a transparent interface through which wewould no longer be aware of confronting a medium (i.e. the screen), but instead would directly experience the content of the medium (i.e. the movie or the game). Immediacy comes down to our desire to experience something “real” without the mediation of a machine. Innovation of digital screens, cinemas and virtual reality should be understood in this light. Simultaneously, as opposed to immediacy, other interfaces establish “hypermediacy” by trying to make users highly aware of the medium in order to draw attention to images as representations rather than reality (e.g. graphical user interfaces on computers).

Connecting the dots

Our time is characterized by fundamentally different perspectives on the nature of the virtual world. This is a societal divide that could persist for decades. Interestingly, the very existence of this divide will open up opportunities for a new type of virtual world created by new types of interfaces. To assess this opportunity, we first have to understand this divide and why it will remain for the foreseeable future.

For many people, the virtual world is a “degenerated reality”. The idea of degenerated reality is that virtual worlds can never become as “real” as the physical world. This is partly based on the idea that our body remains in the physical world whenever we move around in a virtual world. From this perspective, videogames are mainly “escapist” phenomena that temporarily provide amusement. Spending too much time in these virtual worldscould therefore be dangerous and even ruin lives. Research that links anxiety, depression and loneliness to videogames reinforces this idea. Many consumers that simply see virtual worlds as games to be temporarily enjoyed fit this perspective, but it also includes conservative critics who believe that the increasing popularity of virtual worlds represents a huge threat. Indeed, the future backlash against social virtual worlds could be much more vigorous than the current backlash against social media.

On the other hand, the increasingly immersive nature of virtual worlds is also leading a rising number of people to see the virtual world as a “meaningful reality”. This is because virtual worlds increasingly resemble the physical world by offering more social activities (e.g. live entertainment, shopping, education) and morepossibilities for meaningful experiences (e.g. friendship, creativity). Therefore it is possible to live a meaningful life in the virtual world. It is also believed that the integration of human senses into the virtual world (e.g. heartrate sensors, eye tracking, haptic feedback) will turn the experience of virtual worlds into “authenticexperiences” that cannot be distinguished from physical experiences. For many consumers, virtual worlds are therefore meaningful supplements to physical reality (e.g. the virtual community stimulates physical contact), and others even believe that eventually there will no longer be a difference between the physical and the virtual world.

This societal divide could persist for a long time. Both perspectives will continue to think differently about the push for “immediacy” regardless of the advancement of technology. Take the scenario of fully immersive virtual worlds with haptic suits and virtual reality which is indistinguishable from physical reality. From the perspective of the virtual world as degenerated reality, the physical body is still being detached from physical reality, albeit through more sophisticated interfaces. We will also always be aware of living in two worlds (virtual and physical). But from the perspective of the virtual world as meaningful reality, such an immersive virtual can already provide profoundly meaningful experiences. Innovation simply has to make these worlds more authentic.

We are already seeing the emergence of an alternative idea of the virtual world as “harmonious reality”. Augmented reality promises to build a “mirrorworld” that connects the physical world to the virtual world, creating a harmonious reality that provides meaningful experiences in the physical world through a digital platform. From this perspective, the tension between degenerated and meaningful reality simply dissolves. People will be able to build social connections in the physical world through a digital platform. Pokémon Go was the first success in what is likely to become a much larger development. Its successor, Harry Potter: Wizards Unite, will be released later this year and indeed, the title of the game presents the fundamental social dimension of the platform. Although it remains to be seen what type of social frustration this platform will result in (e.g. accidents, the commodification of all urban space), it represents an enormous opportunity from a social perspective, as it will make irrelevant many of the current concerns over virtual worlds by creating new types of social networks.

Implications

  • The enabling factors of the mirrorworld, the foundation of a more comprehensive social augmented reality platform, are likely to be cheap wearable glasses and ubiquitous cameras and sensors in the urban environment.
  • Despite the considerable promise of augmented reality from this socio-cultural perspective, the idea of the virtual world as a meaningful reality still represents an enormous growth market (e.g. gaming, VR). However, the idea of the virtual world as degenerated reality could increasingly disrupt this market by worrying consumers (e.g. parents, schools, or young people themselves), healthcare professionals and even politicians.

Series 'AI Metaphors'

×
1. The tool
Category: The object
Humans shape tools. We make them part of our body while we melt their essence with our intentions. They require some finesse to use but they never fool us or trick us. Humans use tools, tools never use humans. We are the masters determining their course, integrating them gracefully into the minutiae of our everyday lives. Immovable and unyielding, they remain reliant on our guidance, devoid of desire and intent, they remain exactly where we leave them, their functionality unchanging over time. We retain the ultimate authority, able to discard them at will or, in today's context, simply power them down. Though they may occasionally foster irritation, largely they stand steadfast, loyal allies in our daily toils. Thus we place our faith in tools, acknowledging that they are mere reflections of our own capabilities. In them, there is no entity to venerate or fault but ourselves, for they are but inert extensions of our own being, inanimate and steadfast, awaiting our command. (This paragraph was co-authored by a human.)
Read the article
×
2. The machine
Category: The object
Unlike a mere tool, the machine does not need the guidance of our hand, operating autonomously through its intricate network of gears and wheels. It achieves feats of motion that surpass the wildest human imaginations, harboring a power reminiscent of a cavalry of horses. Though it demands maintenance to replace broken parts and fix malfunctions, it mostly acts independently, allowing us to retreat and become mere observers to its diligent performance. We interact with it through buttons and handles, guiding its operations with minor adjustments and feedback as it works tirelessly. Embodying relentless purpose, laboring in a cycle of infinite repetition, the machine is a testament to human ingenuity manifested in metal and motion. (This paragraph was co-authored by a human.)
Read the article
×
3. The robot
Category: The object
There it stands, propelled by artificial limbs, boasting a torso, a pair of arms, and a lustrous metallic head. It approaches with a deliberate pace, the LED bulbs that mimic eyes fixating on me, inquiring gently if there lies any task within its capacity that it may undertake on my behalf. Whether to rid my living space of dust or to fetch me a chilled beverage, this never complaining attendant stands ready, devoid of grievances and ever-willing to assist. Its presence offers a reservoir of possibilities; a font of information to quell my curiosities, a silent companion in moments of solitude, embodying a spectrum of roles — confidant, servant, companion, and perhaps even a paramour. The modern robot, it seems, transcends categorizations, embracing a myriad of identities in its service to the contemporary individual. (This paragraph was co-authored by a human.)
Read the article
×
4. Intelligence
Category: The object
We sit together in a quiet interrogation room. My questions, varied and abundant, flow ceaselessly, weaving from abstract math problems to concrete realities of daily life, a labyrinthine inquiry designed to outsmart the ‘thing’ before me. Yet, with each probe, it responds with humanlike insight, echoing empathy and kindred spirit in its words. As the dialogue deepens, my approach softens, reverence replacing casual engagement as I ponder the appropriate pronoun for this ‘entity’ that seems to transcend its mechanical origin. It is then, in this delicate interplay of exchanging words, that an unprecedented connection takes root that stirs an intense doubt on my side, am I truly having a dia-logos? Do I encounter intelligence in front of me? (This paragraph was co-authored by a human.)
Read the article
×
5. The medium
Category: The object
When we cross a landscape by train and look outside, our gaze involuntarily sweeps across the scenery, unable to anchor on any fixed point. Our expression looks dull, and we might appear glassy-eyed, as if our eyes have lost their function. Time passes by. Then our attention diverts to the mobile in hand, and suddenly our eyes light up, energized by the visual cues of short videos, while our thumbs navigate us through the stream of content. The daze transforms, bringing a heady rush of excitement with every swipe, pulling us from a state of meditative trance to a state of eager consumption. But this flow is pierced by the sudden ring of a call, snapping us again to a different kind of focus. We plug in our earbuds, intermittently shutting our eyes, as we withdraw further from the immediate physical space, venturing into a digital auditory world. Moments pass in immersed conversation before we resurface, hanging up and rediscovering the room we've left behind. In this cycle of transitory focus, it is evident that the medium, indeed, is the message. (This paragraph was co-authored by a human.)
Read the article
×
6. The artisan
Category: The human
The razor-sharp knife rests effortlessly in one hand, while the other orchestrates with poised assurance, steering clear of the unforgiving edge. The chef moves with liquid grace, with fluid and swift movements the ingredients yield to his expertise. Each gesture flows into the next, guided by intuition honed through countless repetitions. He knows what is necessary, how the ingredients will respond to his hand and which path to follow, but the process is never exactly the same, no dish is ever truly identical. While his technique is impeccable, minute variation and the pursuit of perfection are always in play. Here, in the subtle play of steel and flesh, a master chef crafts not just a dish, but art. We're witnessing an artisan at work. (This paragraph was co-authored by a human.)
Read the article
×
7. The deficient animal
Category: The human
Once we became upright bipedal animals, humans found themselves exposed and therefore in a state of fundamental need and deficiency. However, with our hands now free and our eyes fixed on the horizon instead of the ground, we gradually evolved into handy creatures with foresight. Since then, human beings have invented roofs to keep them dry, fire to prepare their meals and weapons to eliminate their enemies. This genesis of man does not only tell us about the never-ending struggle for protection and survival, but more fundamentally about our nature as technical beings, that we are artificial by nature. From the early cave drawings, all the way to the typewriter, touchscreens, and algorithmic autocorrections, technics was there, and is here, to support us in our wondering and reasoning. Everything we see and everywhere we live is co-invented by technics, including ourselves. (This paragraph was co-authored by a human.)
Read the article
×
8. The enhanced human
Category: The human
In a lab reminiscent of Apple HQ, a figure lies down, receiving his most recent cognitive updates. He wears a sleek transparent exoskeleton, blending the dark look of Bat Man with the metallic of Iron Man. Implemented in his head, we find a brain-computer interface, enhancing his cognitive abilities. His decision making, once burdened by the human deficiency we used to call hesitation or deliberation, now takes only fractions of seconds. Negative emotions no longer fog his mind; selective neurotransmitters enhance only the positive, fostering beneficial social connections. His vision, augmented to perceive the unseen electromechanical patterns and waves hidden from conventional sight, paints a deeper picture of the world. Garbed in a suit endowed with physical augmentations, he moves with strength and agility that eclipse human norms. Nano implants prolong the inevitable process of aging, a buffer against time's relentless march to entropy. And then, as a penultimate hedge against the finite, the cryo-cabin awaits, a sanctuary to preserve his corporal frame while bequeathing his consciousness to the digital immortality of coded existence. (This paragraph was co-authored by a human.)
Read the article
×
9. The cyborg
Category: The human
A skin so soft and pure, veins pulsing with liquid electricity. This fusion of flesh and machinery, melds easily into the urban sprawl and daily life of future societies. Something otherworldly yet so comfortingly familiar, it embodies both pools of deep historical knowledge and the yet-to-be. It defies categorization, its existence unraveling established narratives. For some, its hybrid nature is a perplexing anomaly; for others, this is what we see when we look into the mirror. This is the era of the cyborg. (This paragraph was co-authored by a human.)
Read the article

About the author(s)

You may also like