
Computer-mediated reality refers to the ability to add to, subtract information from, or otherwise manipulate one's perception of reality through the use of a
wearable computer
A wearable computer, also known as a body-borne computer, is a computing device worn on the body. The definition of 'wearable computer' may be narrow or broad, extending to smartphones or even ordinary wristwatches.
Wearables may be for general ...
or hand-held device such as a smartphone.
Description
Mediated reality is a proper superset of
mixed reality
Mixed reality (MR) is a term used to describe the merging of a real-world environment and a computer-generated one. Physical and virtual objects may co-exist in mixed reality environments and interact in real time. Mixed reality is largely synony ...
,
augmented reality
Augmented reality (AR) is an interactive experience that combines the real world and computer-generated content. The content can span multiple sensory Modality (human–computer interaction), modalities, including visual, Hearing, auditory, hap ...
, and
virtual reality
Virtual reality (VR) is a simulated experience that employs pose tracking and 3D near-eye displays to give the user an immersive feel of a virtual world. Applications of virtual reality include entertainment (particularly video games), e ...
, as it also includes, for example, diminished reality.
Typically, it is the user's ''visual'' perception of the environment that is mediated. This is done through the use of some kind of electronic device, such as an
EyeTap device or smart phone, which can act as a visual filter between the real world and what the user perceives. Computer-mediated reality has been used to enhance visual perception as an aid to the visually impaired. This example achieves a mediated reality by altering a video input stream light that would have normally reached the user's eyes, and computationally altering it to filter it into a more useful form. It has also been used for interactive computer interfaces.
The use of computer-mediated reality to ''diminish'' perception, by the removal or masking of visual data, has been used for architectural applications, and is an area of ongoing research.
The long-term effects of altering perceived reality have not been thoroughly studied, and negative side effects of long-term exposure might be possible. Short term effects have been demonstrated with the eyestrain caused by computers.
As a seeing aid
In the 1970s and 1980s,
Steve Mann introduced the Generation-1 and Generation-2 "Digital Eye Glass", initially as a vision aid to help people see better, as a
welding helmet,
[IEEE Spectrum]
/ref> and as a general-purpose seeing aid for everyday life as outlined in IEEE Technology & Society 31(3) and the supplemental material entitled "GlassEyes".
In this sense, mediated reality is a proper superset of mixed reality
Mixed reality (MR) is a term used to describe the merging of a real-world environment and a computer-generated one. Physical and virtual objects may co-exist in mixed reality environments and interact in real time. Mixed reality is largely synony ...
, augmented reality
Augmented reality (AR) is an interactive experience that combines the real world and computer-generated content. The content can span multiple sensory Modality (human–computer interaction), modalities, including visual, Hearing, auditory, hap ...
, and virtual reality
Virtual reality (VR) is a simulated experience that employs pose tracking and 3D near-eye displays to give the user an immersive feel of a virtual world. Applications of virtual reality include entertainment (particularly video games), e ...
, as it also includes, for example, diminished reality.
Window managers
One common window manager in mediated reality is the "Reality Window Manager".
Wireless mediated reality
With wireless communications, mediated reality can also become a communications medium among different communities. For example, Bluetooth
Bluetooth is a short-range wireless technology standard that is used for exchanging data between fixed and mobile devices over short distances and building personal area networks (PANs). In the most widely used mode, transmission power is limit ...
devices are often used with mediated reality. With the use of EyeTap, such interaction is called "''seeing eye-to-eye''".
Applications
Applications of mediated reality include devices that help people see better, as well as devices for gaming and equipment repair, telemedicine, remote expert advice interfaces, and wayfinding. Mediated reality is also used in robotics and drawing applications such as the "Loose and Sketchy" drawing package.
One key application of computer-mediated reality is healthcare and medicine, which has become a popular research area, specifically beginning in the 1990s with the field growing larger over time. Common research topics include applications of computer-mediated reality in surgery, diagnosing diseases generally, and aiding care of neurodegenerative diseases like Parkinson's. In surgery, studies have shown that the use of virtual reality simulations can be used to reduce error, improve efficiency, and be used generally as training. Other applications in surgery include modeling, which allows for more extensive planning of surgeries prior to the procedure that can also be more personalized to the patient, and image-guided surgery, in which machines and overlays would allow for more accuracy in the surgical processes. There have even been complete telesurgeries, where the surgeon operates on a 3D model of the patient while a robot executes the actions. This has been used for basic surgeries on swine and more advanced surgeries on swine and humans. With neurodegenerative diseases, virtual reality has been used to simulate situations that train memory but aren't reproduce in a standard treatment environment. Virtual reality may also be used for interfacing with a patient in their home, with data sent directly to the physician, or creating games that would encourage these exercises. Virtual reality has also been used to aid those with a fear of heights, anxiety, depression, and autism. It has also been used to reduce patients' pain.
A widely implemented development of computer-mediated reality in medicine is the invention of electronic consultation Electronic consultation is an aspect of telemedicine which involves remote communication between patients and clinicians, or between clinicians and specialists.
E-consult was one of the earlier applications which primary care physicians could use ...
, such as services like Teladoc
Teladoc Health, Inc. is a multinational telemedicine and virtual healthcare company headquartered in the United States. Primary services include telehealth, medical opinions, AI and analytics, telehealth devices and licensable platform servic ...
.
Within video games, the most common form of computer-mediated reality is virtual reality headsets
A virtual reality headset (or VR headset) is a head-mounted device that provides virtual reality for the wearer. VR headsets are widely used with VR video games but they are also used in other applications, including simulators and trainers. VR ...
, such as Oculus Rift
Oculus Rift is a discontinued line of virtual reality headsets developed and manufactured by Oculus VR, a division of Meta Platforms, released on March 28, 2016.
In 2012 Oculus initiated a Kickstarter campaign to fund the Rift's development, a ...
. These are devices that attach to the user's head and immerse their field of vision solely within the game world. Controllers used for virtual reality games range from traditionally designed controllers to controllers designed to track the motions of the user. However, alongside the uses previously mention in medical fields, virtual reality has gained notoriety with Meta
Meta (from the Greek μετά, '' meta'', meaning "after" or "beyond") is a prefix meaning "more comprehensive" or "transcending".
In modern nomenclature, ''meta''- can also serve as a prefix meaning self-referential, as a field of study or ende ...
, formerly known as Facebook
Facebook is an online social media and social networking service owned by American company Meta Platforms. Founded in 2004 by Mark Zuckerberg with fellow Harvard College students and roommates Eduardo Saverin, Andrew McCollum, Dustin ...
, and the introduction of their "metaverse." The metaverse is intended to be designed in a similar fashion to massive multiplayer online games, where users can interact with each other in an interconnected virtual space. It has already been subject to controversy, as a woman claimed she was assaulted in the Metaverse. In addition to virtual reality, augmented reality has also been used for video games. The most prominent example is ''Pokémon Go
''Pokémon Go'' (stylized as ''Pokémon GO'') is a 2016 augmented reality (AR) mobile game, part of the ''Pokémon'' franchise, developed and published by Niantic in collaboration with Nintendo and The Pokémon Company for iOS and Android ...
'', an augmented reality game for mobile devices where Pokémon creatures are displayed through the phone to appear as if they are part of the real world. Other examples of AR games include '' Harry Potter: Wizards Unite'' and ''Ingress
Ingress may refer to:
Science and technology
* Ingress (signal leakage), the passage of an outside signal into a coaxial cable
* Ingress filtering, a computer network packet filtering technique
* Ingress protection rating, a protection level t ...
'', which was developed by the same developer behind ''Pokémon Go''.
Augmented reality technology has similarly been applied with social media applications such as Snapchat
Snapchat is an American multimedia instant messaging app and service developed by Snap Inc., originally Snapchat Inc. One of the principal features of Snapchat is that pictures and messages are usually only available for a short time before th ...
. These lenses range from adding 3D digital objects to pictures to altering the appearance of those in the photos. One of the most common types are beauty filters, which digitally alter the user's appearance to make the user appear more "beautiful." Beauty filters have been correlated to lower self esteem.
Related concepts
Mediated reality is related to other concepts such as augmented reality
Augmented reality (AR) is an interactive experience that combines the real world and computer-generated content. The content can span multiple sensory Modality (human–computer interaction), modalities, including visual, Hearing, auditory, hap ...
(which is a special case of mediated reality), virtual reality
Virtual reality (VR) is a simulated experience that employs pose tracking and 3D near-eye displays to give the user an immersive feel of a virtual world. Applications of virtual reality include entertainment (particularly video games), e ...
, mixed reality
Mixed reality (MR) is a term used to describe the merging of a real-world environment and a computer-generated one. Physical and virtual objects may co-exist in mixed reality environments and interact in real time. Mixed reality is largely synony ...
, etc.Mediated Reality with implementations for everyday life
, Presence Connect, MIT Press journal PRESENCE: Teleoperators and Virtual Environments, Date Posted: 2002 August 6
See also
*
*
*
*
References
External links
Mediated Reality based on the VideoOrbits head trackerDiminished Reality example to show something where Mediated Reality is definitely a proper superset of Augmented Reality
{{DEFAULTSORT:Computer-Mediated Reality
Multimodal interaction
User interface techniques
Cyberpunk themes