Emerging Technology On "Mixed Reality" (MR)

Introduction

In the field of Information and Communication Technology, there are quite a number of computer-simulated realities that have been emerging over the time, and have also been gaining massive advancements. We have; as it were; heard of the "Augmented Reality", and the "Virtual Reality", but do you know that these realities can be hybridized to form another reality? This reality is called "Mixed Reality" (MR). Hang on guys; because I would be dropping some bonus tips in the course of this survey.

[Image Source: Pixabay. CC0 licensed]

For a better understanding of the concept of mixed reality, I would briefly explain the concept of augmented reality and virtual reality, and I would do that with some practical examples and real life scenarios for a easier understanding even for the uninitiated.

Concept of Augmented Reality (AR)

Augmented Reality can be viewed as a computer-simulated enhancement or improvement of an environment that is already in existence. In this type of reality, there is no need to create an entirely new virtual world, but to leverage on the pre-existing one in other to alter some perceptions of it. This is just like the process of adding virtual elements to an already existing reality; and not necessarily creating a new one.

Here's a little example to make you understand this concept: You have a computer, and you needed to work on some 3D animations; maybe for a school project; but instead of working on it directly from the computer screen, you project it holographically to the mid-air. In this way, you can have a full overview of the animation in many perspectives, but you've also altered the physical world surrounding the holographically projected animation.

By inference, augmented reality changes your perception/view of the "True Reality" (that is the real world). But just like you will see later, this is almost opposite of the virtual reality which substitutes the "true reality" with a computer-created one.

[Image Source: Pixabay. CC0 licensed]

Now we have seen briefly the concept of the AR, let us look at the VR. But before I continue, here's a little tip for you: The virtual reality cuts you off from the real world, but the augmented reality keeps you in the real world with some enhancements to alter your sense of perception of the real world. Here's what Tim Cook, the CEO of Apple (makers of Apple AR glass) had to say about augmented reality in comparison to virtual reality:

... Virtual reality closes the real world, while augmented reality makes you to be present in the real world but with an enhancement of it... - Tim Cook. Source. [Paraphrased by me]

Concept of Virtual Reality (VR)

You may have already had a brief insight of VR from the tip I dropped earlier, but onus is still laid on me to explain it a bit further. Virtual reality is the computer-simulation or creation of an entirely new environment which is different from the "true reality" (real world). In the VR, it makes the individual feel like he is in another world (or rather; in a simulated world). Majorly, this is done by cutting off your perception of the real world with; maybe; a VR headgear, which projects a simulated imagery directly to you.

Here's a practical example of virtual reality; you can put on a VR headgear (like the oculus rift) and have a projection or simulation of you walking alongside Dinosaurs, and maybe playing with them. But in the real world, we all know that this is practically impossible, but it can be simulated. In other words, the VR reflects an environment which is 100%; or for the major part of it; generated digitally.

[Image Source: Pixabay. CC0 licensed]

Ok now we have had an overview of the concept of both the augmented reality and the virtual reality, we will be looking at what the result of merging the both of them will be.

Augmented Reality + Virtual Reality = Mixed Reality 

Mixed Reality (MR) is an environment gotten from the hybridization or combination of the augmented reality and the virtual reality. Here's another little tip for you before I continue: The qualification of a "perfect" mixed reality is one that you can flawlessly navigate between and within the environments of augmented reality and virtual reality.

The technology of mixed reality is made possible by the Immersive Technology. And just as you may have known, Immersive Technology is a kind of technology that creates the perception of being immersed in a form of digital world. Thus, blurring out the dividing line between the "true reality" and the "simulated reality". And this can either be in form of full-immersion, or partial (perceptual) immersion. In the initial, the user fully communicates with the digital world (more like being physically present in a digital world), but in the later, just a part of it is perceived by the user.

The above concept of immersive technology will help you understand how the mixed reality works. One of the examples of mixed reality is the photorealistic virtual fixtures which can allow the user to manipulate and directly communicate with the environment; just as the picture shown below depicts.

[Image of Virtual Fixtures system. Source: Wikimedia Commons. Author: AR Trends. CC BY-SA 4.0 Licensed]

So by inference from the explanation I have given so far, mixed reality is a continuous series of extension; to and fro; the virtual reality and the augmented reality. According to Fumio Kishino and Paul Milgram on the concept of mixed reality:

Mixed reality is any part between the extrema (maxima and minima) of the virtuality continuum. - Fumio Kishino and Paul Milgram. Source. [Paraphrased by me]

By summation, this signifies any point that lies in between the extremity of augmented reality and that of the virtual reality (that means; from the true reality to the augmented virtuality, to the augmented reality, then to the virtual reality, and back to the real world).

Yeah! I made mention of the Augmented Virtuality (AV), this is a tributary of the mixed reality which combines the "object" of the true world into the objects of the virtual or simulated world. The augmented virtuality has also been used interchangeably with the mixed reality; which for the major part of it; is actually correct.

Applications of Mixed Reality

This survey would not be complete without mentioning the applications of the MR. And among the hosts of applications, I would just mention two:

• In educational sector: This can come in handy in the electronic learning system, in which students can interact electronically with the learning environment. It can also be useful in the virtual classroom system of learning.
• In the military: Before for a real combat, a simulation can be run with an element of the real combat in it to get the soldiers acquainted with what to expect in the real combat scenario.

Conclusion

As you have seen, realities can be created and not only being created, but an existing one can also be enhanced to suit the user's perception. This is actually what mixed reality is all about. Now the true world and the virtual world can be merged (just like in the movie "king of fighters"). Technology keeps getting better.

Thanks for reading

References for further reading: Ref1, Ref2, Ref3, Ref4, Ref5

All Images are CC licensed and are linked to their sources

gif by @foundation