Mixed Reality (MR)

Futuristic Graphics for decoration only.
Fuzzy numbers:
<40% Virtual + 60%< Real

Mixed Reality (MR) blends elements of both the physical and digital worlds, creating an environment where real and virtual objects can coexist and interact in real-time. Imagine wearing a headset that lets you see your actual surroundings while also displaying digital objects that appear to be part of your real world, like a holographic calendar on your desk or a virtual pet running around your living room. It’s a more integrated experience compared to virtual or augmented reality.

On the technical side, MR leverages advanced hardware and software to seamlessly combine real-world and digital content. Key components include sensors, cameras, and depth sensors that map the physical environment. The data from these sensors is processed using computer vision algorithms to understand the space and objects around the user. The headset displays the digital content using transparent lenses or see-through displays, allowing users to see both the real world and virtual elements simultaneously. Real-time interaction between physical and digital objects is achieved through sophisticated spatial mapping and environmental understanding technologies, ensuring a cohesive and immersive experience.

A person is presenting in a meeting assisted with virtual tabletop models to holographic attendees.
Mixed reality – the guy standing up is real, the table is real, the models on the table are virtual, the people around the table are real but are remote to this room and represented by their avatars.

As you can see in the image above, mixed reality is the blending of virtual reality with physical reality and often a splash of other technologies integrated for enhancement. For example, the people sitting around the table are real people, they are just remote to this space and are remotely connected via some telepresence technology. In this advanced example, they appear to be holograms, but they could simply be computer-generated avatars such as the gamer identities shown in the image below.

A person is participating in a gaming session with virtual players remotely connected and represented by cosplay style gaming avatars.
Mixed reality – the guy with his hands together is real, the table is real, the models on the table are virtual, and the heroes around the table are real but are remote to this room and represented by their gaming avatars.

For most virtual meetings and classroom experiences, a more streamlined approach can be taken. As shown below, the telepresence takes the form of a more familiar video call.

A person holds a video call with three other people on camera.
Mixed reality – the guy with his hand in his pocket is real, the room is real, and the people on the screens are real but are remote to this room and represented by their shared cameras.

Here’s a demonstration of AI + AR on the shop floor.

AI + AR is the new reality

Remember, while this is a demo of an everyday workflow, this technology can also be used to introduce (aka train) for new workflows as well.

MR in pop culture

A long time ago in a galaxy far, far away.… they had better MR than we do!