Mixed Reality (MR) blends elements of both the physical and digital worlds, creating an environment where real and virtual objects can coexist and interact in real-time. Imagine wearing a headset that lets you see your actual surroundings while also displaying digital objects that appear to be part of your real world, like a holographic calendar on your desk or a virtual pet running around your living room. It’s a more integrated experience compared to virtual or augmented reality.
On the technical side, MR leverages advanced hardware and software to seamlessly combine real-world and digital content. Key components include sensors, cameras, and depth sensors that map the physical environment. The data from these sensors is processed using computer vision algorithms to understand the space and objects around the user. The headset displays the digital content using transparent lenses or see-through displays, allowing users to see both the real world and virtual elements simultaneously. Real-time interaction between physical and digital objects is achieved through sophisticated spatial mapping and environmental understanding technologies, ensuring a cohesive and immersive experience.
As you can see in the image above, mixed reality is the blending of virtual reality with physical reality and often a splash of other technologies integrated for enhancement. For example, the people sitting around the table are real people, they are just remote to this space and are remotely connected via some telepresence technology. In this advanced example, they appear to be holograms, but they could simply be computer-generated avatars such as the gamer identities shown in the image below.
For most virtual meetings and classroom experiences, a more streamlined approach can be taken. As shown below, the telepresence takes the form of a more familiar video call.
Here’s a demonstration of AI + AR on the shop floor.
Remember, while this is a demo of an everyday workflow, this technology can also be used to introduce (aka train) for new workflows as well.