The future of mixed reality

People seeking to feel fully immersed in virtual environments will soon be able to experience a revolutionary approach to spatial computing that bridges the gap between real and digital worlds. A collaborative research team from NTT DOCOMO, Inc. and Nara Institute of Science and Technology (NAIST), Japan, has developed a novel mixed reality (MR) technology that transforms how users interact with virtual spaces by using everyday real-world doors as natural transition points.

Virtual reality (VR) and MR technologies have long faced a critical challenge—creating a truly immersive experience that feels natural and intuitive. Existing spatial computing applications in VR and MR typically use artificial barriers or abrupt transitions between real and virtual spaces, breaking user immersion and creating a disjointed experience.

To this end, the research team, led by Dr. Daiki Hagimori from NTT DOCOMO, Inc., and Professor Kiyoshi Kiyokawa from NAIST, developed a solution to address this problem. The team includes Hideaki Uchiyama, Monica Perusquía-Hernández, and Yutaro Hirao from NAIST. Through a sophisticated software system compatible with Apple Vision Pro and similar head-mounted displays, the team managed to create seamless transitions between physical and virtual rooms.

Highlighting the unique feature of their technology, Prof. Kiyokawa explains, “To date, no system enables users to physically operate real doors—including all associated sensory feedback—as entry points to virtual spaces.”

The new technology allows users to select a real-world door within their MR interface by simply marking two of its corners. Once identified, the door becomes a smart portal between physical and virtual environments. As the user opens the door, the system dynamically renders a virtual space beyond the door, creating an unprecedented sense of natural transition by leveraging existing physical architecture.

The developed system uses advanced hand movement recognition that does not require users to focus specifically on the door handle, making the interaction intuitive and seamless. Moreover, after the user enters the virtual space, the open door seen from inside still looks like a dynamic window back to the real world.

“By incorporating academic expertise from NAIST into the technology that was under development by NTT DOCOMO, a refined system was created,” shared Dr. Hagimori.

This technology offers transformative potential across multiple industries. While in the tourism industry, users could virtually step through a door into destinations around the world, applications in real estate would allow potential buyers to take immersive property tours. Entertainment and art industries could create new forms of interactive storytelling where physical spaces become gateways to rich virtual worlds.

As Prof. Kiyokawa puts it, “Our goal is to develop what we call “Personalized Reality’—systems capable of creating dynamic experiences tailored to each individual.”

They plan to showcase this novel MR technology at Keihanna Expo in Yumeshima, part of Expo 2025 in Osaka, Kansai, Japan, on Wednesday, April 23, and Friday, September 19, 2025, offering visitors a firsthand experience of this innovative approach to spatial computing. Moving forward, NTT DOCOMO, Inc., and NAIST will continue collaborating to refine this technology and explore its potential applications across various sectors.