BMW Group and Meta’s Reality Labs have presented a research update that explores the integration of extended reality devices with the digital vehicle ecosystem.

The update showcases the capability of accurately displaying virtual reality (VR) and mixed reality (MR) content to passengers, even in high speed driving conditions.

Through the combination of Meta Quest’s tracking system and BMW’s sensor data, researchers claim to have achieved a range of reliable and secure in car experiences in gaming, entertainment, productivity, and meditation.

One issue that the research has been aimed at is how current VR headsets “can’t display stable virtual content when travelling inside a fast moving vehicle”.

To overcome this obstacle, data from a sensor array is used with the tracking system of a Meta Quest Pro, enabling the tracking system to determine the device’s position in relation to the real world. This enables precise placement of virtual objects onto a moving car.

Through combining the data from the XR headset sensor with the vehicle’s movements, the headset’s motion in the car could be more accurately tracked.

GlobalData Strategic Intelligence

US Tariffs are shifting - will you react or anticipate?

Don’t let policy changes catch you off guard. Stay proactive with real-time data and expert analysis.

By GlobalData

Content can therefore be created which is synced with the car’s real time movement.

“It is too early to tell exactly how or when this technology will make it into customers’ hands, but we envision a number of potential use cases for XR devices in vehicles from assisting the driver in locating their car in a crowded parking lot to alerting them to hazards on the road and important information about the vehicle’s condition,” said Claus Dorrer, head of BMW Group Technology Office USA.

Just Auto Excellence Awards - Have you nominated?

Nominations are now open for the prestigious Just Auto Excellence Awards - one of the industry's most recognised programmes celebrating innovation, leadership, and impact. This is your chance to showcase your achievements, highlight industry advancements, and gain global recognition. Don't miss the opportunity to be honoured among the best - submit your nomination today!

Nominate Now