Meta has released a significant update to its MR Utility Kit SDK for Unity, empowering developers to easily integrate QR code decoding and six-degrees-of-freedom (6DoF) tracking into their Quest 3 applications. This new system-level feature streamlines the process, requiring only the Spatial Data permission, a less intrusive alternative to the Headset Camera permission.
Key Takeaways
- The Meta MR Utility Kit SDK for Quest 3 now supports QR code tracking.
- This feature provides 6DoF positional pose, 2D bounding box, 2D boundary polygon, and decoded payload.
- It requires only the Spatial Data permission, not the Headset Camera permission.
- The update is available in v78 of the SDK and supports Quest 3, Quest 3S, and future Horizon OS headsets.
Enhanced Mixed Reality Capabilities
Previously, developers could implement QR code tracking using custom or third-party computer vision libraries by accessing the Quest 3’s passthrough cameras. However, the latest MR Utility Kit update introduces this functionality as a built-in system-level feature. This significantly simplifies implementation for Unity developers, making it quicker and more accessible.
When enabled, the SDK offers developers a comprehensive set of data for each tracked QR code. This includes its precise 6DoF positional pose, a 2D bounding box for its outline, a 2D boundary polygon, and the decoded payload, such as a URL or other relevant information.
Integration and Use Cases
The QR code tracking capability joins the existing Keyboard trackable within Meta’s MR Utility Kit, bringing the total number of system-level trackable inanimate objects on the Quest 3 to four, including Touch controllers and the Logitech MX Ink stylus. Meta emphasizes that, similar to keyboard tracking, the position update rate is relatively low. This means it is not suitable for real-time tracking of fast-moving objects but is effective for static or slowly moving QR codes.
Developers are advised to enable this feature dynamically when needed, as it does incur a performance cost. Potential applications include:
- Improved Colocation Calibration: Offering a more reliable method for initial calibration compared to Meta’s Shared Spatial Anchors system.
- Enterprise and Location-Based Applications: Enhancing enterprise solutions and location-based VR/MR experiences.
- Consumer Applications: Allowing users to display QR codes on their phones or tablets for interaction, addressing the limited availability of printers in many households.
Availability
QR code tracking is an optional feature within version 78 of the Meta MR Utility Kit for Unity. It is compatible with the Quest 3 and Quest 3S, as well as all subsequent Horizon OS headsets. The feature supports QR codes up to version 10.