Microsoft has recently filed a patent for an advanced eye-tracking technology designed for its augmented reality (AR) devices, particularly those similar to HoloLens. This comes shortly after reports of the company’s efforts in developing micro-LED display technology for such headsets.
The patent outlines a mixed-reality head-mounted device (HMD) utilizing a transparent waveguide display and hand tracking to facilitate user interaction with virtual elements and receive additional audio and tactile feedback. In practical terms, an individual wearing the device could navigate a real city while the glasses display information about nearby locations and objects, reminiscent of the recent Google Maps AI update.
This technology creates a fusion of real-world surroundings and virtual elements, enhancing the user experience by incorporating sounds and vibrations to make virtual interactions feel more tangible. Notably, the implementation of this eye-tracking system contributes to lighter devices, increased efficiency, and improved battery life.
The working principle involves a lensless camera and machine learning to track the user’s eyes and hands without the need for reconstructing the original images. This enhances efficiency, accuracy, and compactness compared to conventional body tracking systems. The internal components consist of an optical mask, an outward-facing sensor, and an illumination source.
To capture an image of the user’s body parts, the system utilizes a lensless camera. The image is encoded using an optical mask, rendering it unrecognizable to the human eye. Subsequently, a sensor captures the scrambled image, which is then processed by a computer program capable of identifying body parts within the scrambled image without the need for prior unscrambling.
This patented eye-tracking technology showcases Microsoft’s commitment to advancing the capabilities of AR devices, offering users a more immersive and efficient experience.
