Apple made a significant announcement at WWDC 2023 by unveiling its first-ever AR/VR headset. The annual developer conference showcased Apple’s plans to launch this mixed-reality device in the US market by 2024. To enhance the user experience, Apple has started providing the Vision Pro headset to select developers for testing and improvement. One developer claims that the Apple headset has the ability to create touch controls and displays, including touch control panels on any surface in the room. Developer Steve Troughton Smith shared his findings on Mastodon, highlighting the headset’s features.
According to the report, the Apple Vision Pro allows users to select any surface within their field of view to place a touch display. This functionality extends to all apps, making the keyboard and controls work seamlessly. Although the virtual keyboard on the Vision Pro may not be suitable for long typing sessions, it can transform a user’s desk into a functional keyboard.
The report also mentions that the typing experience on the Vision Pro will be futuristic, as it eliminates the need for physical keys and allows typing on any object in front of the user. However, it’s worth noting that keyboard projectors utilizing laser technology already exist in the market. Apple has been developing the Vision Pro headset for some time and has filed several patents related to its mixed reality capabilities. One of these patents, granted in 2020, describes how the headset can transform any surface into a functional keyboard.