A rumored Apple mixed-reality headset could have a suite of high-end eye- and hand-tracking sensors and cameras, swappable headbands, and a visor-like design, according to a new report.
The device could sport more than a dozen cameras for hand movement tracking and to show users a video feed of the world. It could also have advanced eye-tracking technology and ultra-high-resolution 8K displays, along with a "bevy" of other features, The Information reported on Thursday.
Apple MR headset features
Late stage prototypes and concept images of the device show a curved visor-like form factor with that attaches to the face with a mesh material and swappable headbands. The Information created a concept rendering of the headset based on images of Apple's prototypes.
Instead of a pure augmented reality (AR) device, sources within Apple said that the visor is being internally referred to as an MR device because of its "ability to combine virtual reality experiences with games and other applications that use real-life objects surrounding the person wearing the headset."
Currently, the focus of the device could be games or possibly productivity and education applications. The device, codenamed N301, is said to immerse a wearer in a fully virtual environment like Oculus Quest. It will also block a user's peripheral vision, but will pass a view of the world around them to create a mixed-reality effect.
In addition to hand- and eye-tracking, Apple is also developing other control mechanisms for it. One possible method would be a thimble-like device worn on a user's finger that could allow them to control software. It isn't clear if that accessory will be bundled with it or sold separately.
Some prototypes also appear to have a physical dial or crown on the side. All versions appear to have LIDAR technology, which Apple already uses in its iPhone and iPad Pro lineup to quickly map objects and environments.
An outward-facing display on the device could show users information when it's not in use. Interchangeable headbands could feature spatial audio technology like the AirPods Max or AirPods Pro. Users will be able to charge it with a cable, though Apple is also working on a swappable headband with additional battery life.
According to Apple sources, the MR device will come equipped with in-house chips. Apple may also be planning to reduce computer power by showering lower-quality graphics in a user's peripheral vision. The inclusion of 8K displays will make its overall picture quality much higher than other consumer headsets, and even most high-end televisions.
Apple MR headset release date and price
The device could ship as early as 2022. Apple has reportedly tapped Pegatron to assemble it. However, because of the complexity of the device and the risk with entering a new niche product market, Apple could ultimately decide to scrap or shelve the project.
Price could add to the risk. In 2020, Apple reportedly discussed pricing the device around $3,000 — more expensive than an MacBook Pro but less expensive than Microsoft's $3,500 HoloLens.
Initially, Apple has talked about a goal of shipping about 250,000 units of the device in its first year of release. That's largely due to its high price.
Apple's past augmented and virtual reality work
Apple has been developing virtual reality, augmented reality, and mixed reality technology for years. In addition to rumors of various headset devices and its public work on ARKit, the Cupertino tech giant also has a slew of patents related to head-worn devices.
Many of those patents and patent applications focus on eye tracking, which the MR headset is said to have. Other patents detail different systems, including technology to keep users from bumping into real-world objects while immersed in a virtual environment.
Back in March 2020, an early iOS 14 leak also suggested that Apple was working on controller-like accessories for a virtual reality product.
The MR headset is also not the same device as Apple's rumored AR-based "Apple Glass." That device is said to have a more glasses-like device, a much lower price point, and a bigger focus on complementing an iPhone in a user's day-to-day life.
Back in September 2020, a former Apple executive predicted that Apple's first foray into head-worn visual devices would be a virtual reality - instead of an augmented reality — device.
According to The Information, Apple is still working on a pair of "lightweight smart glasses designed to overlay objects onto a person's view of the real world." That device, which is facing steep technological hurdles, is still years away from release.
In October 2019, Apple planned to ship its MR headset by 2022 and its "Apple Glass" AR device in 2023. Those plans may have changed.
22 Comments
Can the average person pay $3,000 for a headset like this? Can an above-average earner even afford this? This needs to be completely disposable income (I’m sure this will be somewhat controversial and there will be many different views on how income would be determined to be disposable). Most people that will buy this should probably be putting that money in a retirement or savings account and planning for their future. The people that can afford this without any considerations, probably have all the money they need. I mean, I could afford these if they came out right now, but I don’t think I could justify it. Maybe those are just my demons.
It costs as much as one of their higher-end laptops. I’m already having issues with the high cost of their iPhones even though I can afford one for myself and my partner every year at the current cost. It just seems like a whole lot.
Of course the thimble will be extra...
DOA IMHO.
This rumor sounded nuts to me until I saw in the article that MS has a $3500 product in this space. Wow.
I think I'll wait until Apple actually announces something and explains the expected use case before I venture an opinion. This could be an industrial product for all I know.