Affiliate Disclosure
If you buy through our links, we may get a commission. Read our ethics policy.

Development of Apple's smart glasses continues despite massive hurdles

Renders of what Apple Glass could look like


The long-rumored Apple Glass may eventually become Apple's wearable future, with development of the smart glasses hitting hurdles that even Apple's rivals are having to deal with.

The Apple Vision Pro is Apple's first attempt at a head-mounted display, as a project that sucked a considerable amount of resources to produce. That device is far from the end goal for Apple, with the ultimate aim being the introduction of smart glasses.

It's been a long road so far, but there's still a lot more distance for Apple to travel in order to get to that goal.

Apple is still keen to get there, despite seeing its competitors face difficult hurdles and the prospect of spending even more on a project that's still years away from realization.

A continued push

In Sunday's newsletter, Bloombergwrites that Apple is still working on the technologies behind the concept, but knowing full well it's years away from release.

Within Apple's offices, it is reportedly conducting user studies to determine the appeal of various features and interfaces that the glasses could use. This also reportedly included creating a version of visionOS meant for use with the glasses.

Apple's use of in-house testing for head-mounted technologies has been going on for quite some time already, though it has taken extraordinary circumstances for that secretive work to come to light.

In 2017, it was revealed in a leaked report from an Apple Environment Health and Safety contractor that a person required "medical treatment beyond first aid" after testing a prototype. Eye discomfort was reported, after they saw a laser flash multiple times.

That work continues to be handled today by a secretive facility in Santa Clara, down the road from Cupertino. Those offices are handling the development of the AR screens, among other important technologies.

The location has fewer staff than usual, as there were layoffs at the facility in 2024. The decision to kill off in-house smartwatch display development may have impacted Apple's research into smart glasses displays as a byproduct of the layoffs.

While smart glasses are the obvious thing for Apple to be working on, it's still looking into other items in the wearables space. There's talk of a rival to the Meta Ray-Ban spectacles and possibly camera-equipped AirPods.

Off-road vision

Apple's development of its wearable augmented reality (AR) technology was born from its self-driving car work. Originally meant as a display embedded into the windshield, the concept was considered too expensive to implement in a normal vehicle.

The idea was scaled down a lot more, despite coming up with a working prototype. Instead, it was envisioned that everyone would wear headsets, which could provide all of the data but in a smaller and more manageable package.

While this was a non-starter, the vehicle group still worked on AR technology. It also used VR headsets to demonstrate the capabilities of the in-development car project.

At the time CEO Tim Cook believed that AR was the way forward, superimposing images on a real-world view, not in an isolating way as with VR goggles.

Executive Mike Rockwell pulled the AR and VR work out of the car project and into what is now the Apple Vision Pro division. That team then spent two years making a headset prototype that used a pass-through system with external cameras, which Apple uses today in the Vision Pro.

Despite spending billions on the VR headset, Apple continued to work on producing the technology to create the proper AR smart glasses that it wanted as a follow-up.

A shared challenge

Like the creation of its headset, producing smart glasses with AR features is a technical nightmare. It's a hard set of problems to solve, ranging from creating the image in front of the user's eyes to producing something light enough to be like regular spectacles.

All while dealing with other long-term issues like handling processing and communications, and somehow hiding a battery on the frame.

However, Apple is far from the only company to be working on smart glasses.

Man wearing black smart glasses, looking upward, with bookshelves in the blurred background. Meta Orion

Meta's Orion AR glasses prototype is expected to arrive as a product in 2027, making it a very early release in the field.

Then there is Google, which is producing the Android XR operating system intended for next-gen headsets and smart glasses. Gurman writes that Google demonstrated the operating system to him in December using various glasses, including some with displays.

Those prototypes were considered to be quite polished, but unlikely to reach the open market until the harder challenges like battery life are solved.

Batteries are a massive problem for VR headsets now, let alone lightweight spectacles. It's a weight that must be minimized and carefully placed so the glasses don't feel heavy to wear, which is extremely hard for a purposefully lightweight item like spectacles.

Apple certainly has to come up with a better answer than the current tethered battery on the Apple Vision Pro. But, short of magically making batteries as light as air, it's a difficult problem to solve.

That said, tethering to an iPhone or another device could help further, by handling processing for the glasses. This offloads another set of components and reduces the power draw, but it still means it'll be connected to another piece of kit.

Apple's rivals are also coming up with more immediate product releases too, which Apple has to consider. Meta's making not only the Quest 4 VR headset, but a follow-up to the Quest Pro. Samsung also demonstrated its own "Moohan" mixed reality headset during the January Unpacked event.

Both Google and Samsung have made noises that their efforts will be cheaper than the Apple Vision Pro, with release dates later in 2025.

These are immediate issues that could cause problems for the Apple Vision Pro, but then again, the headset has struggled to gain much traction since launch.

The competitors benefit from getting more time sharing newer products with consumers, with a shorter iteration time from the immediate consumer feedback, rather than seriously damaging Apple.

The ultimate test will be within a few years, when Apple is ready to come to market with smart glasses, with an intention to replace the smartphone. By then, its rivals could've released multiple headset and glasses iterations and gleaned that all-important feedback, making it very hard for Apple to make a splash in the right way.



11 Comments

twolf2919 3 Years · 161 comments

"

That said, tethering to an iPhone or another device could help further, by 
handling processing
 for the glasses. This offloads another set of components and reduces the power draw, but it still means it'll be connected to another piece of kit." - these two sentences, buried in the midst of the article really solves all the problems, doesn't it.  And Google did this some 10+ years ago with Google Glass, so with 10+ years of miniaturization later, Apple should be able to produce something much better (and Google Glass was already pretty good at the time!).

I suspect lack of vision at Apple is to blame - by not having a strong and visionary leader, some committee probably decided that a standalone VR device was the answer.  First a helmet (the Vision Pro) would eventually be miniaturized into glasses.  But given how much CPU power and ancillary devices (e.g. extremely high-res screens) are needed, it's never going to result in regular glasses people would want to wear.

And why is "connected to another piece of kit" such a big deal anyway?  The Apple Watch isn't standalone and became a great success.  The iPhone with ARKit already has the capability to display AR - so all that would need to be done is put the same images it currently displays on the phone's screen onto a screen in the glasses and what the phone camera currently sees and gets processed for AR would be delivered by cameras in the glasses.  If the glasses only deliver sensor data to the phone and displays images coming from the phone, battery capacity is much less of an issue.  The only missing piece of the puzzle is user interaction when there's no touch screen (phone is in pocket).

3 Likes · 2 Dislikes
charlesn 12 Years · 1295 comments

This is why Vision Pro is such an important product for Apple and one of the best uses for the Everest-sized mountain of cash on which Apple is sitting. It may take a while, but it's a certainty that technology will evolve to give us some future "Vision Pro" in a smart glasses form factor. But that only solves the hardware part of the equation. You still need an OS that's capable of leveraging a vision driven computer and the smart glasses form factor in the most useful, creative and intelligent ways. You need an OS that will have worked out a lot of the potential problems. Or you just end up with another Google Glass. Or you end up like Meta, with over a decade and countless billions of dollars invested in headsets, without a single penny of profit ever to show for it. And I have no doubt that the smart glasses it drops in 2027 (or 2037, considering the Zuck's usual over optimism about delivery) will continue Meta's history of manufacturing loss leader hardware. The Vision Pro product will continue to be the ever-evolving real-time laboratory in which Apple works out its smart glasses. A mass market hit product was never the point of Vision Pro, nor does Apple need it to be that. With a user base of a half million and counting, Apple has the benefit of feedback and innovations from actual users that it never would have had without releasing VP 1.0. 

2 Likes · 1 Dislike
tht 24 Years · 5732 comments

Is there anything else from Gurman? Seems like a nothing burger of an article. 

Why yes, Apple is toiling away at an AR glasses product that they know will take years, 2030s, to become a product. Also true for metalens cameras, M7 SoCs, folding displays, satellite communication functionality, 7000 PPI microOLEDs, LLM functionality, etc. 

See-through AR, the putative eyeglass product that everyone is trying to get to, will have its positives and negatives. There are features and functionality that won’t be as good as the existing Vision Pro, let alone what a Vision Pro could be in 2030. 

A pass-through AR product line (Vision Pro or goggles) and a see-through AR product line (eye glasses) probably will co-exist. 

1 Like · 0 Dislikes
charlesn 12 Years · 1295 comments

twolf2919 said:
I suspect lack of vision at Apple is to blame - by not having a strong and visionary leader, some committee probably decided that a standalone VR device was the answer.  

Steve's death was widely believed to be the end of Apple. Oh, sure, it might hang around a while, squeezing whatever remaining juice it could out of "Steve's" products, but the company itself was now on death watch with its singular and visionary leader gone. Tim Cook? Oh, please. So where is Apple now, 13 years later? Is it dead yet? Or is it just a sad, barely profitable shell of its former self, surviving on Steve's work? NO. It is exponentially far more successful than it ever was under Steve's leadership, as measured by any of the metrics used to determine a company's level of success. Oh, but then surely Tim has done nothing but run the photo copier on Steve's products. NO, again. Apple Watch. CarPlay, Airpods. Apple Silicon, And, most importantly, Services, which is already generating 50% of iPhone revenues, growing exponentially faster and has a profit margin that's more than double that of iPhone. All of that happened under Tim, years after Steve was gone. Between its rapid growth and huge margins, Services is poised to be more profitable within the next few years than ALL of Apple's hardware products combined. That's right--all of them. Don't believe me? In a recent quarter last year, hardware profit was $22 billion... and services profit was $18 billion. 

But out here in the technosphere echo chamber, the incredible growth that Apple has achieved under Tim, a level of success that was unimaginable while Steve reigned. doesn't count because Tim has failed to deliver some undefined, unnamed, imaginary new piece of hardware that the technosphere demands as proof of his "vision," even though they can't articulate what the product might be. His vision doesn't count because it doesn't suit their perception of vision. Most successful watch in the 200 year history of watches? Doesn't count. Most successful audio product in the history audio products? Doesn't count. A game-changing transition to Apple's blazingly fast processors that occurred with barely a hiccup? Doesn't count. It doesn't count because Tim didn't fulfill some hidden desire you have for some product you can't even describe. But Tim should have made it by now! Fortunately, Tim isn't distracted by all this ridiculousness coming from the tech peanut gallery and he continues his 13 year streak and counting of making Apple more and more successful. As someone who puts his money where his mouth is when it comes to Apple by investing in the company, Tim's strong and visionary leadership has been incredibly rewarding: it was a $14 stock when Steve died. It just closed on Friday at $223. 

2 Likes · 0 Dislikes
mpantone 19 Years · 2280 comments

tht said:
Is there anything else from Gurman? Seems like a nothing burger of an article. 
Why yes, Apple is toiling away at an AR glasses product that they know will take years, 2030s, to become a product. Also true for metalens cameras, M7 SoCs, folding displays, satellite communication functionality, 7000 PPI microOLEDs, LLM functionality, etc. 

See-through AR, the putative eyeglass product that everyone is trying to get to, will have its positives and negatives. There are features and functionality that won’t be as good as the existing Vision Pro, let alone what a Vision Pro could be in 2030. 

A pass-through AR product line (Vision Pro or goggles) and a see-through AR product line (eye glasses) probably will co-exist. 

This is one of the few thoughtful comments I have read about the whole AR effort. Most people seem to think it's all or nothing, one or the other, rather than co-existing (and hopefully complementary) product lines.

My guess is that Apple had been prototyping a variety of AR devices in their labs and the Vision Pro googles were the first that management deemed as "commercially viable" which is a stretch with the $3500 price tag. My guess is that see-through AR products will eventually come but it's nearly impossible to say when it will happen. My guess is that some AR-related API will show hints of a product before Apple actually announces it.

Let's remember that this is not a SoC upgrade to an existing product like iPhones or Macs. This would be a new product line and they have consider software work to do to get something like this off the ground.

One thing that is clear is that AR glasses will need to do 1, 2, maybe 3 things way better than an iPhone by itself. This was the case with Apple Watch which ends up being even better as A.) a health monitor, B.) an activity tracker, and C.) as an NFC contactless payment device (think public transit fare gates, not the POS terminal at McDonalds).

It's up to Apple to figure out 2-3 killer features that make AR glasses a better experience than raising your phone to your face.

Note that weight, fit, and comfort (and for some fashion) are all critically important for eyewear. I have several pairs of eyeglasses that weigh between 25-30 grams and I still take them off periodically for a break. I know a lot of people ignore the comfort factor but it's actually important to many people.

Trust me, I am a longtime owner of an Oculus Rift S (weight 500 g or 1.1 lbs.) and I find it unbearable to wear for more than 45 minutes. If AR glasses are going have any widespread consumer uptake, they need to come in below 100 g, the less the better. They also need to be washable and survive a modest drop, stuff that the AR pundits always seem to avoid mentioning.

2 Likes · 0 Dislikes