Neil Hughes
The U.S. Patent and Trademark Office this week revealed a patent application from Apple related to 3D picture taking, entitled "Systems and Methods for an Imaging System Using Multiple Image Sensors." First discovered by AppleInsider, the filing describes a system that would capture, process and render 3D images with the accompanying dual-camera hardware.
The application refers to Apple's approach as a "paradigm shift from the known software-based approaches." It notes that current software must "guess" at how to perform stereo disparity compensation for 3D images.
Those guesses, Apple said, can result in images with artifacts in a composed 3D image that would result in a poor quality photo. Apple's method would instead employ a hardware-based approach with a "deterministic calculation for stereo disparity compensation."
Apple would create hardware with multiple imaging systems, employing separate luma, chroma and depth/distance sensors to capture images that can be turned into a single, three-dimensional picture.
In addition to still images, Apple's system would also be able to record video in 3D. Setup and calibration of such a system would be a simple one-time event, the application claims.
3D picture taking capabilities for the average consumer just arrived in the U.S. this week, with the launch of the new Nintendo 3DS handheld gaming console. Nintendo's portable device features two rear cameras for capturing still pictures and playing augmented reality games in 3D.
On Nintendo's gaming system, the 3D content is shown on a glasses-free 3D display. Of course, if Apple were to offer 3D picture taking capabilities on a future device, it too would need to feature 3D display capabilities.
The patent application revealed this week is not the first time Apple has shown interest in 3D imaging. In 2009, the company explored 3D display capabilities with head tracking technology, while in 2008 it was revealed to be researching auto-stereoscopic 3D display hardware. The Cupertino, Calif., company has also shown interest in a 3D interface for Mac OS X.
The patent application revealed this week by the USPTO is credited to Brett Bilbrey and Guy Cote. It was first filed in September of 2009.
William Gallagher
Marko Zivkovic
Amber Neely
Christine McKee
Andrew Orr
Malcolm Owen
25 Comments
Would be interesting for a MacBook or iMac. I think it could also link to their previous patents on being able to move the desktop display through tracking potentially? Also depth perception, possible uses could link up to it. We haven't seen much from Apple in regard Kinect like body or hand gestures (or being able to identify hand position and gestures. Guess we'll see if they want to go in that direction.
Sounds like they wanted to patent an idea to have a foot in the door, than push through an iPod Touch with a 3D camera?
How would this fit today, or with Lion?
Of course, if Apple were to offer 3D picture taking capabilities on a future device, it too would need to feature 3D display capabilities.
That's not true. Twin cameras make AR apps much more powerful, but you could happily interact with those apps using a regular 2D display. That's not to say people might not clamor for a 3D display, just because they wanted one. But twin cameras have utility without such a display. (Edit: I was a little too fast to reply, and I think it looks like I'm commenting about something just to the side of the point you're making. What I had in mind was a video I saw of a guy who used a 2-camera device to turn a flat real-life game board into an AR zombies game, where zombies are walking down the street, and the device screen acts as a camera on the scene. He moves around gets a different view of the streets below. It was very cool. The device was essentially taking a 3D picture over and over and used that to generate scene information for the AR)
Let's see if all the iFanboys will suddenly change their mind and start liking 3D on their phones. The same iFans who blasted this feature on Android phones.
I'm interested, would be real cool if the Live Chat sites use it (until you click on a good-look'n thumbnail and the live 3D baaadddddd). Meaning maybe 3D isn't isn't the best for everything.
Photography in general has not been an area that Apple has shown consistent passion for.
The only iDevice with a good camera is iP4. Then they followed up with disappointing sensors in the iPod Touch and iPad 2. Whether the rationale was costs or design (to keep the devices thin), it was still disappointing.
Hopefully this signals a growing interest to conquer the hearts and imagination of more photo-buffs.