Affiliate Disclosure
If you buy through our links, we may get a commission. Read our ethics policy.

Apple's Cover Flow-like 3D desktop UI uses tilt controls to peek around windows

Source: USPTO

Last updated

Apple is looking into a new desktop user interface that puts two- and three-dimensional application windows in a unique browsable "parade" view, much like the company's Cover Flow GUI used in iTunes and iOS apps.


The U.S. Patent and Trademark Office on Tuesday awarded Apple U.S. Patent No. 8,560,960 for "Browsing and interacting with open windows," which at first blush appears to be a modified solution that brings Cover Flow to the desktop. Deeper in the document, however, is language describing a fresh take on usability that implements a secondary mode of input more akin to controls used in an iOS device.

According to the patent's detailed description, a user can tilt the computer to present the three-dimensional desktop "with a raised view level, such that desktop items behind the browsable parade are revealed." This action not only allows for a more immersive interactive experience, but increases viewable desktop space and aids in navigating the UI.

While the current OS X desktop is already somewhat "3D," with drop shadows and other graphical tricks providing an illusion of depth, Tuesday's invention further pushes these established boundaries.

A conventional desktop displays two-dimensional windows and icons on a substantially flat background. Users interact with these on-screen items via a given mode on input, such as clicking on a window to make it active. This means the visible area for presenting windows, icons, and other UI elements is constrained by the size of a device's screen.

Illustration of two-dimensional desktop environment.

As noted in the patent, 3D desktops offer more perceived space with the introduction of a z-axis, but manipulating graphical assets within these environments has proven too complex for previously proposed systems. Apple itself experimented with such techniques in the past, though the technology has yet to be applied to OS X.

To work around the hurdles, the invention proposes an operating system that can seamlessly switch between two-dimensional and three-dimensional environments. In two-dimensions, a user can invoke the familiar expose mode to see all open windows in a tiled view. Alternatively, in a three-dimensional environment, a user can invoke a Cover Flow or "parade" viewing mode, browsable by flipping through active windows.

Illustration of three-dimensional desktop space.

When in 3D mode, the individual application windows act much like their current OS X counterparts. For example, when a window is made active, that application's menu bar is provided directly below the system menu bar. Further, when new windows are opened, the UI places the assets in a stack that can be reshuffled, resized or moved by the user.

Aside from the Cover Flow capabilities, Apple's invention uses two inputs to control the window parade. This is accomplished with conventional computer inputs, like a mouse and keyboard, working in concert with tilt controls. While not specifically explained in the patent, tilting of a device can be recognized by an accelerometer, gyroscope, camera or any other suitable on-board sensor. Alternatively, a tilt command can be invoked via a special key combination or gesture.

Illustration of tilted three-dimensional desktop with active windows.

By tilting the three-dimensional desktop space, users can view an entire group of open windows in the parade from a higher view point. Content previously obscured by an active top window is made viewable, allowing users to select another window without cycling through all open assets.

It is unclear if Apple will implement the Cover Flow window invention in a future version of OS X, but a similar technique uses iOS device sensors to create the "parallax effect" seen in iOS 7.

Apple's three-dimensional GUI patent was first filed for in 2010 and credits Thomas Goossens and Fabrice Robinet as its inventors.



29 Comments

eckergus 11 Years · 96 comments

That is pretty neat. I also wonder if that would be something they would implement on Mac OS or if it is geared to iOS only. I guess we'll have to wait to find out.

enzos 16 Years · 344 comments

iOS? err. the picture is of a Mac. If they have a tabbed finder in Mavericks why not cover low the tabs? Sound like a great idea!

melgross 20 Years · 33630 comments

Apple has had a couple of interesting, but not ultimately useful, tries at a 3D UI before, going back as far as System 9. This looks much more useful. But the computer power available back them wasn't sufficient to do this.

philboogie 15 Years · 7669 comments

It's different, again. They also were awarded a patent back in Feb (filed in 2007 & 2008): [IMG ALT=""]http://forums.appleinsider.com/content/type/61/id/33410/width/500/height/1000[/IMG] [IMG ALT=""]http://forums.appleinsider.com/content/type/61/id/33411/width/500/height/1000[/IMG] source: http://www.patentlyapple.com/ and they have a worthy footnote: [quote] Readers should be aware that every Tuesday the US Patent and Trademark Office publish Apple's Granted Patents. Granted patents are approved patent applications that Apple applied for months or even years ago. In the vast majority of cases, "granted patents" aren't covering any new kind of technology on the day the patent is being granted. New Apple technologies are generally revealed on Thursdays by the US Patent Office in the form of published patent applications. Some Mac sites confuse this process by making claims and presenting bylines on Tuesday that insinuate that Apple has just revealed a new technology or process. In 99% of cases, this is simply untrue and readers should be made aware of this fact. Known exceptions would include patents that were recently acquired by Apple or a domestic and/or foreign patent application that Apple had never presented in the US before under its own brand name. [/quote]