The U.S. Patent and Trademark Office on Tuesday issued Apple a patent for an audio-based input system in which various noises made on a laptop's chassis are translated into actions, basically turning the computer into one large input device.
Apple's U.S. Patent No. 8,441,790 for an "Electronic device housing as acoustic input device" describes a system in which user input, such as taps, scratches or other noises, are picked up by acoustic transducers or microphones integrated into a device's chassis. These sounds are then processed, with corresponding actions resulting from comparison with predefined waveform data.
In one embodiment, the audio transducer or transducers "sense" a sound wave generated by user's interaction with an electronic device. When coupled with a microprocessor, the sound can be distinguished and interpreted to output the appropriate signal.
From the patent description:
The interpretation maybe based on the type of input, nature of the input, the location of the contact on the housing, the amplitude of input, as well as other various other factors. For example, a scratch may be interpreted differently from a tap, and so forth. Additionally, a tap on the housing near an output or input device may actuate the device whereas a tap on another surface of the housing may be interpreted as a keystroke.
A sound "vocabulary" is employed to distinguish patterns and locations of noise input. For example, three taps near a camera can turn said device on, while another tap can snap a picture. Other forms of interaction, such as scratching or moving a finger along the device surface, can also be interpreted.
As computers tend to have moving parts like a hard drive or cooling fans, the patent calls for acoustic isolation in the form of either physical barriers constructed around the noisy components. Another embodiment calls for a software-based solution that ignores the sound signature of a certain part, for example a DVD drive. Noise interference can also be dealt with by subtracting signal data from an external transducer, much as the iPhone cancels sound with its secondary microphone.
Apple notes that the invention can be used as a replacement for a physical keyboard, with the sound of tapping on a computer housing being enough to generate the appropriate onscreen information. For example, micro perforations backlit by LEDs or a solid surface can be used instead of a QWERTY keyboard. The system can also be configured for use as a trackpad.
When applied to a mobile phone, the patent can be used as a simple input gesture, such as stopping an call from ringing. One of the more interesting examples described is when a user drags their finger up or down on the back of a device, thereby increasing or decreasing volume output. Yet another embodiment allows a user to tap a device housing near a specific component like a camera or speaker to activate it.
It is unknown if Apple will deploy such technology in a future device, as the advent of capacitive touch technology is simpler and more precise for many operations outlined in the patent. For other purposes, like tapping anywhere on an iPhone to answer a call, the property could come in handy.
Apple's acoustic input patent was first filed for in 2009 and credits Aleksandar Pance, Nicholas Vincent King, Duncan Kerr and Brett Bilbrey as its inventors.
7 Comments
Well that's how I control myself when I'm in front of the tube, reclining in my Lazy-Boy... taps... thumps... and definitely scratches!
/
/
This is the first patent in a while I've seen from Apple where I can really see the usefulness for it. Tapping anywhere to answer a call would be a bad idea, however. Double tapping on the side bezels of an iPad to page forward and page backwards in Safari, iBooks and other apps would be an interesting use, but aren't those bezels soon gone? Knowing it's Apple you can bet they use this feature carefully. And they'd need to, because this could confuse people very quickly.
Tapping anywhere to answer a call would be a bad idea, however.
Works on Star Trek with comm badges
Especially in futuristic movies, prop devices often don't have moving parts, so we instead see the user tapping, or sliding a finger along the edges of a box to unlock it, or along a ridge (think of the original Predator movie slide-to-unlock self-destruct initiation gesture).
So whenever I see a patent application from anybody that mentions gesture vocabularies, I visualize a group of stoned geeks watching SciFi movies on TV over the weekend, exclaiming, "Oh look what they just did! Let's figure out how to imitate that!"
As for using case sound patterns, it's not a unique idea. For example, a company in the UK demonstrated it a few years back. " Every tap (or scratch) on the phone's screen or its casing produces a telltale sound that resonates through the device. Careful analysis of the sound patterns can identify where and how the phone was touched."
First we had the telegraph wire and after a hundred years or so of innovation we can type in Morse code on our laptops.
Patented by Apple? This has been a feature of Windows machines for years! [IMG]http://forums.appleinsider.com/content/type/61/id/25039/width/200/height/400[/IMG]