Apple patents accurate touch and hover panel, embedded heart rate monitor

Touch and hover

The newer of Tuesday's patents, Apple's extensive U.S. Patent No. 8,614,693 for "Touch and hover signal drift compensation" describes a system in which a touchscreen display can accurately determine both hover and touch events.

A number of modern computing devices, like Apple's iPhone and iPad, incorporate touch-sensitive panels that enhance and define the user experience by affording unprecedented GUI manipulation and control. Some systems also incorporate what is known as "hover" controls, which allow users to interface with a device without actually touching it.

Using specialized internal components, these touch sensitive devices can recognize an object hovering above a display panel, like a user's finger or stylus. Once a hover event has been detected, the device may process it as a touch event, handling subsequent actions according to the general rules of traditional touch input. For example, if a hover event occurs over a specific app, that app may be opened.

A general overview of hover sensing technology is provided, including a driver control system in which can generate electrical fields that extend out from the touch panel. When a finger or other object passes through these fields it changes the capacitance of trace lines in the sensor array. By processing the capacitance fluctuations, the system is able to detect a hover event.

As noted in Apple's patent, incorporating touch and hover capabilities into one device is a difficult proposition when considering reliability and accuracy. A user may, for example, be holding a phone with their left hand while inputting hover events with the right. If said user's left thumb accidentally touches the screen, the device may register it as a touch event.

In one embodiment, touch event compensation can be applied to ignore errant touches. Much like iOS palm rejection technology, touch signal compensation can intelligently determine a user's intentions by inferring activity based on signal strength.

For example, as seen above, touch panel may be segmented into quadrants, each of which measures capacitance signals of both touch and hover events. Depending on the location and saturation of a signal, as well as duration and other metrics, the system can classify an action as a legitimate touch or hover event. Managing the system is a set of rules based on predefined thresholds.

In other embodiments, object shape and profiling may be implemented to parse out hover events. For example, a user may point at a UI asset such as an app icon, which results in a certain shape profile as "seen" by the touch screen's sensors. Size and distance from a sensor panel may also be used to determine whether a user intended to invoke a hover event. Also provided for are solutions for concurrent touch/hover events and multi-hover events as measured and processed by capacitance and threshold rules.

Apple's patent particularly focuses on compensation for signal drift in a touch sensor panel. Touch sensing devices measure changes from a baseline capacitance — that is when no object is touching or hovering over the device — generated by touching or hovering over the array. Environmental factors like ambient temperature, humidity and pressure play a large role in how well the system operates. Operating changes, such as component shifts, expansion or contraction, could also impact baseline.

When these changes to the baseline capacitance substantially affect measurements indicative of a touch or hover event, it is known as signal drift.

To combat signal drift, Apple proposes a compensation method that resets the baseline capacitance of a touch sensor at periodic intervals, thereby accounting for environmental, operating, mechanical and other changes. When a new baseline is defined, the system can apply the change to capacitance measurement thresholds to correct for signal drift.

In one embodiment, a grounded plate can cover the touch panel when not in use, such as a protective device cover. With the plate temporarily covering the panel, and no touch or hover events being logged, a baseline reading can be taken and a subsequent signal drift compensation applied.

When the plate is not covering the screen, recalibration is suspended because it is more likely that the user will be touching or interacting with the device during this time. Alternatively, the sensor panel can recalibrate when the device is attached to a grounded dock.

In another embodiment, the device can take readings dynamically in between touch and hover events. By using on-board sensors, the recalibration system can intelligently select the most opportune time in which to reset the baseline. For example, recalibration might be suspended if the device is thought to be in motion, or if touch and hover events are being logged. When the unit is stationary and no touch or hover event is recognized, the system may set for baseline signal drift.

The patent continues with an in-depth look at other touch/hover panel implementations, including touch and however switching, signal resistance calibration and sensitivity variation compensation, among others. Also covered are various input techniques, including cameras and on-board motion sensors, and their integration into a display.

It is unknown if Apple will one day choose to incorporate hover controls into its products, but some companies are already working on their own solutions. Rival Samsung, for example, recently rolled out hover-based Air View and Air Gestures features with its Galaxy S4 handset.

Apple's touch and hover sensor panel patent was first filed for in 2010 and credits Brian Michael King, Omar Leung, Paul G. Puskarich, Jeffrey Traer Bernstein, Andrea Mucignat, Avi E. Cieplinski, Muhammad U. Choudry, Praveen R. Subramani, Marc J. Piche, David T. Amm and Duncan Robert Kerr as its inventors.

Heart rate monitor

As for the heart rate monitor, Apple's U.S. Patent No. 8,615,290 for a "Seamlessly embedded heart rate monitor" remains largely unchanged from AppleInsider's initial report on the property's application in 2010. The patent employs sensors to read a user's EKG data, which can then be used to authenticate said user or indicate their mood.

Basically, Apple's invention measures cardiac signals read by sensors embedded into metallic conductive portions of a device housing. The sensor leads can be successfully hidden or embedded, into the chassis housing, possibly in the screen bezel. These leads pick up minute electrical signals unique to a specific user's heart, which can be measured to a degree of accuracy high enough as to provide an adequate means of identification.

The latest Apple patent is evidence that the company is actively investigating deployable biometric security solutions that rely on users' bodies rather than stored or memorized codes, one such system being the Touch ID fingerprint reader.

Apple credits Gloria Lin, Taido Nakajima, Pareet Rahul, and Andrew Hodge as the patent's inventors. The property was originally filed for in 2009.