From using an iPhone as a webcam on Mac to Universal Control, for years Apple has been making it easier to work across multiple devices — and now it has a plan to mean you can instantly switch between them, too.
Universal Control was the wow moment of WWDC 2021, as Craig Federighi dragged a file from his iPad, across his MacBook Pro screen, and dropped it into Final Cut Pro on an iMac. Universal Control gave us the ability to use one keyboard and trackpad — in this case his MacBook Pro — and seamlessly use other nearby devices.
No wonder Federighi looked excited. But it turns out that this may have been less his turn to present something at WWDC, and more of a project he is particularly invested in.
For a newly-revealed patent application about extending this feature still further, is credited to Federighi and two colleagues. "Continuity of Applications Across Devices" proposes a subtle but significant improvement on what Apple summarizes as its Continuity features.
Universal Control is the most striking of those, but there is also how the music playing on an iPhone can be handed off to a convenient HomePod. Then there's the tremendous AirDrop, the ability to use an iPhone as a camera, or to have your Apple Watch unlock your Mac.
Apple is all-in on this Continuity idea of recognizing that we tend to have multiple devices, and will benefit from integrating them more. The idea in this patent application centers on how we might turn to either the best or the handiest device to do something, only to realise another device would be better.
"[For example], the user may power-up a laptop, launch an e-mail application, find the specific e-mail for which a response is needed, and begin to prepare the response," says Apple. "It would be helpful if the user could transition from use of one device to another, such as transition from reading an e-mail on one device to drafting a reply on another device, in a seamless and cognitively continuous manner."
One Apple ID, one account
You've done this. You've begun replying to an email on your iPhone, only to find that there's more to say than a quick emoji. Right now, you could delete that draft and open up Mail on your Mac to get the benefit of typing on a full keyboard instead of tapping with your finger.
Right now you can even select all of the text you've written, copy it, turn to your Mac, open Mail, find the message, click on Reply, and paste your existing text into your reply. There is also iCloud syncing which for some apps will mean a draft is copied between devices, saving you even the copy-and-paste effort.
But Apple wants it to be that you literally just put down one device and pick up the other, to carry on working precisely where you were.
"[If] the user is using one application on a first device, it would be helpful for the second device to which the user is transitioning-to automatically launch the same application," says Apple, "so that the user may continue without loss of progress."
So you're in Mail, writing a reply, and you realise it would be better to do that on your Mac. Put down your iPhone, open your MacBook Pro's lid, and Mail has launched itself in readiness.
Mail is waiting for you — and so is the message you were replying to. If you haven't cancelled the one on your iPhone, that's what you see now, the email you've begun writing.
That email reply is just waiting for you to carry on precisely where you were. This seems handy, it seems quite nicely convenient, but Apple argues that actually, there's more to it than convenience.
"Such techniques can reduce the cognitive burden on a user who switches between uses of multiple computing devices, thereby enhancing productivity," says the patent application. "Further, such techniques can reduce processor and battery power otherwise wasted on redundant user inputs."
Ultimately, while Apple would gladly have us buy very many devices, the aim is for us to feel as if we have just one. It comes in different sizes and has different capabilities, but it's the device we need to do what we have to right now.
7 Comments
Make it work when my MacBook Pro is in clamshell and you have my attention. Lost the simple ability to move my cursor to my iPad when I moved from a Mac mini M1 to a MacBook Pro M2. Argh.
How long before competing device makers sue claiming it’s an unfair advantage…
Apple issued a similar patent in the early days of the iPad, which, according to the patent description, would allow Mac apps to relay and interface to an iPad-like device.
Now, it never really happened like that; indeed, it really was the first edition of watch Apps that were hosted by the phone, but the interface was run by the watch as an app extension.
Still, it seemed like a great idea to expand. Why bring the whole app onlineon each device when all you need in the example is only a small part of it? Why couldn't drafting an email be a super-lightweight app extension that jumps between devices with ease?
Would help the CPU/GPU multi-task the app if if was divided to task interfaces.
That would require them to make iCloud syncing robust so I guess that's a good thing? Would be nice to have all your open windows, files apps and complete state, syncing instantly.