iOS 18
Device customization and privacy control would take the spotlight in iOS 18 if it weren't for Apple Intelligence. The new AI efforts may be limited to recent iPhones, and products with M-series processors, but it is what's captured everyone's attention -- private and secure models.
● On-device AI & Apple Cloud Compute
● Privacy-focused models
● Safari Intelligent Browsing
● Siri AI upgrades
● generative Photos Clean Up tool
● Voice Memo text summaries
● Optional ChatGPT function
● Coming fall 2024
Page last updated:
Get Apple News Directly in Your Inbox
Apple revealed iOS 18 during WWDC on June 10, 2024. The new iOS is packed with updates for every iPhone that supports the release, plus exclusive Apple Intelligence features for iPhone 15 Pro.
All eyes may have been on Apple's AI efforts, but those are going to release in beta form for a limited number of users. The more significant updates for most users center on customization, privacy controls, and new cross-app functionality.
Everything new in iOS 18:
- Free placement of icons and widgets on the Home Screen within the pre-set grid
- Dark mode icons and tinted icons for more uniform Home Screen styling
- Lock Screen buttons for Flashlight and Camera can be replaced with other apps and shortcuts
- Control Center gets pages, customized layouts, and third-party app access
- Photos app is redesigned with a unified view, custom layout, and more
- Messages has new text effects, RCS support, and emoji tapbacks
- Mail will get new sorting options later in 2024
- Safari has Highlights that show page summaries, Maps locations, or Apple Music links
- An all-new Passwords app
- Lock or hide apps
These features are launching across all compatible iPhones. However, Apple did reserve Apple Intelligence for devices running A17 Pro, meaning iPhone 15 Pro and iPhone 15 Pro Max.
The iPhone 16 lineup could support Apple Intelligence across every model thanks to using a version of A17 with the larger Neural Engine and more RAM for standard models plus A18 Pro for upgraded pro models.
More customization
A significant portion of the iOS 18 portion of WWDC was centered around user customization. The Home Screen, Lock Screen, Control Center, and even some apps like Photos all have customization options.
The iPhone Home Screen has been a structured grid of icons since the device's inception. That hasn't changed beyond adding widgets, but now users can leave blank spaces in the grid for even more custom screens.
Users that spend time theming their Home Screen with different colors and icons will be happy to hear that it is easier than ever. Icons can be set to a dark mode, including Apple's, so they have a dark background and colorful icon.
If a color tint is desired, it can be applied to the dark mode icons and widgets so that everything has a color overlay. Developers can submit special layered icons to ensure the effect is pleasant when applied.
The Lock Screen buttons for flashlight and camera can be replaced with different app launchers, Shortcuts, and other system features. It even works on a per-Focus basis.
The biggest change to customization occurred in Control Center. Users can now freely place icons on up to 10 pages of Control Center.
These buttons can be a 1x1 square or expand to take up an entire page, like the Music button. Home controls, device controls, and even third-party app functions can be added to Control Center.
Messages upgrades & RCS
Apple is finally adopting RCS, which means sending text messages to Android users will see a vast improvement. The Rich Communication Services standard works over the internet instead of older phone signals still used by SMS.
When Apple users communicated using SMS, it meant downgrading photos and videos to tiny pixelated media suitable for the old-school communication standard. With RCS, full-sized images and video with HDR can be sent over the network.
RCS also means users will be able to have more rich group chats, see typing indicators, and have access to cross-platform message reactions.
Apple also introduced new Messages features like text formatting, per-word animations, and an option to schedule messages called Send Later. Images and emoji will be able to be generated using Image Playground as well.
Apple Intelligence
Apple Intelligence uses on device models to offer things like Writing Tools, which can proofread text and offer different styles to make it sound more professional. In some cases, the user can hand requests off device to Private Cloud Compute servers for privacy-preserving Apple LLMs or optionally to ChatGPT.
There's also Image Playground, which can be used to generate emoji for use in Messages. Images can also be generated, but on a limited basis with animated themes.
Siri is also being given a big upgrade thanks to Apple Intelligence. On-device command processing will be much better, even when the user stumbles over a command or makes a mistake.
However, it appears that Apple will delay the release of the new Siri by several months. The significant undertaking of changing how Siri works for billions of daily requests could take until iOS 18.4 in spring 2025 to complete.
Developers will have to build support for Apple Intelligence, but Apple has made it straightforward by tying the features to existing app intent structures. While there are already new Siri features in beta, the full version with app intent tie ins will take time.
Apps with Apple Intelligence Siri support coming:
- Books
- Calendar
- Camera
- Contacts
- Files
- Freeform
- Keynote
- Magnifier
- News
- Notes
- Photos
- Reminders
- Safari
- Stocks
- Settings
- Voice Memos
Developers are able to test a limited set of Apple Intelligence features in the iOS 18.1 beta. Apple's AI tools will not release with iOS 18 in September.
Photos Clean Up
The AI powered object removal feature in Photos arrived in a beta of iOS 18.1. It works similarly to third-party apps with repair tools or Google's Magic Eraser, but it runs on Apple Intelligence, on device.
Users that want to use the feature in iOS 18.1 will see a small eraser icon in the photo editor. The first time this is tapped, it will download the tool.
Photos with easily removed objects or other removal suggestions will show up with rainbow-colored and shiny material on top. Tapping these objects will automatically remove the highlighted region.
Otherwise, objects can be removed by drawing a circle around an object or coloring in the object. The AI will attempt to understand what the image should look like without the removed item, then rebuild the area to some effect.
Results vary based on the size of the object and what surrounds it. Complex backgrounds or ones without a reference to what should be behind what you're removing may result in a bad outcome.
iOS 18 release date
Apple released iOS 18 to the public on September 16. While the update contained all of the new customization options, the Apple Intelligence features won't arrive until a later iOS 18.1 update.
Everything below this point was written before WWDC 2024 and contains rumors and speculation surrounding the release. It will remain in this page for reference.
iOS 18 rumor cycle
It's no secret, Apple is going to have a big artificial intelligence focus in 2024 starting with WWDC. Every operating system, including iOS 18, will have AI features throughout, and some information about these rumored features has already been leaked.
Apple will focus on privacy and security with its on-device AI tools. Some rumors indicate Apple may be looking into server-side AI, but that may not be ready for iOS 18.
Features will focus on small models that run without connecting to the internet unless necessary. Tools in Safari, Notes, the and Messages app will enhance basic interactions.
Other features will likely be announced and updated, like more widget options, customization tools, and changes to HomeKit.
The following information has been obtained from anonymous people familiar with Apple's plans for iOS 18 or from other leaks and rumors that have been reported.
Privacy is paramount
Apple sees privacy as a fundamental human right. So, expect the company's AI strategy for iOS 18 to have a central theme around privacy and data control.
Existing tools that use large language models (LLM) or generative AI tend to rely on sucking up a lot of information freely available on the web or consumer's device. These data sets and the prompts provided by users are used to continue training the models, which leads to privacy concerns.
Apple is expected to focus on training the models separate from the user's devices and data. When a model is used, it will use data available on the device to make decisions, but that user data will remain on the device and not become part of the larger model.
There has been some discussion of Apple offering paid access to LLMs made by other companies, but these would come with a warning about data privacy. An AI-focused App Store could be introduced.
Siri and Spotlight with generative AI
An Apple-made algorithm codenamed Ajax has been rumored to have generative AI capabilities in iOS 18. It could be used to provide improved responses from Siri, Spotlight, and other system-level search tools like those in Messages.
Ajax will be able to learn from user data found in Files, Contacts, Messages, and apps exposed to Spotlight to quickly find specific content buried deep across the system and provide summaries or direct links. The on-device model will be able to generate responses to queries about user data without an internet connection.
Apple isn't looking to introduce chatbot capabilities, so don't expect ChatGPT-like interactions with Siri. However, the search tools will be able to do more than the "result from Wikipedia" that frustrates many users today.
The generative AI assistant could help with texting by providing summaries of conversations. For example, if you've been away from a group chat and return to find hundreds of unread messages, Ajax could tell you what you missed in a quick summary.
Intelligent Browsing
Not much is known about Intelligent Browsing just yet other than the option exists. It appears to rely, in part, on Apple's generative AI called Ajax.
The user will have to enable Intelligent Browsing in iOS 18 manually. It will then be able to provide information as the user is browsing, like webpage summaries or image search tools.
The image search functionality is in the works, but it may not make it for the iOS 18 release day. It apparently builds on the Visual Lookup feature in Photos and will enable users to perform actions on photos found on the web.
Another new tool is coming to Safari, but it isn't clear if it will have AI-focused capabilities. It is a tool called Web Eraser, and it can remove elements of a page by tapping them.
Photos Clean Up
Another Apple AI feature in iOS 18 will be focused on photo retouching. Clean Up will be able to remove objects from a photo using generative AI.
The feature will differ from conventional repair and removal tools, which rely on machine learning to determine how to remove an object. Generative AI will be able to better understand what is in a photo and what should be behind an object for more accurate object removal and photo retouching.
Apple could introduce other features like generative fill, but it isn't clear if that will arrive when iOS 18 debuts. The Photos app on Mac already has a repair tool, and it appears that Clean Up replaces that entirely.
Voice transcription and summary
The Notes app will be getting Voice Memos integration, and both applications are getting AI capabilities. The on-device AI in iOS 18 will be able to take a Voice Memo, provide a voice memo transcription that is searchable, and generate a summary.
Users will be able to open the Notes app and start an audio recording while taking notes simultaneously. The feature is available in third-party apps already, but Apple's melding of Voice Memos and Notes may Sherlock those.
Once a recording has been completed, users will be able to ask questions about the content of the recording. For example, if you missed a specific part of a lecture, ask for when that topic occurred and a summary of it.
Apple Music Passthrough and Smart Transitions
A new feature called "Smart Transitions" is expected to replace or enhance the existing crossfade function. It would use an understanding of the current song and upcoming song to determine how to best transition between them.
The existing crossfade function works the same as it always has — it simply starts playing a song a few seconds before the previous song ends.
Another feature called Passthrough is coming, though nothing is known about the feature beyond appearing as a setting in Apple Music and QuickTime. It seems to be associated with Dolby Atmos.
Merging apps
A pattern has emerged from various insider details about iOS 18 — cross-app functionality is spreading. The Calculator is going to appear in Notes, the Calendar app will have a Reminders view, and Voice Memo recordings will also get added to Notes.
It isn't clear if these are the only new integrations coming with the updated operating system, but it shows how Apple's first-party apps continue to evolve. Being able to take notes with an intelligent calculator function could Sherlock some of the popular notes-meets-math apps like Soulver.
The Calendar and Reminders integration won't be as in-depth as apps like Fantastical, but having a universal view of all tasks could be enough to bring more people into Apple's free apps. Sherlocking doesn't always have to do with being the best option, it can happen by being the good-enough default.
By integrating different functionality across the operating system, Apple may push more users to fall back to first-party apps. If a user can't pick the default calculator, for example, they're more likely to default to Apple's apps. Apps like Apple Music and Safari have come under antitrust scrutiny for similar system-level Apple-only functionality.
UI changes throughout iOS 18
There are several rumors around how Apple might tweak the look and feel of iOS, but nothing is certain yet. The Settings app could be rearranged completely with prioritization of certain elements and new groupings based on functionality.
The Home Screen could get another change that allows free placement of icons and widgets. Apple has locked users to a grid that must be filled in top to bottom, leading to users coming up with clever design techniques like blank icons.
While apps have been able to offer alternative app icons for years, there could be even further customization options soon. Users can already build a Shortcut with a custom icon that launches an app, but doing so removes basic functionality from the launcher like long press quick actions. Enabling customers to choose any image for app icons would be a significant change.
One exploit found the ability to animate icons, which could add yet another element of customization. While icons animating continuously might create chaos, Apple could choose a more stable route. Apps like Calendar and Clock are able to show accurate information by updating regularly, so such a feature could finally come to third-party icons.
iOS 18 release date
Apple will reveal iOS 18 during WWDC, which is being held June 10, 2024. It will be announced alongside iPadOS 18, tvOS 18, watchOS 11, macOS 15, and visionOS 2.
After a brief beta period over the summer, Apple will release iOS 18 to the public shortly after the iPhone 16 launch in September.