After some false starts, Apple has gone all out for the upcoming iOS 27, due this fall. There’s a greatly improved Siri, based on Google’s Gemini, and a host of AI features. Our readers will be most interested in the new photo-taking and editing features in iOS 27, and I was able to download the developer beta for a quick look around.
Most impressive are the AI-based editing features for photos. When you get into the iOS 27 Photos app, you can choose any new or existing photo in your collection. You’ll notice a new icon right away at the lower right of the screen that brings up new AI editing features. In the example below, I opened an image and selected edit. Then I clicked on the tools icon on the lower right, bringing up these new iOS 27 features. Visible are “Clean Up,” “Extend,” and “Reframe.” For this example, I wanted to extend the photo downward.
When you click on the photo, a frame appears around it, and you can drag or extend the frame in any direction.
In this photo, I pulled down the bottom and Apple AI generated a new matching area of the landscape. We’ve seen this kind of AI use in Photoshop and other editors, but it’s impressive on a phone. It appears the actual processing is happening off device, but the final result is pretty good.
Another new feature is called “Clean Up.” It’s basically an AI eraser, which we’ve seen before on other photo apps, and even a coarser version in iOS. To make it work, you’re instructed to paint any unwanted object out with your finger, like the cactus below.
A quick swipe and it’s gone.
Not a killer feature, but it’s nice to have.
More impressive is the “Reframe” tool. Take any image and drag with your finger to change the perspective. Here’s the original:
And the image where AI changes the perspective:
This would be good for repositioning people to get a better background or angle on the subjects. I tried it on several photos and thought it did a credible job.
Although not in the beta just released, Apple is said to be testing a natural language interface for the photo editor, letting you describe the outcomes you want.
Image Playground is back, and improved, with more realistic AI images. It was first introduced in iOS 18.
Apple is also adding, but I have not tested, voice prompts for camera control, and there is an “add widgets” feature that hasn’t appeared in my beta yet. It’s supposed to allow you to customize the camera controls.
We can have a healthy discussion about the use of AI in photography, and we’ve had hundreds of those discussions in these pages. I think these features are going to be very popular with people who use their iPhone as their main camera and want to come back from a family gathering or vacation with something better than run-of-the-mill snapshots.
Of course, you’ll also be able to turn these features off, or simply not invoke them.
On the technical side, I’m impressed with what Apple is giving photographers in the upcoming iOS 27. I say giving, because it does not appear there will be any extra charges for using these AI features. However, use of some of the AI features that require server-side computing from Apple will not be unlimited. Apple has said:
“Some Apple Intelligence features, including image generation, have daily usage limits because they rely on powerful server models. Increased access is available with most iCloud+ subscription plans, which also include Apple Intelligence support for compatible Home cameras.”
Apple has offered no other details about those limits and their impact on customers.
Expect to see a public beta for those who want to try it soon, maybe a few weeks from now, and the general release will happen late summer or early fall.
The beta release is English only, and this fall Apple is unsure what the release plans are in the EU, which has a tight grip on products with AI. The Far East is going to be another sticky point for Apple.
These AI-based photo edit features should also show up on Macs with Apple Silicon. I’ll have more info and impressions as I spend more time on the beta and check out new releases and features, which I expect will be frequent before iOS 27 goes into general release.
Leave a Reply