iPhone 16's Latest Visual Intelligence Features Explained - MacRumorsOpen MenuShow RoundupsShow Forums menuVisit ForumsOpen Sidebar
Skip to Content

iPhone 16's Latest Visual Intelligence Features Explained

by

For ‌iPhone 16‌ models, Apple's iOS 18.3 software update added new Visual Intelligence features to the Camera Control button. Keep reading to learn what you can do with the new capabilities and how to use them.

Apple Visual Intelligence

New Visual Intelligence Features

In iOS 18.2, Apple company added Visual Intelligence functionality to its latest iPhone 16 models, allowing device owners to point the camera at the world around them and get details about places, summarize and translate text, go to website links, call phone numbers, and more.

In iOS 18.3, Apple added new capabilities to Visual Intelligence, including an option to create a calendar event when viewing a poster or flyer, as well as the ability to easily identify plants, animals, and insects.

iphone 16 hands on camera control
Bear in mind that ‌Visual Intelligence‌ is an Apple Intelligence feature that is exclusive to the ‌iPhone 16‌ models – if you have an older model, you won't have a Camera Control button below the Side button on the right-hand side of your device.

Activating Visual Intelligence

To activate Visual Intelligence, press and hold the Camera Control button for a few seconds. A regular press simply opens the camera with Camera Control, so the press-and-hold gesture is necessary. Ensure the Camera app isn't already active, as Visual Intelligence won't work if the camera is already in use.

The Visual Intelligence interface includes a camera view, a capture button, and "Ask" and "Search" options. The "Ask" button interacts with ChatGPT, while "Search" sends the captured image to Google Search.

visual intelligence buttons
To use Visual Intelligence, you must take a photo of the object or scene you're observing. Use the Camera Control button to snap a picture, then select your desired option. It doesn't support live camera views or previously saved photos.

Create a Calendar Event From a Poster

Using ‌Visual Intelligence‌ to add an event to Calendar was a promised function that Apple showed off when introducing Camera Control, and it has been usable since the release of iOS 18.3.

create event visual intelligence
To add an event, view a document such as a poster with a date, and then tap on the date when the feature pops up in the ‌Visual Intelligence‌ interface.

Identify Pets, Animals, and Insects

The Photos app is already able to provide insight into plants, animals, and insects when opting to view additional information in the editing interface, but Camera Control will now show these details in real-time.

ios 18 3 camera control animals
When viewing an animal or a plant with ‌Visual Intelligence‌, you may see a tappable bubble at the top of the viewfinder that lets you know what you're looking at. Simply tap it to view more information. If the output is incorrect, you can use the thumbs up and thumbs down icons below the card to submit feedback to Apple.

Top Rated Comments

21 months ago
Kind of a dick move to exclude 15 Pro’s
Score: 14 Votes (Like | Disagree)
21 months ago
Looks like a nice feature set. Looking forward to updating and checking it out.
Score: 7 Votes (Like | Disagree)
21 months ago
Apple Intelligence has proven worthless so far. Locking this feature to only iPhone 16 models continues this useless trend.
Score: 7 Votes (Like | Disagree)
teknikal90 Avatar
21 months ago

Like I keep saying, just buy Apple stock (AAPL) then you will be happy it's only on NEW models. :) :)
we're like 80% in to the Apple Intelligence rollout - can anyone honestly tell me 1 good benefit? The big downside, the massively decreased battery life is a tangible downside. I sure hope the contextual siri actually works.

None of that is creating any upward pressure on the company's valuation.
Score: 5 Votes (Like | Disagree)
21 months ago
Can’t wait. I really like AI, but know haters gonna hate.
Score: 5 Votes (Like | Disagree)
BGPL Avatar
21 months ago
This could be a very cool feature. Too bad my one year old phone doesn't support it. Classic Apple move.
Score: 5 Votes (Like | Disagree)

Popular Stories

macOS 27 next to MacBook Pro Running macOS 27

macOS Golden Gate Now Available With Siri AI, Visual Intelligence and More

Monday September 14, 2026 10:07 am PDT by
Apple today released macOS Golden Gate 27, the latest version of the macOS operating system that runs on the Mac. macOS Golden Gate is a free app that can be downloaded on all compatible Macs. The update requires a Mac with an Apple silicon chip, and it is not available on Intel Macs. Mac users can download the macOS Golden Gate update by using the Software Update section of System Settings. ...
apple watch series 12

Three All-New 'Audio Intelligence' Features Arrive With Apple Watch Series 12 and Ultra 4

Wednesday September 9, 2026 2:23 pm PDT by
Apple today announced "Audio Intelligence," a new suite of Apple Intelligence-powered features for the Apple Watch Series 12 and Apple Watch Ultra 4 that use the built-in microphone to help users catch missed moments in conversation and stay aware of important sounds. The Apple Watch's Audio Intelligence comprises four features: Siri Recap: Uses ambient listening to generate high-level...
ios 26 visual intelligence ask

Apple Considering Ads Inside Visual Intelligence, Code Suggests

Thursday September 10, 2026 5:55 am PDT by
Apple may be exploring a way to let search providers show sponsored results inside Visual Intelligence, according to code uncovered in iOS 27. The find comes from MacRumors' Aaron Perris, who said in a post on X that the code points to Apple allowing search providers to insert their own sponsored results into Visual Intelligence, rather than Apple selling the ad space itself. He compared...