Apple Expands Visual Intelligence With Bill Splitting, Nutrition Insights, and visionOS Support
Apple today unveiled significant upgrades to Visual Intelligence, including a new Siri mode in the Camera app that can analyze real-world objects and take actions directly from what the iPhone sees.
Apple's vice president of software engineering Sebastien Marineau-Mes detailed the enhancements during today's WWDC keynote, explaining that the new Siri mode in Camera uses image understanding powered by Apple's foundational models to interpret what the camera is pointed at and surface contextually relevant actions.
One of the headline use cases is bill splitting. Users can aim their iPhone camera at a restaurant check and immediately divide the total between friends, with Apple Cash integration allowing payments to be sent on the spot. Apple also demoed pointing the camera at a plate of food to receive nutritional insights.
Visual Intelligence is also coming to visionOS, bringing the same capability to Apple's spatial computing platform. Siri can recognize real-world objects in a user's environment and surface relevant information about them on demand.
Popular Stories
Apple today announced that the first iOS 27.3 developer beta will be released next week and enable some Apple Intelligence features in China.
In a press release shared on the Apple Newsroom website in China, Apple said the beta will be released on Wednesday, November 4, but that likely means Tuesday, November 3 in the U.S. due to time zone differences. Apple said iOS 27.3 will then be...
Apple today said that second- and third-generation Apple TV 4K models will gain Siri AI in beta with tvOS 27.2.
Siri AI on the Apple TV adds conversational entertainment searches, follow-up questions, and personal context through a paired compatible device. Setup requires the Home app's home owner to have an Apple Intelligence-enabled iPhone or iPad running the latest software, with Siri AI...
In an interview with TIME's Andrew R. Chow, Apple's marketing chief Greg Joswiak said Apple Intelligence is meant for "everyday people" as opposed to the "lunatic fringe."
The full sentence: "In the midst of a populist AI backlash, they contend that they are building a modest but personalized and privacy-preserving form of AI that will actually help ordinary people as opposed to merely...
