Apple Expands Visual Intelligence With Bill Splitting, Nutrition Insights, and visionOS Support
Apple today unveiled significant upgrades to Visual Intelligence, including a new Siri mode in the Camera app that can analyze real-world objects and take actions directly from what the iPhone sees.
Apple's vice president of software engineering Sebastien Marineau-Mes detailed the enhancements during today's WWDC keynote, explaining that the new Siri mode in Camera uses image understanding powered by Apple's foundational models to interpret what the camera is pointed at and surface contextually relevant actions.
One of the headline use cases is bill splitting. Users can aim their iPhone camera at a restaurant check and immediately divide the total between friends, with Apple Cash integration allowing payments to be sent on the spot. Apple also demoed pointing the camera at a plate of food to receive nutritional insights.
Visual Intelligence is also coming to visionOS, bringing the same capability to Apple's spatial computing platform. Siri can recognize real-world objects in a user's environment and surface relevant information about them on demand.
Popular Stories
Apple today released macOS Golden Gate 27, the latest version of the macOS operating system that runs on the Mac. macOS Golden Gate is a free app that can be downloaded on all compatible Macs. The update requires a Mac with an Apple silicon chip, and it is not available on Intel Macs.
Mac users can download the macOS Golden Gate update by using the Software Update section of System Settings. ...
Recent layoffs of Apple employees working on the Vision Pro were broader than previously thought, Bloomberg's Mark Gurman reports.
Last month, Gurman said that Apple cut around 100 jobs from the Vision Products Group, with those cuts centered on the headset's gaming and immersive video teams. Gurman now says the layoffs also reached Vision Pro staff across the rest of the company, including ...
Apple today announced "Audio Intelligence," a new suite of Apple Intelligence-powered features for the Apple Watch Series 12 and Apple Watch Ultra 4 that use the built-in microphone to help users catch missed moments in conversation and stay aware of important sounds.
The Apple Watch's Audio Intelligence comprises four features:
Siri Recap: Uses ambient listening to generate high-level...
