Apple to Integrate Augmented Reality Functionality Into iPhone's Camera App - MacRumorsOpen MenuShow RoundupsShow Forums menuVisit ForumsOpen Sidebar
Skip to Content

Apple to Integrate Augmented Reality Functionality Into iPhone's Camera App

Apple has a team of people working on integrating augmented reality functionality into the iPhone's camera app, reports Business Insider. Employees from several different augmented reality companies Apple has acquired are said to be involved in the effort, including those from Metaio and Flyby Media.

Citing sources familiar with Apple's plans, Business Insider says Apple's goal is for consumers to be able point the phone at a real-world object and have that object be recognized. Apple is already working on similar technology using machine learning techniques and has built basic object recognition capabilities into the Photos app.


Object recognition in the camera app would potentially allow for the real-time recognition of objects, but it is more complex than what is available in the Photos app because it involves 3D objects. Such a feature could be used for spacial recognition and mapping, among other things.

Facial recognition and manipulation may also be a goal, perhaps allowing the camera app to be used to apply Snapchat-style augmented reality filters to people. Apple is said to be planning to release an augmented reality SDK for developers following the debut of the rumored camera feature, which would allow third-party apps access the AR camera technology too.

Another early feature for Apple's AR integration into the camera app could be to recognize and manipulate people's faces. Apple integrated facial recognition technology into the photos app in the most recent version of its iOS software, and purchased FaceShift, a company with similar technology in 2015.

Recent rumors have suggested Apple's ultimate augmented reality ambition may be a set of smart glasses, which would connect wirelessly to the iPhone and display "images and other information" to the wearer.

A recent hire, John Border, seems to confirm Apple's rumored interest in smart glasses. Border, who describes himself as a "subject matter expert" in head-worn displays, plastic optics manufacturing, and camera systems and image sensors, recently joined Apple after serving as the chief engineer at Osterhout Design Group, a company that developed a set of smart glasses.

Apple's work on smart glasses is said to be in the early stages, and no product is expected to debut before 2018 should the project continue. It is not clear when Apple might introduce AR functionality in the camera app.

Related Roundup: Apple Vision Pro
Buyer's Guide: Vision Pro (Neutral)
Related Forum: Apple Vision Pro

Popular Stories

Apple Remnants Vision Pro

Apple Unveils Immersive Horror Film Coming Exclusively to Vision Pro

Tuesday October 13, 2026 5:26 am PDT by
Apple on Monday announced Remnants, an immersive horror film that will be released exclusively on the Vision Pro on Friday, October 16. The film will be in the Apple Immersive Video format, meaning it will be a 3D video recorded in 8K resolution with a 180-degree field of view and Spatial Audio. Apple shared a short video of people reacting to the film while wearing the Vision Pro....
apple vision pro orange

Apple Releases visionOS 27.2

Monday October 26, 2026 10:46 am PDT by
Apple today released visionOS 27.2, the first big update for the visionOS 27 operating system that runs on the Apple Vision Pro. visionOS 27.2 can be downloaded by opening the Settings app, selecting the General section, and choosing Software Update. Installing the update requires the headset to be removed, and a progress bar appears on the EyeSight display. The visionOS 27.2 update...
General visionOS watchOS and tvOS Betas Feature Redux

Apple Seeds watchOS 27.2, tvOS 27.2 and visionOS 27.2 Release Candidates

Monday October 19, 2026 10:25 am PDT by
Alongside new betas of iOS 27.2, iPadOS 27.2, and macOS Golden Gate 27.2, Apple has seeded the release candidate versions of watchOS 27.2, tvOS 27.2 and visionOS 27.2. The RCs come a week after Apple released the fourth betas. Registered developers can download the betas through the Settings app on each device. There's no word on what's being added in visionOS 27.2 and tvOS 27.2, but...

Top Rated Comments

Zirel Avatar
130 months ago
MacRumors content image

VR. It's the future! Guys!
Score: 17 Votes (Like | Disagree)
AngerDanger Avatar
130 months ago
I propose Apple create a feature whereby you aim your camera at a new MacBook and nearby device, and the app overlays all the dongles and adaptors you'd need to connect the two devices. You could even buy them right from the camera app!
Score: 13 Votes (Like | Disagree)
ErikGrim Avatar
130 months ago
While object recognition would be of limited use to most users, imagine what it could do for the vision impaired? A set of smart glasses that translated what they were seeing into sound with Voice Over would be a game changer. Kind of like how VO can identify faces in the camera app already, but for a whole library of every day objects. The blind would literally be able to see and navigate the world by sound.
Score: 10 Votes (Like | Disagree)
FatherJack1980 Avatar
130 months ago
"[facial] manipulation may also be a goal, perhaps allowing the camera app to be used to apply Snapchat-style augmented reality filters to people."

Oh goody, yet another social media thingy! Man, can't wait to emoji-fy my face!! *sigh*

....I can just imagine the presentation for this in the next Apple event.
Score: 7 Votes (Like | Disagree)
130 months ago
The skeptic in me says that this is just the next piece of feces that Apple is throwing against the wall to see if it sticks. The Watch was not the next iPod. The car went down a dead end.
I hope this doesn't distract them from the next revolutionary breakthrough in emoji development.
Score: 5 Votes (Like | Disagree)
Zirel Avatar
130 months ago


It sounds like Apple is trying to copy Lenovo/Tango now http://shop.lenovo.com/us/en/tango/?clickid=wC6SCUz4LTTyX89x2yQckWouUkky7s0lyS6aQs0&PID=10078&acid=ww:affiliate:bv0as6&irgwc=1
That's rich, because Tango uses Primesense chips to do its thing. Primesense is owned by Apple.

http://www.cultofmac.com/274819/google-swiped-apples-hot-new-primesense-3-d-tech-project-tango/
Score: 3 Votes (Like | Disagree)
Latest Stories
Siri AI Rumored to Become 'More Like an Agent' as Early as Next Year
Siri AI Rumored to Become 'More Like an Agent' as Early as Next Year
4 hours ago
Apple Taking New Approach to Developing iOS 28 and macOS 28
Apple Taking New Approach to Developing iOS 28 and macOS 28
6 hours ago
Early Apple Black Friday Deals on Apple Watch, MacBook Air, and More
Early Apple Black Friday Deals on Apple Watch, MacBook Air, and More
1 day ago
'Backglow' Lets You Customize New MacBook Pro's Glowing Apple Logo
'Backglow' Lets You Customize New MacBook Pro's Glowing Apple Logo
1 day ago
Top Stories: Apple Product Launches, iOS 27.3 Beta, and More
Top Stories: Apple Product Launches, iOS 27.3 Beta, and More
1 day ago
More Fun iPhone Duo Apps: 30 New Picks to Try
More Fun iPhone Duo Apps: 30 New Picks to Try
2 days ago
Hands-On With Apple's New OLED Touchscreen MacBook Pro
Hands-On With Apple's New OLED Touchscreen MacBook Pro
2 days ago
Apple Store With All-New Design Opening Soon in Southern California
Apple Store With All-New Design Opening Soon in Southern California
2 days ago
Control the Glowing Apple Logo on Your New MacBook Pro
Control the Glowing Apple Logo on Your New MacBook Pro
2 days ago
Apple Shares New 'Apple Card: Apply and Use in Minutes' Ad
Apple Shares New 'Apple Card: Apply and Use in Minutes' Ad
2 days ago
Apple Says More Than 100,000 Apps Optimized for iPhone Duo, Here's What's Still Missing
Apple Says More Than 100,000 Apps Optimized for iPhone Duo, Here's What's Still Missing
2 days ago
Early Black Friday Deals Kickoff With Steep Discounts on Apple Watch Ultras and More
Early Black Friday Deals Kickoff With Steep Discounts on Apple Watch Ultras and More
2 days ago
The MacRumors Show: iOS 27.3 Looks Like a Huge Update
The MacRumors Show: iOS 27.3 Looks Like a Huge Update
2 days ago
Best Buy's Black Friday Event Begins With Sitewide Savings on Apple, TVs, More
Best Buy's Black Friday Event Begins With Sitewide Savings on Apple, TVs, More
2 days ago
Apple Releasing Yet Another Two New Products Next Week
Apple Releasing Yet Another Two New Products Next Week
2 days ago
MacBook Air Drops to Lowest Price in Months With Amazon's $250 Discount
MacBook Air Drops to Lowest Price in Months With Amazon's $250 Discount
2 days ago
Apple Rumored to Drop the iPhone's Action Button Next Year
Apple Rumored to Drop the iPhone's Action Button Next Year
2 days ago
Apple's Extended Return Policy Now in Effect for 2026 Holiday Season
Apple's Extended Return Policy Now in Effect for 2026 Holiday Season
2 days ago
Apple Music Classical Updated With New Icon and Refreshed Design
Apple Music Classical Updated With New Icon and Refreshed Design
2 days ago
OLED iPad Mini, M6 iMac, and New MacBook Pros Available From Today
OLED iPad Mini, M6 iMac, and New MacBook Pros Available From Today
2 days ago
Apple Surveys iPhone Duo Buyers About Crease and Camera
Apple Surveys iPhone Duo Buyers About Crease and Camera
3 days ago
Apple's First Touchscreen Mac is Now Arriving to Customers
Apple's First Touchscreen Mac is Now Arriving to Customers
3 days ago
Claude Gets Personal Finance Feature With Bank Account Linking
Claude Gets Personal Finance Feature With Bank Account Linking
3 days ago
Apple Arcade Adds Crossy Road Rush and NBA 2K27
Apple Arcade Adds Crossy Road Rush and NBA 2K27
3 days ago
Apple's New HomeView Smart Home Hub: Here's How Much RAM It Has
Apple's New HomeView Smart Home Hub: Here's How Much RAM It Has
3 days ago
iPad Mini vs. iPad Air Buyer's Guide: Now Just $50 Apart
iPad Mini vs. iPad Air Buyer's Guide: Now Just $50 Apart
3 days ago
First iOS 27.3 and macOS Golden Gate 27.3 Public Betas Now Available
First iOS 27.3 and macOS Golden Gate 27.3 Public Betas Now Available
3 days ago
Apple Announces a New Mac Sales Record
Apple Announces a New Mac Sales Record
3 days ago
Paid $200 for Logic Pro? Apple Says You Won't Get This New Feature
Paid $200 for Logic Pro? Apple Says You Won't Get This New Feature
3 days ago
Instagram's Edits Video Editor is Now Available on Mac
Instagram's Edits Video Editor is Now Available on Mac
3 days ago