Apple Researching Motion-Sensing Virtual 3D User Interface for iOS Devices - MacRumorsOpen MenuShow RoundupsShow Forums menuVisit ForumsOpen Sidebar
Skip to Content

Apple Researching Motion-Sensing Virtual 3D User Interface for iOS Devices

Patently Apple reports on a newly-published patent application from Apple describing the use of motion sensors to create a virtual three-dimensional interface for iOS devices. Utilizing concepts similar those found in a number of existing augmented reality apps, the general device interface could appear as a virtual room that could be navigated by changing the orientation of the device.

The invention covers a 3D display environment for mobile device that uses orientation data from one or more onboard sensors to automatically determine and display a perspective projection of the 3D display environment based on the orientation data without the user physically interacting with (e.g., touching) the display.

Apple describes the use of gyroscope sensors that would allow the "camera view" of the virtual room to rotate as the user rotates their device. Apple also mentions that sensors could be used to detect gestures above the surface of the device's display in order to allow for natural 3D manipulation of the user interface environment.

apple 3d interface iphone
Finally, Apple's patent application discusses a "snap to" feature that would allow users to easily transition between various "walls" within the virtual room.

In another patent application filed in mid-2007, Apple discussed a similar notion of multi-dimensional desktops in Mac OS X, showing a virtual room with various groups of icons on the different walls of the room. Apple followed that up with another patent application looking at hyper-reality displays that would allow for orientation- and motion-based manipulation of 3D objects.

Related Roundup: Apple Vision Pro
Tag: Patent
Buyer's Guide: Vision Pro (Neutral)
Related Forum: Apple Vision Pro

Popular Stories

Apple Remnants Vision Pro

Apple Unveils Immersive Horror Film Coming Exclusively to Vision Pro

Tuesday October 13, 2026 5:26 am PDT by
Apple on Monday announced Remnants, an immersive horror film that will be released exclusively on the Vision Pro on Friday, October 16. The film will be in the Apple Immersive Video format, meaning it will be a 3D video recorded in 8K resolution with a 180-degree field of view and Spatial Audio. Apple shared a short video of people reacting to the film while wearing the Vision Pro....
apple vision pro orange

Apple Releases visionOS 27.2

Monday October 26, 2026 10:46 am PDT by
Apple today released visionOS 27.2, the first big update for the visionOS 27 operating system that runs on the Apple Vision Pro. visionOS 27.2 can be downloaded by opening the Settings app, selecting the General section, and choosing Software Update. Installing the update requires the headset to be removed, and a progress bar appears on the EyeSight display. The visionOS 27.2 update...
General visionOS watchOS and tvOS Betas Feature Redux

Apple Seeds watchOS 27.2, tvOS 27.2 and visionOS 27.2 Release Candidates

Monday October 19, 2026 10:25 am PDT by
Alongside new betas of iOS 27.2, iPadOS 27.2, and macOS Golden Gate 27.2, Apple has seeded the release candidate versions of watchOS 27.2, tvOS 27.2 and visionOS 27.2. The RCs come a week after Apple released the fourth betas. Registered developers can download the betas through the Settings app on each device. There's no word on what's being added in visionOS 27.2 and tvOS 27.2, but...

Top Rated Comments

RoelJuun Avatar
193 months ago
In a flash I read Apple adopting a Research In Motion interface. The horror.

On Topic:

I still don't believe in 3D interfaces/screens. My eyes get strained after a while. But then again, Apple is usually implementing technologies when they believe they have something really good to offer.
Score: 7 Votes (Like | Disagree)
193 months ago
Imagine the lag if Jailbroken.. geez
Score: 2 Votes (Like | Disagree)
HiRez Avatar
193 months ago
It reminds me of this (https://www.youtube.com/watch?v=dFUlAQZB9Ng), an interface I thought looked clumsy even in 1993.
Score: 2 Votes (Like | Disagree)
SockRolid Avatar
193 months ago
crazy, weird and illogical, indeed.

Thanks! I aim to please. :-)

----------

Do you have something in mind? I really like how it is.

The best thing about iOS is its ability to quickly get out of your way. There's almost nothing between you and your apps and data. Just a few swipes to get to the right page of icons, then a tap to launch the app itself.

So, what's the glaringly obvious way to make it even easier to get to a specific app?

"Siri, launch Maps." And "Siri, open MacRumors.com." No bizarre 3-d "walls" needed.
Score: 2 Votes (Like | Disagree)
193 months ago
There are several apps in the App Store that already do exactly this, *even on iOS*.

If the US Patents Office doesn't throw this out under prior art instantly the place may as well get burnt down.

Phazer
Score: 2 Votes (Like | Disagree)
193 months ago
I may be 100% wrong here so forgive me, but doesn't the 3DS already do this? I was under the impression that the screen does software based 3d rendering using facial tracking to determine where you are, thus where the 3d display needs to position the content.

I could be way off so any input from a 3DS owner would help!
Score: 2 Votes (Like | Disagree)
Latest Stories
Siri AI Rumored to Become 'More Like an Agent' as Early as Next Year
Siri AI Rumored to Become 'More Like an Agent' as Early as Next Year
7 hours ago
Apple Taking New Approach to Developing iOS 28 and macOS 28
Apple Taking New Approach to Developing iOS 28 and macOS 28
9 hours ago
Early Apple Black Friday Deals on Apple Watch, MacBook Air, and More
Early Apple Black Friday Deals on Apple Watch, MacBook Air, and More
1 day ago
'Backglow' Lets You Customize New MacBook Pro's Glowing Apple Logo
'Backglow' Lets You Customize New MacBook Pro's Glowing Apple Logo
1 day ago
Top Stories: Apple Product Launches, iOS 27.3 Beta, and More
Top Stories: Apple Product Launches, iOS 27.3 Beta, and More
1 day ago
More Fun iPhone Duo Apps: 30 New Picks to Try
More Fun iPhone Duo Apps: 30 New Picks to Try
2 days ago
Hands-On With Apple's New OLED Touchscreen MacBook Pro
Hands-On With Apple's New OLED Touchscreen MacBook Pro
2 days ago
Apple Store With All-New Design Opening Soon in Southern California
Apple Store With All-New Design Opening Soon in Southern California
2 days ago
Control the Glowing Apple Logo on Your New MacBook Pro
Control the Glowing Apple Logo on Your New MacBook Pro
2 days ago
Apple Shares New 'Apple Card: Apply and Use in Minutes' Ad
Apple Shares New 'Apple Card: Apply and Use in Minutes' Ad
2 days ago
Apple Says More Than 100,000 Apps Optimized for iPhone Duo, Here's What's Still Missing
Apple Says More Than 100,000 Apps Optimized for iPhone Duo, Here's What's Still Missing
2 days ago
Early Black Friday Deals Kickoff With Steep Discounts on Apple Watch Ultras and More
Early Black Friday Deals Kickoff With Steep Discounts on Apple Watch Ultras and More
2 days ago
The MacRumors Show: iOS 27.3 Looks Like a Huge Update
The MacRumors Show: iOS 27.3 Looks Like a Huge Update
2 days ago
Best Buy's Black Friday Event Begins With Sitewide Savings on Apple, TVs, More
Best Buy's Black Friday Event Begins With Sitewide Savings on Apple, TVs, More
2 days ago
Apple Releasing Yet Another Two New Products Next Week
Apple Releasing Yet Another Two New Products Next Week
2 days ago
MacBook Air Drops to Lowest Price in Months With Amazon's $250 Discount
MacBook Air Drops to Lowest Price in Months With Amazon's $250 Discount
2 days ago
Apple Rumored to Drop the iPhone's Action Button Next Year
Apple Rumored to Drop the iPhone's Action Button Next Year
2 days ago
Apple's Extended Return Policy Now in Effect for 2026 Holiday Season
Apple's Extended Return Policy Now in Effect for 2026 Holiday Season
2 days ago
Apple Music Classical Updated With New Icon and Refreshed Design
Apple Music Classical Updated With New Icon and Refreshed Design
2 days ago
OLED iPad Mini, M6 iMac, and New MacBook Pros Available From Today
OLED iPad Mini, M6 iMac, and New MacBook Pros Available From Today
3 days ago
Apple Surveys iPhone Duo Buyers About Crease and Camera
Apple Surveys iPhone Duo Buyers About Crease and Camera
3 days ago
Apple's First Touchscreen Mac is Now Arriving to Customers
Apple's First Touchscreen Mac is Now Arriving to Customers
3 days ago
Claude Gets Personal Finance Feature With Bank Account Linking
Claude Gets Personal Finance Feature With Bank Account Linking
3 days ago
Apple Arcade Adds Crossy Road Rush and NBA 2K27
Apple Arcade Adds Crossy Road Rush and NBA 2K27
3 days ago
Apple's New HomeView Smart Home Hub: Here's How Much RAM It Has
Apple's New HomeView Smart Home Hub: Here's How Much RAM It Has
3 days ago
iPad Mini vs. iPad Air Buyer's Guide: Now Just $50 Apart
iPad Mini vs. iPad Air Buyer's Guide: Now Just $50 Apart
3 days ago
First iOS 27.3 and macOS Golden Gate 27.3 Public Betas Now Available
First iOS 27.3 and macOS Golden Gate 27.3 Public Betas Now Available
3 days ago
Apple Announces a New Mac Sales Record
Apple Announces a New Mac Sales Record
3 days ago
Paid $200 for Logic Pro? Apple Says You Won't Get This New Feature
Paid $200 for Logic Pro? Apple Says You Won't Get This New Feature
3 days ago
Instagram's Edits Video Editor is Now Available on Mac
Instagram's Edits Video Editor is Now Available on Mac
3 days ago