Apple Researching Groundbreaking Image Sensor Tech to Achieve Dynamic Range on Par With Human Eye

Apple has filed a patent for a new type of image sensor that could give future iPhones and other Apple devices the ability to capture photos and videos with dynamic range levels approaching that of the human eye.

The patent, titled "Image Sensor With Stacked Pixels Having High Dynamic Range And Low Noise," was first spotted by Y.M.Cinema Magazine and describes an advanced sensor architecture that combines stacked silicon, multiple levels of light capture, and on-chip noise suppression mechanisms to reach up to 20 stops of dynamic range.

For comparison, the dynamic range of the human eye is estimated to be around 20 to 30 stops, depending on how the pupil adjusts and how light is processed over time. Most smartphone cameras today capture between 10 and 13 stops. If Apple's proposed sensor reaches its potential, it would not only surpass current iPhones but also outperform many professional cinema cameras, such as the ARRI ALEXA 35.

The patent outlines a stacked sensor design made up of two layers. The top layer, called the sensor die, contains the parts that capture light. The layer underneath, the logic die, handles processing, including noise reduction and exposure control.

Currently, Apple uses sensors made by Sony across the iPhone lineup. Those sensors also use a two-layer design, but Apple's version includes several original features and takes up less space.

One of the most important parts of the sensor design is a system called a Lateral Overflow Integration Capacitor (LOFIC). This allows each pixel in the sensor to store different amounts of light depending on how bright the scene is, all in the same image. With this, the sensor can handle extremely wide lighting differences, such as a person standing in front of a bright window, without losing detail in the shadows or highlights.

Another part of the design focuses on reducing image noise and grain. Each pixel has its own built-in memory circuit that measures and cancels out heat-related electronic noise in real time. This is done on the chip itself, before the image is saved or edited by software.

Patent filings cannot be taken as evidence of Apple's immediate plans, but they do indicate areas of active research and interest for the company, as well as what it is considering developing for future devices.