News
News Categories

NVIDIA has developed an AI that can fix photos by filling in the blanks

By James Lu - on 25 Apr 2018, 10:53am

NVIDIA has developed an AI that can fix photos by filling in the blanks

NVIDIA has developed a deep learning AI that can restore photos by filling in blank or corrupted spaces. While most image fix solutions rely on borrowing content from adjacent pixels (such as Photoshop's Healing Brush tool), NVIDIA's solution generates missing information by itself. 

While there have been previous attempts at AI photo restoration, they've typically been limited to rectangular-size holes in the middle of the image. NVIDIA's "partial convolution" approach is able to fill in holes of any shape, size or location. 

NVIDIA trained its system by generating tens of thousands of hole variations and making the AI learn how to reconstruct photos. It tested using a different set of holes to ensure the AI genuinely understood how to restore photos on its own.

While the results aren't always perfect, they're still quite remarkable, and the system will only continue to get better. On top of photo reconstruction, the NVIDIA team says that the AI could be used to upscale images without losing clarity.

Source: NVIDIA