{"id":7573,"date":"2017-07-26T00:33:55","date_gmt":"2017-07-26T00:33:55","guid":{"rendered":"https:\/\/rsoftsolution.com\/blog\/colorizing-images-with-deep-neural-networks.html"},"modified":"2017-07-26T00:33:55","modified_gmt":"2017-07-26T00:33:55","slug":"colorizing-images-with-deep-neural-networks","status":"publish","type":"post","link":"https:\/\/www.rbsitsoftwaresolution.in\/blog\/colorizing-images-with-deep-neural-networks.html","title":{"rendered":"Colorizing images with deep neural networks"},"content":{"rendered":"
\n
\n
\n \"Colorizing<\/a>
\n The proposed system uses AI to colorize a grayscale image (left), guided by user color ‘hints’ (second), providing the capability for quickly generating multiple plausible colorizations (middle to right). Credit: Photograph of Migrant Mother by Dorothea Lange, 1936 (Library of Congress, Prints Photographs Division, FSA\/OWI Collection, reproduction number: LC-USF34-9058-C.).
\n <\/figcaption><\/figure>\n

For decades, image colorization has enjoyed an enduring interest from the public. Though not without its share of detractors, there is something powerful about this simple act of adding color to black and white imagery, whether it be a way of bridging memories between the generations, or expressing artistic creativity. However, the process of manually adding color can be very time consuming and require expertise, with typical professional processes taking hours or days per image to perfect. A team of researchers has proposed a new technique to leverage deep networks and AI, which allows novices, even those with limited artistic ability, to quickly produce reasonable results.\n <\/p>\n


\n <\/section>\n

The research, entitled “Real-Time User Guided Colorization with Learned Deep Priors,” is authored by a team at UC Berkeley led by Alexei A. Efros, Professor of Electrical Engineering and Computer Sciences. They will present their work at SIGGRAPH 2017, which spotlights the most innovative in computer graphics research and interactive techniques worldwide. The annual conference will be held in Los Angeles, 30 July to 3 August.<\/p>\n

In prior work, the team trained a deep network<\/a> on big visual data (a million images) to automatically colorize grayscale images, with no user intervention<\/a>. While the results were sometimes very good, it was prone to certain artifacts. One major limitation was that the color of many objects\u2014for example, shirts\u2014may be inherently ambiguous. The system<\/a> could only ultimately decide on one possibility.<\/p>\n

“The goal of our previous project was to just get a single, plausible colorization,” says Richard Zhang, a coauthor and PhD candidate, advised by Professor Efros. “If the user didn’t like the result, or wanted to change something, they were out of luck. We realized that empowering the user and adding them in the loop was actually a necessary component for obtaining desirable results.”<\/p>\n

The new network is trained on a grayscale image, along with simulated user inputs. The system improves upon previous automatic colorization systems by enabling the user, in real-time, to correct and customize the colorization. The user provides guidance by adding colored points, or “hints”, which the system then propagates to the rest of the image. The network also learns common colors for different objects and makes appropriate recommendations to the user. Though the new system is only trained on natural images\u2014for instance, elephants are typically brown or gray\u2014the system is also happy to follow the user’s whims, enabling out-of-the-box coloring. For example, a pink elephant\u2014though unnatural\u2014is not off limits.<\/p>\n

To evaluate the system, the researchers tested their interface on novice users, challenging them to produce a realistic colorization of a randomly selected grayscale image. Even with minimal training and limited time\u2014just one minute per image\u2014these users quickly learned how to produce colorizations that often fooled real human judges in a real vs. fake test scenario.<\/p>\n

Deep networks are being more heavily used in graphics. Perhaps after conquering remaining challenges, such as streamlining memory usage and hardware requirements, along with integrating with existing image editing tools, a system like this one could find its way into commercial tools for image manipulation.\n <\/p>\n

\n \"\"
\n Explore further:<\/b>
\n Information processing: Adding a touch of color<\/a>\n <\/p>\n

\n More information:<\/b>
\n For the full paper, visit richzhang.github.io\/ideepcolor\/<\/a> . Download the software at github.com\/junyanz\/interactive-deep-colorization<\/a> .
\n <\/p>\n