{"id":4832,"date":"2017-04-19T20:42:12","date_gmt":"2017-04-19T20:42:12","guid":{"rendered":"https:\/\/www.rsoftsolution.com\/blog\/facebook-is-improving-the-360-video-experience-by-predicting-where-you-will-look.html"},"modified":"2017-04-19T20:42:12","modified_gmt":"2017-04-19T20:42:12","slug":"facebook-is-improving-the-360-video-experience-by-predicting-where-you-will-look","status":"publish","type":"post","link":"https:\/\/www.rbsitsoftwaresolution.in\/blog\/facebook-is-improving-the-360-video-experience-by-predicting-where-you-will-look.html","title":{"rendered":"Facebook is improving the 360 video experience by predicting where you will look"},"content":{"rendered":"


\n<\/p>\n

From the stage of F8, Joaquin Quinonero, Facebook\u2019s Director of Applied Machine Learning, described a new technique the company is using to improve the watching experience for 360 videos. The format is challenging to deliver because of its size, but Facebook is using\u00a0machine learning to reduce the number of pixels that have to be rendered at any one time. By predicting where a viewer will look next, rendering priority can be given to that location \u00a0\u2014\u00a0particularly helpful\u00a0for users with lower quality internet access.<\/p>\n

The status quo for 360 videos is reactive rather than proactive rendering.\u00a0Mike Coward, engineering director for Facebook\u2019s VR video team echoed the frustration of users to me when he described the unpleasantness of turning\u00a0your head in VR only to see a blurry scene.<\/p>\n

One partial fix is to optimize compression. But teams at the company are already using machine learning to select across the thousand-plus compression techniques for individual snippets of video. The other way to reduce the streaming load is to just cut down on what you\u2019re rendering. And rather than reduce quality across the board, Facebook\u2019s approach improves resolution for exactly what you\u2019re most likely to look at next.<\/p>\n

\"\"<\/p>\n

Mike Coward, engineering director for Facebook\u2019s VR video team<\/p>\n

Step one was to use the resources of the company to monitor where people actually do look when watching 360 videos. Facebook\u2019s VR video team created a heat-map that highlighted the most popular spots that users looked at within videos. From there, Facebook built a generative saliency map using a deep neural network. This model makes it possible to perform predictions on new videos that haven\u2019t previously been watched or studied.<\/p>\n

If a human were to be given the task of predicting where someone might look, they might\u00a0study their natural environment and look for anomalies that could catch one\u2019s interest \u2014 think birds or a car driving by.<\/p>\n

Abstracting away to the neural net, the physical cars and birds cease to matter. Facebook\u2019s model was trained on\u00a0a massive corpus of videos to identify interesting subsets of a video frame. Coward told me that the model, when faced with a surfer in the ocean, is capable of picking selecting the surfer as most interesting, despite the fact that both are fast moving entities.<\/p>\n

After implementing the prediction model, Facebook was able to increase resolution by 39 percent on VR devices. Aside from improving resolution and making 360 videos accessible to people without great network connections, the technology could some day make it possible to offer preemptive suggestions to creators on how to make videos more engaging.<\/p>\n

<\/p>\n

Article source: http:\/\/feedproxy.google.com\/~r\/techcrunchIt\/~3\/rXemDDEnfo8\/<\/p>","protected":false},"excerpt":{"rendered":"

From the stage of F8, Joaquin Quinonero, Facebook\u2019s Director of Applied Machine Learning, described a new technique the company is using to improve the watching experience for 360 videos. The <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[19],"tags":[25],"class_list":["post-4832","post","type-post","status-publish","format-standard","hentry","category-enterprise-software","tag-enterprise"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t