{"id":19190,"date":"2020-06-14T06:33:02","date_gmt":"2020-06-14T06:33:02","guid":{"rendered":"https:\/\/rbsitsoftwaresolution.com\/blog\/facebooks-deepfake-detection-challenge-yields-promising-early-results.html"},"modified":"2020-06-14T06:33:02","modified_gmt":"2020-06-14T06:33:02","slug":"facebooks-deepfake-detection-challenge-yields-promising-early-results","status":"publish","type":"post","link":"https:\/\/www.rbsitsoftwaresolution.in\/blog\/facebooks-deepfake-detection-challenge-yields-promising-early-results.html","title":{"rendered":"Facebook\u2019s \u2018Deepfake Detection Challenge\u2019 yields promising early results"},"content":{"rendered":"

The digitally face-swapped videos known as deepfakes aren\u2019t going anywhere, but if platforms want to be able to keep an eye on them, they need to find them first. Doing so was the object of Facebook\u2019s <\/a> \u201cDeepfake Detection Challenge,\u201d<\/a> launched last year. After months of competition the winners have emerged, and they\u2019re\u2026 better than guessing. It\u2019s a start!<\/p>\n

Since their emergence in the last year or two, deepfakes have advanced from niche toy created for AI conferences to easily downloaded software that anyone can use to create convincing fake video of public figures.<\/p>\n

\u201cI\u2019ve downloaded deepfake generators that you just double click and they run on a Windows box \u2014 there\u2019s nothing like that for detection,\u201d said Facebook CTO Mike Schroepfer in a call with press.<\/p>\n

This is likely to be the first election year where malicious actors attempt to influence the political conversation using fake videos of candidates generated in this fashion. Given Facebook\u2019s precarious position in public opinion, it\u2019s very much in their interest to get out in front of this.<\/p>\n

\n

Facebook is making its own deepfakes and offering prizes for detecting them<\/a><\/p>\n<\/blockquote>\n

\n

The competition started last year with the debut of a brand new database of deepfake footage. Until then there was little for researchers to play with \u2014 a handful of medium-size sets of manipulated video, but nothing like the huge sets of data used to evaluate and improve things like computer vision algorithms.<\/p>\n

Facebook footed the bill to have 3,500 actors record thousands of videos, each of which was present as an original and a deepfake. A bunch of other \u201cdistractor\u201d modifications were also made, to force any algorithm hoping to spot fakes to pay attention to the important part: the face, obviously.<\/p>\n

Researchers from all over participated, submitting thousands of models that attempt to decide whether a video is a deepfake or not. Here are six videos, three of which are deepfakes. Can you tell which is which? (The answers are at the bottom of the post.)<\/p>\n

<\/a><\/p>\n

Image Credits: Facebook<\/p>\n

At first, these algorithms were no better than chance. But after many iterations and some clever tuning, they managed to reach more than 80% accuracy in identifying fakes. Unfortunately, when deployed on a reserved set of videos that the researchers had not been provided, the highest accuracy was about 65%.<\/p>\n

It\u2019s better than flipping a coin, but not by much. Fortunately, that was pretty much expected, and the results are actually very promising. In artificial intelligence research, the hardest step is going from nothing to something \u2014 after that it\u2019s a matter of getting better and better. But finding out if the problem can even be solved by AI is a big step. And the competition seems to indicate that it can.<\/p>\n

<\/a><\/p>\n

Examples of a source video and multiple distractor versions. Image Credits:<\/strong> Facebook<\/p>\n

An important note is that the data set created by Facebook was deliberately made to be more representative and inclusive than others out there, not just larger. After all, AI is only as good as the data that goes into it, and bias found in AI can often be traced back to bias in the data set.<\/p>\n

\u201cIf your training set doesn\u2019t have the appropriate variance in the ways that real people look, then your model will not have a representative understanding of that. I think we went through pains to make sure this data set was fairly representative,\u201d Schroepfer said.<\/p>\n

I asked whether any groups or types of faces or situations were less likely to be identified as fake or real, but Schroepfer wasn\u2019t sure. In response to my questions about representation in the data set, a statement from the team read:<\/p>\n

\n

In creating the DFDC dataset, we considered many factors and it was important that we had representation across several dimensions including self-identified age, gender, and ethnicity. Detection technology needs to work for everyone so it was important that our data was representative of the challenge.<\/p>\n<\/blockquote>\n

The winning models will be made open source in an effort to spur the rest of the industry into action, but Facebook is working on its own deepfake detection product that Schropfer said would not be shared. The adversarial nature of the problem \u2014 the bad guys learn from what the good guys do and adjust their approach, basically \u2014 means that telling everyone exactly what\u2019s being done to prevent deepfakes may be counterproductive.<\/p>\n

(Answers to deepfake detection image: 1, 4, and 6 are real; 2, 3, and 5 are deepfakes.)<\/p>\n<\/p>\n

\t\t<\/p>\n

Article source: http:\/\/feedproxy.google.com\/~r\/techcrunch\/social\/~3\/iKrVWeRkXW0\/<\/p>","protected":false},"excerpt":{"rendered":"

The digitally face-swapped videos known as deepfakes aren\u2019t going anywhere, but if platforms want to be able to keep an eye on them, they need to find them first. Doing <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[3],"tags":[10,7,14,15,6,12,11],"class_list":["post-19190","post","type-post","status-publish","format-standard","hentry","category-latest-update","tag-computer-news","tag-downloads","tag-microsoft-download-news","tag-networking-updates","tag-technology-update","tag-wordpress-plugin-download","tag-wordpress-theme-download"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t