{"id":18612,"date":"2020-05-13T02:12:58","date_gmt":"2020-05-13T02:12:58","guid":{"rendered":"https:\/\/rbsitsoftwaresolution.com\/blog\/facebook-upgrades-its-ai-to-better-tackle-covid-19-misinformation-and-hate-speech.html"},"modified":"2020-05-13T02:12:58","modified_gmt":"2020-05-13T02:12:58","slug":"facebook-upgrades-its-ai-to-better-tackle-covid-19-misinformation-and-hate-speech","status":"publish","type":"post","link":"https:\/\/www.rbsitsoftwaresolution.in\/blog\/facebook-upgrades-its-ai-to-better-tackle-covid-19-misinformation-and-hate-speech.html","title":{"rendered":"Facebook upgrades its AI to better tackle COVID-19 misinformation and hate speech"},"content":{"rendered":"

Facebook\u2019s <\/a> AI tools are the only thing standing between its users and the growing onslaught of hate and misinformation the platform is experiencing. The company\u2019s researchers have cooked up a few new capabilities for the systems that keep the adversary at bay, identifying COVID-19-related misinformation and hateful speech disguised as memes.<\/p>\n

Detecting and removing misinformation relating to the virus is obviously a priority right now, as Facebook and other social media become breeding grounds not just for ordinary speculation and discussion, but malicious interference by organized campaigns aiming to sow discord and spread pseudoscience.<\/p>\n

\u201cWe have seen a huge change in behavior across the site because of COVID-19, a huge increase in misinformation that we consider dangerous,\u201d said Facebook CTO Mike Schroepfer in a call with press earlier today.<\/p>\n

The company contracts with dozens of fact-checking organizations around the world, but \u2014 leaving aside the question of how effective the collaborations really are<\/a> \u2014 misinformation has a way of quickly mutating, making taking down even a single image or link a complex affair.<\/p>\n

Take a look at the three example images below, for instance:\"\"<\/a>In some ways they\u2019re nearly identical, with the same background image, colors, typeface and so on. But the second one is slightly different \u2014 it\u2019s the kind of thing you might see when someone takes a screenshot and shares that instead of the original. The third is visually the same but the words have the opposite meaning.<\/p>\n

An unsophisticated computer vision algorithm would either rate these as completely different images due to those small changes (they result in different hashes) or all the same due to overwhelming visual similarity. Of course we see the differences right away, but training an algorithm to do that reliably is very difficult. And the way things spread on Facebook, you might end up with thousands of variations rather than a handful.<\/p>\n

\u201cWhat we want to be able to do is detect those things as being identical because they are, to a person, the same thing,\u201d said Schroepfer. \u201cOur previous systems were very accurate, but they were very fragile and brittle to even very small changes. If you change a small number of pixels, we were too nervous that it was different, and so we would mark it as different and not take it down. What we did here over the last two and a half years is build a neural net-based similarity detector that allowed us to better catch a wider variety of these variants again at very high accuracy.\u201d<\/p>\n

Fortunately analyzing images at those scales is a specialty of Facebook\u2019s. The infrastructure is there for comparing photos and searching for features like faces and less desirable things; it just needed to be taught what to look for. The result \u2014 from years of work, it should be said \u2014 is SimSearchNet<\/a>, a system dedicated to finding and analyzing near-duplicates of a given image by close inspection of their most salient features (which may not be at all what you or I would notice).<\/p>\n

\"\"<\/a><\/p>\n

SimSearchNet is currently inspecting every image uploaded to Instagram and Facebook \u2014 billions a day.<\/p>\n

The system is also monitoring Facebook Marketplace, where people trying to skirt the rules will upload the same image of an item for sale (say, an N95 face mask) but slightly edited to avoid being flagged by the system as not allowed. With the new system, the similarities between recolored or otherwise edited photos are noted and the sale stopped.<\/p>\n

Hateful memes and ambiguous skunks<\/h2>\n

Another issue Facebook has been dealing with is hate speech \u2014 and its more loosely defined sibling hateful<\/em> speech. One area that has proven especially difficult for automated systems, however, is memes<\/a>.<\/p>\n

The problem is that the meaning of these posts often results from an interplay between the image and the text. Words that would be perfectly appropriate or ambiguous on their own have their meaning clarified by the image on which they appear. Not only that, but there\u2019s an endless number of variations in images or phrasings that can subtly change (or not change) the resulting meaning. See below:<\/p>\n

\"\"<\/a><\/p>\n

To be clear, these are toned-down \u201cmean memes,\u201d not the kind of truly hateful ones often found on Facebook.<\/p>\n

Each individual piece of the puzzle is fine in some contexts, insulting in others. How can a machine learning system learn to tell what\u2019s good and what\u2019s bad? This \u201cmultimodal hate speech\u201d is a non-trivial problem because of the way AI works. We\u2019ve built systems to understand language, and to classify images, but how those two things relate is not so simple a problem.<\/p>\n

The Facebook researchers note that there is \u201csurprisingly little\u201d research on the topic, so theirs is more an exploratory mission than a solution. The technique they arrived at had several steps. First, they had humans annotate a large collection of meme-type images as hateful or not, creating the Hateful Memes data set. Next, a machine learning system was trained on this data, but with a crucial difference from existing ones.<\/p>\n

Almost all such image analysis algorithms, when presented with text and an image at the same time, will classify the one, then the other, then attempt to relate the two together. But that has the aforementioned weakness that, independent of context, the text and images of hateful memes may be totally benign.<\/p>\n

Facebook\u2019s system combines the information from text and image earlier in the pipeline, in what it calls \u201cearly fusion,\u201d to differentiate it from the traditional \u201clate fusion\u201d approach. This is more akin to how people do it \u2014 looking at all the components of a piece of media before evaluating its meaning or tone.<\/p>\n

\n

Facebook speeds up AI training by culling the weak<\/a><\/p>\n<\/blockquote>\n

\n

Right now the resultant algorithms aren\u2019t ready for deployment at large \u2014 at around 65-70% overall accuracy, though Schroepfer cautioned that the team uses \u201cthe hardest of the hard problems\u201d to evaluate efficacy. Some multimodal hate speech will be trivial to flag as such, while some is difficult even for humans to gauge.<\/p>\n

To help advance the art, Facebook is running a \u201cHateful Memes Challenge\u201d<\/a> as part of the NeurIPS AI conference later this year; this is commonly done with difficult machine learning tasks, as new problems like this one are like catnip for researchers.<\/p>\n

AI\u2019s changing role in Facebook policy<\/h2>\n

Facebook announced its plans to rely on AI more heavily<\/a> for moderation in the early days of the COVID-19 crisis. In a press call in March, Mark Zuckerberg said that the company expected more \u201cfalse positives\u201d \u2014 instances of content flagged when it shouldn\u2019t be \u2014 with the company\u2019s fleet of 15,000 moderation contractors at home with paid leave.<\/p>\n

\n

The pandemic is already reshaping tech\u2019s misinformation crisis<\/a><\/p>\n<\/blockquote>\n

\n

YouTube<\/a> and Twitter<\/a> also shifted more of their content moderation to AI around the same time, issuing similar warnings about how an increased reliance on automated moderation might lead to content that doesn\u2019t actually break any platform rules being flagged mistakenly.<\/p>\n

In spite of its AI efforts, Facebook has been eager to get its human content reviewers back in the office. In mid-April, Zuckerberg gave a timeline for when employees could be expected to get back to the office, noting that content reviewers were high on Facebook\u2019s list of \u201ccritical employees\u201d marked for the earliest return<\/a>.<\/p>\n

While Facebook warned that its AI systems might remove content too aggressively, hate speech, violent threats<\/a> and misinformation continue to proliferate on the platform as the coronavirus crisis stretches on. Facebook most recently came under fire for disseminating a viral video discouraging people from wearing face masks or seeking vaccines once they are available \u2014 a clear violation of the platform\u2019s rules against health misinformation.<\/p>\n

The video, an excerpt from a forthcoming pseudo-documentary called \u201cPlandemic,\u201d initially took off on YouTube, but researchers found that Facebook\u2019s thriving ecosystem of conspiracist groups<\/a> shared it far and wide on the platform, injecting it into mainstream online discourse. The 26-minute-long video, peppered with conspiracies, is also a perfect example of the kind of content an algorithm would have a difficult time making sense of.<\/p>\n

On Tuesday, Facebook also released a community standards enforcement report<\/a> detailing its moderation efforts across categories like terrorism, harassment and hate speech. While the results only include a one month span during the pandemic, we can expect to see more of the impact of Facebook\u2019s shift to AI moderation next time around.<\/p>\n

In a call about the company\u2019s moderation efforts, Zuckerberg noted that the pandemic has made \u201cthe human review part\u201d of its moderation much harder, as concerns around protecting user privacy and worker mental health make remote work a challenge for reviewers, but one the company is navigating now. Facebook confirmed to TechCrunch that the company is now allowing a small portion of full-time content reviewers back into the office on a volunteer basis and, according to Facebook Vice President of Integrity Guy Rosen, \u201cthe majority\u201d of its contract content reviewers can now work from home. \u201cThe humans are going to continue to be a really important part of the equation,\u201d Rosen said.<\/p>\n

<\/a><\/p>\n

Article source: http:\/\/feedproxy.google.com\/~r\/techcrunch\/social\/~3\/ZuaAFffaeR8\/<\/p>","protected":false},"excerpt":{"rendered":"

Facebook\u2019s AI tools are the only thing standing between its users and the growing onslaught of hate and misinformation the platform is experiencing. The company\u2019s researchers have cooked up a <\/p>\n","protected":false},"author":1,"featured_media":18613,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[3],"tags":[10,7,14,15,6,12,11],"class_list":["post-18612","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-latest-update","tag-computer-news","tag-downloads","tag-microsoft-download-news","tag-networking-updates","tag-technology-update","tag-wordpress-plugin-download","tag-wordpress-theme-download"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t