\n
![](\"https:\/\/i0.wp.com\/rsoftsolution.com\/blog\/wp-content\/plugins\/RSSPoster_PRO\/cache\/816fb_shutterstock_75513031.jpg?w=640&ssl=1\")
<\/p>\n
\n<\/p>\n
Facebook announced this morning that it had completed its move to neural machine translation \u2014 a complicated way of saying that Facebook is now using convolutional neural networks (CNNs) and recurrent neural networks (RNNs) to automatically translate content across Facebook.<\/p>\n
Google, Microsoft and Facebook have been making the move to neural machine translation for some time now, rapidly leaving old-school phrase-based statistical machine translation behind. There are a lot of reasons why neural approaches show more promise than phrase-based approaches, but the bottom line is that they produce more accurate translations.<\/p>\n
Traditional machine translation is a fairly explicit process. Relying on key phrases, phrase-based systems translate sentences then probabilistically determine a final translation. You can think of this in a similar light as using the\u00a0Rosetta Stone (identical phrases in multiple languages) to translate text.<\/p>\n
In contrast, neural models deal in a higher level of abstraction. The interpretation of a sentence becomes part of a multi-dimensional vector representation, which really just means we\u2019re trying to translate based on some semblance of \u201ccontext\u201d rather than phrases.<\/p>\n
![\"\"](\"https:\/\/i0.wp.com\/rsoftsolution.com\/blog\/wp-content\/plugins\/RSSPoster_PRO\/cache\/33a8b_seetranslation2.png?resize=320%2C576&ssl=1\"){kind=spacer}
<\/p>\n
Facebook Status update translation<\/p>\n
It\u2019s not a perfect process, and researchers are still tinkering with how to deal with long-term dependencies (i.e. retaining understanding and accuracy throughout a long text), but the approach is incredibly promising and has produced great results, thus far, for those implementing it.<\/p>\n
Google announced the first stage of its move to neural machine translation<\/a>\u00a0in September 2016 and Microsoft made a similar announcement <\/a>two months later. Facebook has been working on its conversion efforts for about a year and it\u2019s now at full deployment. Facebook AI Research (FAIR) published its own research<\/a> on the topic back in May and open sourced its CNN models on GitHub.<\/p>\n \u201cOur problem is different than that of most of the standard places,\u00a0mostly because of the type of language we see at Facebook,\u201d Necip Fazil Ayan, engineering manager in Facebook\u2019s language technologies group,\u00a0explained to me in an interview. \u201cWe see a lot of\u00a0informal language and slang acronyms. The style of language is very different.\u201d<\/p>\n Facebook has seen about a 10 percent jump in translation quality. You can read more into the improvement in FAIR\u2019s research.<\/a> The results are particularly striking for languages that lack a lot of data in the form of comparative translation pairs.<\/p>\n <\/p>\n