{"id":18066,"date":"2020-04-13T20:44:17","date_gmt":"2020-04-13T20:44:17","guid":{"rendered":"https:\/\/rbsitsoftwaresolution.com\/blog\/verizon-introduces-open-source-big-data-coronavirus-search-engine.html"},"modified":"2020-04-13T20:44:17","modified_gmt":"2020-04-13T20:44:17","slug":"verizon-introduces-open-source-big-data-coronavirus-search-engine","status":"publish","type":"post","link":"https:\/\/www.rbsitsoftwaresolution.in\/blog\/verizon-introduces-open-source-big-data-coronavirus-search-engine.html","title":{"rendered":"Verizon introduces open-source, big data coronavirus search engine"},"content":{"rendered":"

<\/span><\/p>\n

As we struggle to get a grip on exactly how COVID-19<\/a><\/span> makes us ill and what we can do about it, researchers have created over 50,000 articles. That’s a lot of information! So, how do you make sense of it all? Verizon Media<\/a> is doing it by using Vespa<\/a>. This is an\u00a0open-source, big data processing program<\/a> to create a coronavirus academic research search engine: CORD-19 Search<\/a>. \u00a0<\/p>\n

\n\t\tebook<\/span>
\n\t<\/h3>\n


\n <\/span><\/p>\n

<\/a><\/p>\n

\n
\n Coronavirus and its impact on the enterprise
\n <\/a>\n <\/p>\n

This TechRepublic Premium ebook compiles the latest on cancelled conferences, cybersecurity attacks, remote work tips, and the impact this pandemic is having on the tech industry.<\/p>\n

\n Read More<\/a>\n <\/p>\n

This engine works on top of the\u00a0 COVID-19 Open Research Dataset (CORD-19)<\/a>. This dataset should help medical researchers to find and create new insights in the fight against SARS-CoV-2. The documents within it are updated weekly as new research is published in peer-reviewed publications and archival services like bioRxiv<\/a>, biological sciences preprints<\/a> and medRxiv<\/a>, health science preprints. It also includes document links to PubMed<\/a>, Microsoft Academic<\/a>, and the WHO COVID-19 database of publications<\/a>.\u00a0<\/p>\n

What’s different about it from other search engines is that it combines several different methods to find the best answers. Vespa combines text and structured search with exploring by semantic similarity using the scibert-nli<\/a> model. This is a pre-trained data-mining language model for efficiently searching scientific text.\u00a0<\/p>\n

Usually Verizon uses Vespa for applications such as article recommendations, user personalization, and ad targeting. Now, by keyword indexing COVID-19 articles, it makes searching the flood of COVID-19 articles much easier for researchers.\u00a0<\/p>\n

More technically advanced researchers can access the data via the CORD-19 application programming interface (API)<\/a>. If you want you can even download the code and run the application<\/a> on your own server.\u00a0<\/p>\n

This is very much a work in progress. You can expect daily updates to the documentation and query features. Verizon welcomes your help on both the code and the data. Check out its contributing guide<\/a> for how you can help. You can also reach the project’s developers by tweeting to them\u00a0@vespaengine<\/a>.
\u00a0
Related Stories:<\/strong><\/p>\n