{"id":1191,"date":"2016-10-26T16:10:54","date_gmt":"2016-10-26T16:10:54","guid":{"rendered":"http:\/\/www.rsoftsolution.com\/blog\/alluxio-launches-its-memory-centric-storage-system-for-big-data-workloads.html"},"modified":"2016-10-26T16:10:54","modified_gmt":"2016-10-26T16:10:54","slug":"alluxio-launches-its-memory-centric-storage-system-for-big-data-workloads","status":"publish","type":"post","link":"https:\/\/www.rbsitsoftwaresolution.in\/blog\/alluxio-launches-its-memory-centric-storage-system-for-big-data-workloads.html","title":{"rendered":"Alluxio launches its memory-centric storage system for big data workloads"},"content":{"rendered":"


\n<\/p>\n

Alluxio<\/a>, formerly known as Tachyon, raised a $7.5 million Series A round led by\u00a0Andreessen Horowitz earlier this year. Today, the company is launching<\/a> the first commercial product<\/a> based on its open source memory-centric distributed storage platform out of beta.<\/p>\n

The problem Alluxio\u00a0aims to solve is that while most businesses now\u00a0create massive amounts of data, they often store them in a number of storage systems and even clouds. To get\u00a0value from this data, they have to bring all of this information together to analyze it, but that\u2019s hard to do at any speed if your data is stored in all of these different systems.<\/p>\n

Alluxio, which was founded by Haoyuan Li, allows compute frameworks like Spark, MapReduce\u00a0and others to access all of this data by providing a unified namespace across all of these distributed storage systems. It then uses a tiered storage architecture that caches the most often used data in memory, with less often used data on SSDs and traditional hard drives. It\u2019s probably fair to think of Alluxio\u00a0as a very sophisticated cache for big data workloads.<\/p>\n

The software was originally developed at UC Berkeley\u2019s AMPlab and is compatible with the Hadoop file system, which has become somewhat of a standard for storing massive amounts of data across many (often thousands of) machines.<\/p>\n

\"screenshot-2016-10-26-at-14-07-14\"<\/a><\/p>\n

Today, Alluxio is launching both the Enterprise Edition and Community edition of its software out of beta.\u00a0Like most open source projects, Alluxio is monetizing its work by selling support and advanced features. In the case of Alluxio\u2019s enterprise product, these additional features include better support for high-availability setups, enterprise security and data replication.<\/p>\n

The Community Edition is available for free, but in a bit of a twist from the usual model, this version is also certified and tested and comes with all of the necessary drivers to access a wide range of file systems (think Amazon S3, Google Cloud Storage, OpenStack Swift, Red Hat Ceph, Huawei FusionStorage etc.) and computation frameworks (including Apache Spark, Apache Hadoop and Apache MapReduce). Just like the enterprise version, the Community Edition also features Alluxio\u2019s web interface for managing the service. The only major feature you\u2019re not getting for free (besides support) is support for replication and Kerberos Authentication.<\/p>\n

Alluxio\u2019s current users\u00a0include the likes of Alibaba, Baidu, Barclay\u2019s Bank, CERN, Huawei, Intel and others. The company says that it has helped Baidu to improve the performance of some of that companies\u2019 ad-hoc interactive queries on multiple petabytes of data that was originally stored in different data centers from 15 minutes to 30 seconds.<\/p>\n

<\/p>\n

Featured Image: Thomas Trutschel<\/a>\/Getty Images<\/small><\/p>\n

Article source: http:\/\/feedproxy.google.com\/~r\/techcrunchIt\/~3\/zuzGxQzpo-Q\/<\/p>","protected":false},"excerpt":{"rendered":"

Alluxio, formerly known as Tachyon, raised a $7.5 million Series A round led by\u00a0Andreessen Horowitz earlier this year. Today, the company is launching the first commercial product based on its <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[19],"tags":[25],"class_list":["post-1191","post","type-post","status-publish","format-standard","hentry","category-enterprise-software","tag-enterprise"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t