{"id":1959,"date":"2016-12-01T21:44:55","date_gmt":"2016-12-01T21:44:55","guid":{"rendered":"http:\/\/www.rsoftsolution.com\/blog\/amazon-glue-solves-sticky-data-prep-problem-in-cloud-2.html"},"modified":"2016-12-01T21:44:55","modified_gmt":"2016-12-01T21:44:55","slug":"amazon-glue-solves-sticky-data-prep-problem-in-cloud-2","status":"publish","type":"post","link":"https:\/\/www.rbsitsoftwaresolution.in\/blog\/amazon-glue-solves-sticky-data-prep-problem-in-cloud-2.html","title":{"rendered":"Amazon Glue solves sticky data prep problem in cloud"},"content":{"rendered":"


\n<\/p>\n

Amazon announced Amazon Glue today at the re:Invent conference in Las Vegas. The tool has been designed to help developers\u00a0process data, whether the source is in the cloud or on prem. This is sometimes known as extract, transform, load (ETL) of data, and it\u2019s generally considered one of the toughest parts of analytics.<\/p>\n

As Amazon CTO Werner Vogels explained today on stage at the re:Invent, getting data into a form you can actually use it to perform analytics is hard work. In fact, it\u2019s so difficult, that it\u2019s generally accepted that you spend about 80 percent of your time getting the data ready to be analyzed and just 20 percent getting information from that data. Vogels said, the goal of Amazon Glue is to flip that equation, greatly simplifying the act of processing the data, so that you are freed to\u00a0do analysis on it, regardless of the analytics tools you are using.<\/p>\n

This last point is particularly important because many analytics tools require that the data be in a specific format, and that transformation can be a lot of up-front work. Basically, Glue does all of this work for you \u2014 whether you\u2019re using Amazon Redshift, Amazon S3, an RDS database, or any JDBC compliant database for that matter, regardless of where it\u2019s stored.<\/p>\n

The first step is to simply point to your data sources, regardless of where they are. It builds the data catalog for you including giving you the opportunity to define access control. Next, it prepares the data by building it in the format required for your analytics package. Finally, it gives you the ability to schedule and run jobs against the clean data set, and if the source data changes, the jobs will run again automatically based on the new information.<\/p>\n

The whole idea is to remove\u00a0the complexity from data preparation and maintenance, a task that has tended to be extremely labor\u00a0intensive, and allow people to do what they actually want to do, and that\u2019s run queries against one or more data sets to get answers based on that information.<\/p>\n

<\/a><\/p>\n

<\/p>\n

Article source: http:\/\/feedproxy.google.com\/~r\/techcrunchIt\/~3\/UtJkPYN0nao\/<\/p>","protected":false},"excerpt":{"rendered":"

Amazon announced Amazon Glue today at the re:Invent conference in Las Vegas. The tool has been designed to help developers\u00a0process data, whether the source is in the cloud or on <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[19],"tags":[25],"class_list":["post-1959","post","type-post","status-publish","format-standard","hentry","category-enterprise-software","tag-enterprise"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t