{"id":1405,"date":"2016-03-24T14:07:09","date_gmt":"2016-03-24T18:07:09","guid":{"rendered":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/?p=1405"},"modified":"2016-11-16T09:33:06","modified_gmt":"2016-11-16T14:33:06","slug":"is-data-integration-dead","status":"publish","type":"post","link":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/","title":{"rendered":"Is Data Integration Dead?"},"content":{"rendered":"

\"Dead<\/p>\n

If you work with data on a daily basis, you’re probably familiar with the process. Data is captured through any number of sources and stored inside of a data warehouse until it is ready for extraction and transfer into an analytics tool. Traditionally speaking, the integration and analytics tools would be separate entities altogether. More and more BI providers are beginning to include integration capabilities inside their analytics platforms, and even more of the top enterprise integration vendors are moving away from the relational integration method of ETL. Vendors that started out offering Data Integration solutions are now branching out in other directions, with many of them moving in the direction of data management platforms (Apache Hadoop and Spark<\/a>).<\/p>\n

With data volumes exploding, unstructured data on the rise, and analytics vendors siphoning off features that used to be specific to integration providers\u00a0alone, one has to ask, is Data Integration dead?<\/p>\n

The truth is, Data Integration has never been more important. However, the way in which organizations traditionally integrated data, via the “relational” ETL method, is beginning to whither away. Legacy ETL integration tools cannot withstand the sheer volume, variety or velocity of data that companies now generate, rendering these tools\u00a0unusable. Companies are collecting more data than ever, and from an infinite number of additional sources which include IoT device sensors, mobile applications, machine data, social media, and more. With the size, scope and diversity of data growing at an unprecedented rate, the traditional data warehouse\/ETL system no longer holds up.<\/p>\n

Business users no longer speak regularly to their data warehouse. Services now do that on our behalf, moving mixing, and matching those data sources with Big Data systems. This has created a need for Data Lakes<\/a>, which will largely replace data warehouses in the future, according to some experts<\/a>. Thus, existing systems have to evolve further to ensure the automation of data access for the end-user. The complexity of data sources cannot be discounted, and now that companies are moving scores and scores of data to the cloud, these pipelines need to be replaced. For Data Integration to work properly for enterprise organizations in the modern day, it has to be able to collect all of the data, not just stores that are held within a specific source.<\/p>\n

In a world where the growing majority of collected data is unstructured in nature, it is impossible to expect a relational data warehouse to integrate in a way that will drive valuable business insight. These legacy systems simply cannot keep up with the amount of data that needs to be integrated into other environments. Data Lakes are dealing with this problem. By having the technical ability to store any type of data in any realistic capacity, newer data management tools such as Hadoop and Spark<\/a> are able to act as the middleware that legacy integration tools once did. Within this evolving paradigm, every piece of data should be collected.<\/p>\n

Traditional integration tools and techniques required stringent controls over data quality and governance<\/a> in order to extract usable sets from the data warehouse. This is no longer the case, as the Data Lake can house any data type without much thought. This method also allows for a serviced-based approach to data management, which, as a result of important applications and enterprise analytics platforms, enterprises are now employing. For what it’s worth, Gartner rolled\u00a0ETL into their pure-play Data Integration Tools Magic Quadrant<\/a> way back in 2006. If your organization relies on only\u00a0structured data and relational data warehouse techniques, then you’ve got nothing to worry about. But if your company collects or plans on collecting data from different sources in the future, the ETL method of doing business\u00a0has certainly gone the way of the dinosaurs.<\/p>\n


Widget not in any sidebars
<\/p>\n","protected":false},"excerpt":{"rendered":"

If you work with data on a daily basis, you’re probably familiar with the process. Data is captured through any number of sources and stored inside of a data warehouse until it is ready for extraction and transfer into an analytics tool. Traditionally speaking, the integration and analytics tools would be separate entities altogether. More […]<\/p>\n","protected":false},"author":23,"featured_media":1409,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[1,251,252],"tags":[19,290,246,37,291,33,194,55,155],"acf":[],"yoast_head":"\nIs Data Integration Dead?<\/title>\n<meta name=\"description\" content=\"With data volumes exploding and unstructured data generation on the rise, one has to ask, is Data Integration dead?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Tim King\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/\"},\"author\":{\"name\":\"Tim King\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\"},\"headline\":\"Is Data Integration Dead?\",\"datePublished\":\"2016-03-24T18:07:09+00:00\",\"dateModified\":\"2016-11-16T14:33:06+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/\"},\"wordCount\":636,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#organization\"},\"image\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/03\/oie_eACRiWcgoRfA.jpg\",\"keywords\":[\"Big Data\",\"Business Intelligence\",\"Data Governance\",\"Data Lake\",\"Data Quality\",\"Data Warehouse\",\"ETL\",\"Hadoop\",\"Spark\"],\"articleSection\":[\"Best Practices\",\"Featured\",\"Staff Pick\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/\",\"url\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/\",\"name\":\"Is Data Integration Dead?\",\"isPartOf\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/03\/oie_eACRiWcgoRfA.jpg\",\"datePublished\":\"2016-03-24T18:07:09+00:00\",\"dateModified\":\"2016-11-16T14:33:06+00:00\",\"description\":\"With data volumes exploding and unstructured data generation on the rise, one has to ask, is Data Integration dead?\",\"breadcrumb\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#primaryimage\",\"url\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/03\/oie_eACRiWcgoRfA.jpg\",\"contentUrl\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/03\/oie_eACRiWcgoRfA.jpg\",\"width\":800,\"height\":350},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Is Data Integration Dead?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#website\",\"url\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/\",\"name\":\"Best Data Integration Vendors, News & Reviews for Big Data, Applications, ETL and Hadoop\",\"description\":\"Data Integration Buyers Guide and Best Practices\",\"publisher\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#organization\",\"name\":\"Solutions Review\",\"url\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"contentUrl\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png\",\"width\":225,\"height\":90,\"caption\":\"Solutions Review\"},\"image\":{\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c\",\"name\":\"Tim King\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2023\/12\/tk.jpg\",\"contentUrl\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2023\/12\/tk.jpg\",\"caption\":\"Tim King\"},\"description\":\"Tim is Solutions Review's Executive Editor and leads coverage on data management and analytics. A 2017 and 2018 Most Influential Business Journalist and 2021 \\\"Who's Who\\\" in Data Management, Tim is a recognized industry thought leader and changemaker. Story? Reach him via email at tking@solutionsreview dot com.\",\"url\":\"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/author\/timking\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Is Data Integration Dead?","description":"With data volumes exploding and unstructured data generation on the rise, one has to ask, is Data Integration dead?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/","twitter_misc":{"Written by":"Tim King","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#article","isPartOf":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/"},"author":{"name":"Tim King","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c"},"headline":"Is Data Integration Dead?","datePublished":"2016-03-24T18:07:09+00:00","dateModified":"2016-11-16T14:33:06+00:00","mainEntityOfPage":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/"},"wordCount":636,"commentCount":0,"publisher":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#organization"},"image":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#primaryimage"},"thumbnailUrl":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/03\/oie_eACRiWcgoRfA.jpg","keywords":["Big Data","Business Intelligence","Data Governance","Data Lake","Data Quality","Data Warehouse","ETL","Hadoop","Spark"],"articleSection":["Best Practices","Featured","Staff Pick"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/","url":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/","name":"Is Data Integration Dead?","isPartOf":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#website"},"primaryImageOfPage":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#primaryimage"},"image":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#primaryimage"},"thumbnailUrl":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/03\/oie_eACRiWcgoRfA.jpg","datePublished":"2016-03-24T18:07:09+00:00","dateModified":"2016-11-16T14:33:06+00:00","description":"With data volumes exploding and unstructured data generation on the rise, one has to ask, is Data Integration dead?","breadcrumb":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#primaryimage","url":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/03\/oie_eACRiWcgoRfA.jpg","contentUrl":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/03\/oie_eACRiWcgoRfA.jpg","width":800,"height":350},{"@type":"BreadcrumbList","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/is-data-integration-dead\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/"},{"@type":"ListItem","position":2,"name":"Is Data Integration Dead?"}]},{"@type":"WebSite","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#website","url":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/","name":"Best Data Integration Vendors, News & Reviews for Big Data, Applications, ETL and Hadoop","description":"Data Integration Buyers Guide and Best Practices","publisher":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#organization","name":"Solutions Review","url":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/logo\/image\/","url":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","contentUrl":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2016\/02\/Solutions_Review_Header_Data_Integration_225.png","width":225,"height":90,"caption":"Solutions Review"},"image":{"@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/person\/154e152a275103e373e24ada7f2feb5c","name":"Tim King","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/#\/schema\/person\/image\/","url":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2023\/12\/tk.jpg","contentUrl":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/files\/2023\/12\/tk.jpg","caption":"Tim King"},"description":"Tim is Solutions Review's Executive Editor and leads coverage on data management and analytics. A 2017 and 2018 Most Influential Business Journalist and 2021 \"Who's Who\" in Data Management, Tim is a recognized industry thought leader and changemaker. Story? Reach him via email at tking@solutionsreview dot com.","url":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/author\/timking\/"}]}},"_links":{"self":[{"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/posts\/1405"}],"collection":[{"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/comments?post=1405"}],"version-history":[{"count":0,"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/posts\/1405\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/media\/1409"}],"wp:attachment":[{"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/media?parent=1405"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/categories?post=1405"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stg-solutionsreviewcom-staging.kinsta.cloud\/data-integration\/wp-json\/wp\/v2\/tags?post=1405"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}