This week SnapLogic posted a presentation of the 10 Modern Data Integration Platform Requirements on the company’s blog. They are:
- Application integration is done primarily through REST & SOAP services
- Large-volume data integration is available to Hadoop-based data lakes or cloud-based data warehouses
- Integration has to support the continuum of data velocities starting from batch all the way to continuous streams
- Integration is event-based rather than clock-driven
- Integration is primarily document- centric
- Integration is hybrid and spans cloud-cloud and cloud-ground scenarios
- Integration itself has to be accessible through SOAP/REST APIs
- Integration is all about connectivity… connectivity connectivity
- Integration has to be elastic
- Integration has to be delivered as a service
I’ve embedded the presentation below.
I wrote a post on the SnapLogic blog this week about the wave of innovation that is happening in the data and application integration market and introduced two new data management acronyms (like we need more, I know) – OETL and OEAI:
- Old Extract, Transform, Load
- Old Enterprise Application Integration
There’s no shortage articles (and books) on disruptive innovation and why it’s so hard for on-premises software vendors to transition to the new era of social, mobile, analytics and big data, and the internet of things (SMACT). Here are 10 reasons (some unique and some applicable to all mature technology vendors) why legacy data integration and middleware vendors are struggling to re-invent themselves:
- Cannibalization of the Core On-Premises Business
- Heritage Matters in the Cloud
- EAI without the ESB
- Beyond ETL
- Point to Point Misses the Point
- Big Data Integration is not Core…or Cloud
- An On-Ramp to On-Prem
- Focus and DNA
You can read the entire post here. Let me know if you agree / disagree – I clearly have somewhat of a bias.
Here’s a powerpoint I worked on in 2007 that continues to be appropriate today.
cloud computing , data integration , Data Integration in the Cloud , Informatica
Tags: Application programming interface, Cloud integration, Cloud-based integration, data integration, Gaurav Dhillon, Informatica, SaaS Integration, snaplogic
Gaurav Dhillon co-founded Informatica in 1992 and ran the company until 2004. In 2006 he co-founded SnapLogic, a data integration start-up in San Mateo, California. In 2010 he took over as the company’s Chairman and CEO and re-focused the company on tackling the emerging cloud data and application integration challenge in the enterprise.
Today SnapLogic introduced the SnapLogic Integration Cloud, with a focus on three key areas:
You can read more about the Winter 2014 release of the multi-tenant integration platform as a service (iPaaS) here. Here’s a video of Gaurav introducing the company out summarizing the importance of the right approach to cloud data and application integration in the API economy. He’s also presenting on that topic on a GigaOM webinar with David Linthicum later this week.
In 2006 I posted a presentation on Slideshare called, “What is Driving the Shift to On-Demand BI?“ While it might have been a little early in terms of cloud business intelligence adoption, looking at it today shows that most of the industry analyst predictions were actually quite conservative when it comes to cloud adoption in the enterprise. I listed the drivers for the shift to analytics as a cloud service as:
- It just makes sense
- Simple, simple, simple
- OLTP –> OLAP
- Because Gartner said so!
- “Date a fad, marry a trend.” (with acknowledgement to @kellblog of course)
Here’s the presentation.
Recently Amazon.com announced that Redshift, their data warehouse solution, is the company’s fastest growing AWS service. Over 1000 global customers are moving significant business intelligence initiatives to Amazon’s data warehouse in the cloud. This video does a pretty nice job of explaining how it works and why the value proposition is so compelling.
In this video, SnapLogic CEO (and co-founder of Informatica) Gaurav Dhillon talks about the mission of his company and what’s changed in the data integration market.
cloud computing , cloud integration , Data Integration in the Cloud , Informatica , PaaS , SaaS
Tags: Cloud integration, governance, ICC, integration competency center, lean integration, SaaS Integration, self-service
Today I moderated a webinar focused on Eliminating SaaS Sprawl with Cloud Integration. We focused on the usual challenges of silos and data fragmentation, but also focused on the opportunity to apply Lean Integration principles in a next generation integration Center of Excellence (CoE) or integration competency center (ICC). The conversation centered on the need for speed and business agility, while also maintaining strong governance and control in IT. What I call “Governed Self Service.”
David Lyle, co-author of the book on Lean Integration, pointed out that integration is a concept that mirrors the “just-in-time” (JIT) manufacturing principles of the automotive industry. With JIT manufacturing, the necessary components to assemble a car are sourced throughout the supply chain and brought onto the factory floor just before they are needed thus minimizing the amount of time a worker has to wait for the necessary part. Lean Integration transforms organizational processes and relies on leading-edge technology for automation and reuse to systematically reduce costs and accelerate delivery. His presentation summarized how the objectives of cloud integration are one and the same as Lean Integration:
- Eliminate waste
- Increase value for end-user customers
- Drive continuous improvement
Mark Murray from the Informatica Cloud team, then delivered a powerful cloud integration demonstration that focused on re-usable templates and the concept of having a central instance and sub-instances that can be deployed out to the divisions and lines of business, while maintaining centralized administration Pretty powerful stuff!
I’ve embedded the webinar in it’s entirety below:
I started a blog post with an “is it me?” question once and got one comment: “Yes, it’s you.”
With that as an intro and a risk, let me ask: “Is it me or is cloud integration suddenly cool?”
Okay, maybe “cool” is the wrong word. But take a look at the trend:
So what’s so hot about cloud integration? In May 2010 I wrote about Phase Two Cloud Integration and The Dangers of Delaying Cloud Integration.
Here’s how I answered the question in a recent interview:
“The first wave of cloud adoption was driven by software as a service (SaaS) applications. Pioneered by companies like salesforce.com, these applications typically were sold directly to the business, with minimal (if any) involvement from the traditional IT department. While there was a great deal of small to mid-sized company adoption early on, there was just as much departmental purchasing taking place in larger companies due to the benefits of ease of use, the promise of rapid deployments and the operational expense appeal of the subscription pricing model. On the IT side of the fence, I would characterize this as the “cloud skeptical” phase. On the business side, it was more like the Wild West. This is where cloud-based data integration first gained a foothold. Mid-sized companies and autonomous divisions and departments had limited technical resources but needed many of the same capabilities – data migration, synchronization, replication, and of course data quality.
Fast forward to today and IT organizations are increasingly becoming “cloud first.” Cloud deployments are becoming more complex, whether they are software, platform or infrastructure as a service; and the importance of broader cloud data management strategy is now recognized as the critical enabler of success. It’s a now truly a hybrid IT world. To avoid the perils of data fragmentation and “SaaS sprawl” business and IT organizations are starting to align around the need for trusted data.”
Do you agree? Disagree? Anyone got a comment?