The Death of Traditional Integration

Recently I hosted a SnapLogic webinar featuring the company’s co-founder and CEO, Gaurav Dhillon, and industry analyst, author and practitioner David Linthicum called: The Death of Traditional Data Integration. The webinar was very well attended and the discussion was quite lively. I’ve posted sections of the transcript on the SnapLogic blog, you can also listen to the podcast on the company’s iTunes channel, and the slides are now on Slideshare. I’ve embedded the YouTube video below. Enjoy!

6 Requirements of a Modern Integration Platform

In 2009 I worked with data and application integration guru David Linthicum on a whitepaper called, “What to Look for When Evaluating Cloud Integration Solutions.” The 6 requirements were:

1. True multitenant versus hosted offering
2. Ease of use
3. Try and buy / rapid deployment
4. IT or LOB usability
5. Scalability
6. Vendor viability

While I don’t think I’d change this list too much in 2014, I’ve been putting together a series of posts on the SnapLogic blog summarizing the requirements of a modern integration platform. Now commonly known as integration platform as a service (iPaaS), the 6 primary requirements are:

1. Fully-Functional Cloud-based Service (based on a Software-Defined Architecture)
2. Single Platform for Big Data, Application and API Integration
3. Elastic Scale
4. Built on Modern Standards (REST, JSON)
5. Broad Cloud and On-Premises Connectivity
6. Self-Service for Citizen Integrators

Let me know if you agree or disagree with the list. I’ve embedded a demonstration of the SnapLogic Elastic Integration Platform below if this is an area of cloud computing that is new to you.

Cloud Politics and the Role of Data Integration

A few weeks ago I wrote a post called, “Avoiding a Cloud Data Disaster.” The post made the following recommendations to organizations investing in software as a service (SaaS) applications and platforms like Salesforce CRM and Force.com:

1. Don’t Wait to Integrate
2. Make Data Quality a Top Priority
3. Get IT Involved Early
4. Think Big, Start Small
5. Beware of Point Solutions

Recently I’ve been involved in a number of discussions with people in IT organizations where #3 was clearly not followed, which typically means that #1 was ignored as well. There’s been a lot written about why SaaS applications are well suited and appealing to the line of business (easy to use, rapid deployment, capex vs. opex, etc.). But how is IT’s role evolving as cloud-based applications continue to proliferate? One IT director put it this way, “our job is to make sure that the business doesn’t hurt themselves!”

According to IDC’s survey research, security, availability, and performance are the primary barriers to success in the cloud. But from my experience, internal politics can often be a much bigger hurdle to get over. I  find that there are generally three common scenarios when it comes to the IT dynamic, roles, and responsibilities:

• The Edge of the Enterprise: Okay, I didn’t coin the term, but I like it and I think it’s appropriate for cloud computing in 2010.  SaaS application adoption in larger organizations often begins with an under-served department or business unit (also known as data silos!). Line of business (LOB) then selects a point application that is unsupported by IT and attempts to hand-code basic integration. At some point IT will need to get involved to find a way to stitch it all together.  I spoke to a new Salesforce.com customer recently that is planning to roll out 1000 seats with no IT involvement whatsoever! In this case, the IT department is too busy trying to figure out Oracle (con)Fusion. This is when LOB often “goes rogue” (Sarah Palin style I guess). The fireworks on calls that I’ve been on involving both sides are always interestig and the need for a comprehensive integration strategy that will deliver timely, relevant, and trustworthy data is often the forcing function that brings them together.
• The No-IT Approach: This is another reason for the phenomenal growth of cloud-based applications. SMB is where SaaS apps have their roots. But this is where #1 and #4 are critical. The sooner integration gets on the radar of the SaaS application implementation, whether there are IT resources or not, the better. Look for a mulitenant integration as a service solution that won’t hit the ceiling as your data volumes, sources, and complexity grow over time. Limited IT resources doesn’t mean that you have to sacrifice scalability and performance – two of the cornerstones of enterprise-class data integration solutions.
• The LOB Self-Service / IT Trust and Control Approach: Okay, I know that this may be the Holy Grail for most organizations, but the good news is that integration delivered as a true on-demand service can actually play a critical role in making this dream a reality. What if IT and LOB cloud actually collaborate to create a trusted source of integrated data that is controlled and managed by IT, but accessible by non-technical people who either don’t have time to wait for their requirements to be met or they don’t have IT resources in the first place. Recently David Linthicum and I did a podcast on the topic based on this post:  Staging or Direct – SaaS Integration Best Practices. He then wrote his own post on the topic where he made the following point:

“The use of intermediary staging where the data can be viewed, manipulated, and cleaned, insures that the data quality and any data governance required occurs consistently.”

The CIO post, “10 Big Cloud Trends for 2010” didn’t call out politics as a big trend, but they did concede that:

“Politics will drive decisions:  Cloud-based services have demystified compute services and increasingly business executives will ask IT managers about the cloud.”

So what are the cloud politics in your organization? Do you see a role for data integration to help bridge the IT and LOB divide as it relates to self-service, governance, trust, and control? Am I overstating the problem? Got any best practices and/or anecdotes to share?

Cloud Integration: Don’t Build a House without a Driveway

David Linthicum agrees with my Cloud Data Integration Predictions and Chris Boorman’s 2010 Predictions from Data Integration World. Check out what he has to say in his post, “Four Data Integration Predictions for 2010“:

“Cloud computing drives much of the growth of data integration. While we’ve not seen this as of yet, the continued interest in cloud computing will certainly drive a lot of data integration in 2010. The fact of the matter is that enterprises don’t think about data integration until they have already moved to the cloud. That’s like building a house without a driveway.”

Nice!

Just getting started with SaaS/Cloud integration? Here are a few resources that you may find useful from David Linthicum (sorry, but registration is required):

• What to Look for When Evaluating Integration as a Service
• Approaching SaaS Integration with Data Integration Best Practices and Technology
• Best Practices in Leveraging a Staging Area for SaaS-to-Enterprise Integration

Good luck with your new driveway!