Big Data Integration Best Practices

Last week I hosted a SnapLogic webinar that featured a great overview of how to approach the increasing requirements for big data integration by Mark Smith, CEO & Chief Research Officer, Ventana Research. As opposed to simply trying to re-purposing your old ETL tools or hiring developers to write custom code, Mark shared 5 best practices for attaining excellence in big data integration:

  1. Evaluate efficiency of processes
  2. Examine new approaches
  3. Evaluate technology needs
  4. Investigate dedicated technology
  5. Gain benefits that outweigh costs

I’ve embedded the slides below and you can watch the webinar here.

The Death of Traditional Integration

Recently I hosted a SnapLogic webinar featuring the company’s co-founder and CEO, Gaurav Dhillon, and industry analyst, author and practitioner David Linthicum called: The Death of Traditional Data Integration. The webinar was very well attended and the discussion was quite lively. I’ve posted sections of the transcript on the SnapLogic blog, you can also listen to the podcast on the company’s iTunes channel, and the slides are now on Slideshare. I’ve embedded the YouTube video below. Enjoy!

[Infographic] Cloud Integration Drivers and Requirements

Here’s an an infographic from SnapLogic that reviews some the drivers and requirements for cloud-based integration, also known as Integration Platform as a Service (iPaaS), as well as reasons why legacy technologies won’t be able to keep up with the need for speed.

2015 Technology Predictions

I enjoy reviewing the predictions from technology pundits this time of year. I particularly appreciate it when industry analysts take the time to review their predictions from the previous year. Here are a few:

And kudos to Gartner’s Doug Laney for this post – A Look Back on My Information and Analytics Strategy Research from 2014, which also includes links to some of Gartners big data management predictions.

Speaking of predictions, here’s SnapLogic’s Gaurav Dhillon sharing a few of his predictions for 2015:

Avoiding Same Old Same Old (SO SO) Integration

I recently presented to the San Francisco data management association (DAMA) on The Impact of SMACT on the Data Management Stack. The presentation reviewed what we call the Integrator’s Dilemma, which is faced when legacy integration tools are no longer effective in the new world of Social, Mobile, Analytics, Cloud Computing and the Internet of Things (SMACT) and summarized some of the drivers for changes to the modern data management stack. Check out the SnapLogic blog post for a review of the top 5 changes.

When it comes to avoiding Same Old, Same Old (SO SO) integration, the 5 recommendations are:

  1. Determine if you’re suffering from the “Integrator’s Dilemma”
  2. Review your Integration Competency Center / Center of Excellence practices
  3. Do an audit of your cloud applications currently in use
  4. Dig into Hadoop
  5. Investigate AWS Redshift other cloud data warehouse/ business intelligence / analytics options

The presentation is embedded below. Feedback welcome!

10 Reasons Why Old ETL and EAI Will Struggle in the #Cloud and #BigData Era

I recently wrote a post on the SnapLogic blog about the challenges legacy vendors are facing when it comes to managing the new data management challenges – whether it’s social, mobile, analytics and big data, cloud computing or the Internet of Things (SMACT).

The last point is probably the most important – Focus and DNA. When you’re on the inside, I compare it to the frog in boiling water story, but I think Aaron Levie, the visionary CEO of Box.com, put it best when he recently tweeted:

  1. Cannibalization of the Core On-Premises Business
  2. Heritage Matters in the Cloud
  3. EAI without the ESB
  4. Beyond ETL
  5. Point to Point Misses the Point
  6. Franken-tegration
  7. Big Data Integration is not Core…or Cloud
  8. Elastic Scale Out
  9. An On-Ramp to On-Prem
  10. Focus and DNA

You can read the entire post here.

CIOs are Getting SMACT: #Social, #Mobile, #Analytics, #Cloud, #IoT

Check out this Infographic from SnapLogic – Why Are CIOs Getting SMACT?
[Infographic] Why Are CIOs Getting SMACT?


Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 5,072 other followers

Follow Me on Twitter


Sheffield View

Trying to keep up with Big Data Vendor Landscape

A Passion for Research

Focusing on CRM, cloud computing, ERP and enterprise software

SnapLogic Blog

Thoughts on Integration Platform as a Service (iPaaS), Analytics and the SnapLogic Integration Cloud

Learning by Shipping

products, development, management...

Laurie McCabe's Blog

Perspectives on the SMB Technology Market

SaaStr

Getting From $0 to $100m ARR Faster. With Less Stress. And More Success.

Follow

Get every new post delivered to your Inbox.

Join 5,072 other followers

%d bloggers like this: