Last week I hosted a SnapLogic webinar that featured a great overview of how to approach the increasing requirements for big data integration by Mark Smith, CEO & Chief Research Officer, Ventana Research. As opposed to simply trying to re-purposing your old ETL tools or hiring developers to write custom code, Mark shared 5 best practices for attaining excellence in big data integration:
- Evaluate efficiency of processes
- Examine new approaches
- Evaluate technology needs
- Investigate dedicated technology
- Gain benefits that outweigh costs
I’ve embedded the slides below and you can watch the webinar here.
For 5+ years this blog has focused primarily on the topic of integrating cloud applications like Salesforce.com, Workday, ServiceNow, Zuora, etc. with each other and with on-premises applications like SAP and Oracle. Occasionally I’ve written about the shift to cloud-based business intelligence tools and platforms, but it’s been mostly all things software as a service (SaaS) and integration platform as a service (iPaaS).
Thanks primarily to YARN and some of the advances in the Hadoop 2.0 platform, this week SnapLogic announced SnapReduce 2.0. Cloud application integration has expanded to big data integration. Here’s SnapLogic’s Chief Scientist Greg Benson discussing the news.
I like how Tableau created a web page and slideshare presentation for their 2014 business intelligence predictions. I also like their predictions. Here they are, with a few comments.
- The end of data scientists (does that mean data artisans too?)
- Cloud business intelligence goes mainstream (I guess I was a little early on that one – here’s an interesting cloud BI survey)
- Big data finally goes to the sky (go Redshift!)
- Predictive analytics goes mainstream (hmmm…I still remember “Data Mining for the Masses” circa 1998 with BusinessObjects Business Miner)
- Agile BI extends its lead (is there one BI vendor that doesn’t call their tools agile?)
- Embedded BI begins to emerge (Good news for JasperSoft, given they’ve been talking about this for years.)
- Story telling becomes a priority (In other words, stop talking speeds and feeds and discuss outcomes – as suggested recently by Ken Rudin)
- Mobile BI becomes the primary experience (Michael Saylor has to be happy about this prediction – has anyone read The Mobile Wave?)
- Organizations begin to analyst social data in earnest (Is Earnest was a new flavor or Hadoop?)
- NoSQL is the new Hadoop (not sure what the angle here is for Tableau, but sure.)
Here’s the presentation with more details.
According to Gaurav Dhillon, CEO of SnapLogic, there’s not just an Innovator’s Dilemma hitting legacy technology vendors, there’s an Integrator’s Dilemma that the customers of traditional middleware and data integration providers are struggling with in the face of the today’s industry mega-trends. As he states:
“The dilemma for enterprise IT organizations is that their legacy integration technologies were built before the era of big data, social, mobile and cloud computing and simply can’t keep up.”
Here’s a video of Gaurav talking about the Integrator’s Dilemma:
Image by None via CrunchBase
Ken Rudin runs the analytics team at Facebook. Today at Strata and Hadoop World he delivered a fantastic presentation on Big Data and how Facebook approaches analytics. Instead of adding another V to the Big Data pile, he instead focused on the most important I in BI – Impact. I had the pleasure of working with Ken Rudin for 2.5 years at an early-stage cloud analytics company called LucidEra, where he pioneered something called, “The Pipeline Healthcheck.” Some of the messages he conveyed at #strataconf are ones he’s held for a long time:
- Analytics is not just about getting the answers, it’s about knowing what questions to ask.
- It’s not about insight, it’s about impact.
You can watch his presentation below. It’s clear, concise and will have an impact – particularly if you’re a business analyst or planning to become one. I agree with this post from BI guru, Cindi Howson:
“If I were to ask a biz sponsor or BI team to watch 1 keynote, it would be Ken Rudin, Facebook.”
Well done Ken!
I recorded an interview recently as part of the Cloud Channel Summit in Mountain View. Industry analyst Jeff Kaplan from THINKstrategies posted his views on the event here and here. In my interview I talk about the need for SaaS application and platform (PaaS) providers to either build, buy or partner when it comes to cloud integration. Everyone talks about the 3 V’s when it comes to Big Data. My belief is that IT organizations are equally overwhelmed with the volume, variety and velocity of SaaS applications coming into the enterprise. This is why the topic of cloud integration will continue to it’s rise in relevance and strategic importance in 2013.