Posts Tagged 'Databases'

Build Your Own Integration – Don’t Be Dumb!

Image representing ebizQ as depicted in CrunchBase

Image via CrunchBase

Recently Hollis Tibbetts has been writing extensively about all aspects of data integration (with a heavy does of cloud) on ebizQ. His most recent post pulls no punches:  Building Integration Yourself – Possibly the Dumbest Idea You’ve Had in a Long Time.

The article wraps up with a series of questions to consider before you jump into the “tarpit” of hand-coding your data integration. I suggest you pose these questions to anyone in your IT organization who tells you they’re “just going to write some scripts” or “simply develop Web  Services” when it comes to cloud integration:

1)  In the SaaS world, APIs are updated on average 4-12 times a year. What is the impact of that on your custom code? What if a document format (e.g. and EDI document) changes? Will you even know in advance of these changes, or will the change happen and suddenly your system stops working and you have a crisis on your hands?

2)  Are you prepared to handle latency and unavailability issues, timeouts, etc.?

3)  Have you budgeted for building a sufficiently robust logging system for errors, as well as for when data ends up somewhere it shouldn’t and you need to undo the situation?

4)  Can you guarantee that data won’t get lost when something “bad” happens?

5)  How will you monitor what’s going on in the system?

6)  Coding transformations and business logic in Java, C#, C++ or any other programming language is very time consuming. Transformations and business logic change a LOT. How will you support that? Most integration products support simple or standard scripting languages, drag and drop, reusable objects, etc.

7)  How do you plan to implement mapping – especially between something like a Web Service and a Relational Database (where one can be hierarchical in nature and the other a collection of tables). What happens when one of those things changes? Have you thought about transactionality and serializability? Do you need to support that?  How will you do it?

8)  Many applications require the use of proprietary SDKs for integration. Are you trained in those? Prepared to support changes in the SDKs?

9)  What levels of performance are required? How do you plan to meet those? What happens if that changes – is scalability built into your solution?

10)  If more sources or targets for integration are added, will your system support that, or did you build something that is a throwaway?

11)  Does your home-built system support concurrent development?

Great questions Hollis and a great article. I hope everyone considering hand-coding their data integration reads and shares it.


Data Integration in the Cloud (via Business Analytics 3.0)

This post provides a comprehensive overview of cloud integration use cases, options and approaches. It’s definitely worth reviewing if you’re interested in the topic.

The Curious Case of Salesforce and Workday: Data Integration in the Cloud The growing enterprise adoption of Salesforce SFA/CRM, Workday HR, Netsuite ERP, Oracle on Demand, for apps and Amazon Web Services for e-commerce will result in more fragmented enterprise data scattered across the cloud. Automating the moving, monitoring, securing and synchronization of data is no longer a “nice-to-have” but “must-have” capability. Data quality and integration issues — aggregating data from the myriad sources and servi … Read More

via Business Analytics 3.0

Next Generation Cloud Business Intelligence?

MicroStrategy entered the cloud BI market today by announcing the general availability of MicroStrategy Cloud. From the press release:

“Compared to traditional on-premises BI approaches, MicroStrategy Cloud is quicker to deploy (within 48 hours) and more flexible, delivers world-class performance, and offers significant financial advantages. MicroStrategy Cloud is powerful and flexible enough to support the full range of cloud use cases, from fast, flexible tactical BI solutions, to the largest implementations where performance and scalability are imperative.”

The announcement goes on to highlight the following benefits:

  • World-Class Performance
  • Integrated Database and Data Integration
  • Accelerated Time to Market
  • Comprehensive Security
  • Elite Platform Partners
Of note on the partner front:
  • “IBM Netezza will provide its complete family of analytical appliances.”
  • “MicroStrategy Cloud customers will be able to choose from a multitenant Cloud-based Data Integration solution, or run their own dedicated Informatica environment in the MicroStrategy Cloud.”
  • “ParAccel will bring its analytic platform to MicroStrategy Cloud customers, delivering extreme scalability to thousands of nodes and tens of thousands of users in a flexible, solution that is optimized for virtualized and cloud-based environments.”
Is Cloud BI 2.0 now upon us? Be sure to read the entire MicroStrategy Cloud press release for more details.

Gartner: Data Warehousing at an Inflection Point

A few weeks ago at Informatica‘s annual industry analyst summit, one my favorite tweets was: “Who would have thought that 10 years later data warehousing would still be interesting?”

Well, today Gartner put out the following press release:  Gartner Says Data Warehousing Reaching Its Most Significant Inflection Point Since Its Inception. While there was surprisingly no mention of the impact of cloud computing, the release does make an important point about the shift in the balance of power from database management vendors to data integration vendors:

“Analysts maintain that there is a real opportunity for data integration tools vendors to challenge the database management system (DBMS) vendors as the primary data management architecture, and the DBMS vendors should not underestimate this potential competition.”

Additional information is available in the Gartner report “The State of Data Warehousing in 2011.” The report is available on Gartner’s website at

2011 Data Integration Predictions

Chris Boorman has posted his 2011 Predictions from the World of Data Integration on the Informatica Perspectives blog. Not surprisingly, he has a lot to say about cloud integration. Here are his predictions:

  1. The Data Deluge Increases Pace – Big Data Arrives
  2. The Hybrid IT Enterprise Finally Embraces the Cloud
  3. Cost Savings will Still be Front of Mind
  4. Enterprises will Focus on Data to Emerge from the Recession
  5. Data Virtualization takes its rightful place alongside other Virtualizations
  6. Social Data Moves Enterprises from Transactions to Interactions
  7. Privacy and Security Risks Drive MDM and Data Masking
  8. Community will Accelerate Innovation
  9. Self-service, Cloud and Collaboration will Squeeze Open Source Data Integration Solutions

It’s a solid list. Be sure to read the entire post here and share your feedback.

CRM Smackdown: Oracle vs.

Benioff vs. Ellison smackdownPaul Greenberg published a great review of Oracle OpenWorld today (sessions = good; keynotes = really bad).  He includes some of the main Ellison vs. Benioff sideshow highlights and provides some good details on Oracle’s CRM roadmap. CRM Market Analyst Lauren Carlson takes it step further with a summary of each vendor’s capabilities in her post: Oracle OpenWorld CRM Smackdown.  She also includes an interesting survey, which is still open for input. She poses the questions:

1) Who do you view as the leader in CRM?

  • SAP
  • Oracle
  • Microsoft
  • Other:
2) Will Oracle acquire
  • Yes
  • No
3) Who’s more full of it?
  • Benioff
  • Ellison
  • It’s a tie.

You can take the survey here. The results will be interesting.

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 7,150 other followers

Follow Me on Twitter


Sheffield View

Trying to keep up with Big Data Vendor Landscape

A Passion for Research

Focusing on CRM, cloud computing, ERP and enterprise software

SnapLogic Blog

Accelerate Your Integration. Accelerate Your Business.

Learning by Shipping

products, development, management...

Laurie McCabe's Blog

Perspectives on the SMB Technology Market

Andreessen Horowitz

Software Is Eating the World

%d bloggers like this: