Strata + Hadoop NY 2016: Data Gets Even Bigger

This week’s annual Strata + Hadoop World in New York City was, as one tweet described it, “The Lollapalooza of Big Data.” Magnitude Software had a great conference, meeting with customers, prospects and top analysts while taking in all that the ever-evolving data landscape has to offer.

Read more

What on earth does MDM have to do with Big Data?

Well, actually rather a lot. In a recent webinar in which I participated with Virgin Media, the question was raised by one of the attendees as a current requirement. It surprised me a little, as although I have had many theoretical conversations about the relationship between the two disciplines, it was refreshing to hear customers looking to take real action on the subject. This combined with no less than a dozen conversations with large financial services customers, analysts and industry alumni alike, has inspired me to share. Read more

Can’t We All Just Get Along?

I was at a standstill on a blog that I alluded to in my previous Thick as a Brick submission when I ran across a similar theme from Jonathan Feldman on Information Week Global CIO, No One Likes Petulant Teenagers.  The premise that I alluded to was that many CIOs are in the business of damage control and thus have no bandwidth left to be visionary. Read more

Commoditizing Data Science: The stampede toward Shadow IT 2.0

Recently I attended the Gartner BI Summit in Dallas. If there was any one thing that jumped out at me it was how many of the analytics vendors I spoke with are lowering the barrier to entry for just about anyone to acquire and apply these at their desk, from their hotel rooms, in the airport or on the plane (if they can actually open their laptops in those not-so-accommodating coach seats). It’s a pretty amazing time. Read more

Big Data and Moneyball

Like many baseball fans, I was spellbound by Moneyball, the 2003 Michael Lewis book that told the story of how Oakland Athletics general manager Billy Beane and his staff leveled the playing field between baseball’s biggest teams and his small market club by finding overlooked value in the “big data” of baseball statistics. Read more

Big Data without Context is Worthless

Whenever you find yourself on the side of the majority, it is time to pause and reflect.
– Mark Twain

These days, if you’re in business you’re likely buzzing about Big Data. Everyone is. Marketing guys like me are trying to figure out an angle to exploit it. What we are buzzing about is an unimaginably expansive universe and we know intuitively there is value to be gained or lost in there. Use whichever analogy you like. It’s the wheel of fortune. It’s a haystack with a needle somewhere within. It’s a pile of river sand that contains a fleck of gold. Read more

Of course Big Data will change the “Traditional” Data Warehouse

I derive great enjoyment from reading the blogs, comments and tweets about whether or not Big Data will replace the Data Warehouse. But as with most predictions, I believe there is a half-truth hidden therein…  The momentum around Big Data is forcing organizations to re-evaluate their investments in data management and there can be no doubt that many Data Warehouses haven’t delivered close to their anticipated ROI. On the other hand, Big Data technologies are still at the early stage of the adoption curve and most organizations are not “betting the bank” on them yet. Read more

Are You Agile Enough for Big Data?

What happens if your Big Data analysis project tells you that your strategy for approaching the market is wrong?  What if sentiment analysis of the tweet stream reveals that your latest product bundling is missing the mark?  Can you react? Can you adjust in time to take advantage of these insights?  In short, is your company agile enough to take advantage of what you might uncover? Read more

Data Efficiency and Agility Explained

We have written a lot about data agility and efficiency in the Kalido blog. I recently provided the results of our ETL-based Data Warehouses survey, and Allen Johnson wrote about the recent report “Measuring the Half Life of Data” by Nucleus Research. Read more

Survey Results on Big Data

Another survey we ran in 2012 was conducted at a Big Data event we sponsored in London – Big Data Analytics 2012. This was a full day event that featured presentations from vendors and customers on their Big Data projects, or aspirations, as the case may be. While it was a relatively small show – a few hundred people – we managed to poll a representative sample in our booth to ask about the status of their Big Data thinking and activity. Read more