Did Big Data Kill OLAP Cubes?

19 Sep

Did Big Data Kill OLAP Cubes? Not yet, but very possibly soon.

Think about the traditional usage and purpose of OLAP cubes in terms of their predominate deployment today. In most cases, enterprises are using cubes to aggregate data and pre-process data from multiple data source and/or a data warehouse to provide BI capabilities.

Many of these use cases are based upon data processing cycles that occur daily with large sets of data in bulk fashion. Well, that sounds quite a bit like Big Data requirements of processing large data sets in bulk fashion and then providing access to that post-processed data to analysts, scientists, etc.

So there is still clearly a correlation and applicability of OLAP cubes in the Big Data world.

OLAP cubes provide value in a number of ways, including abstracting report queries away from the database and providing fast access to knowledge through techniques that include pre-aggregated, pre-built analytics in the cube. This is where we start to breakdown in terms of the future of OLAP cubes in Big Data use cases.

In Big Data use cases, we need to provide much more ad-hoc, data exploration and knowledge self-discovery. This makes building the analytics in the cube based on requirements and assumptions very difficult. Even in the most “Agile” BI shops, this is a challenge.

This is where in-memory technologies, MPP and columnar databases become key enablers in the BI stack for Big Data. I’m writing a few new posts for SQL Server Pro mag and MSSQLDUDE that I’ll link to here to explain this in more technical terms over the next few days. Back here in Big Data Analytics, I’ll talk about generic MPP techniques.

For now, be prepared to hear the BI and database industry talk about maximizing in-memory cubes & databases for BI & reporting purposes, replacing OLAP cubes.

This does NOT preclude the need for semantic modeling and abstraction layers. And OLAP cubes still play a very important role in specific use cases that do not require large sets of ad-hoc query requirements.

However, Big Data architects do need to think about solving the traditional BI problems in a different way.

About these ads

3 Responses to “Did Big Data Kill OLAP Cubes?”

Trackbacks/Pingbacks

  1. SQL Server 2012: Multidimensional vs tabular | James Serra's Blog - September 20, 2012

    [...] Did Big Data Kill OLAP Cubes? Share:LinkedInTwitterFacebookEmailPrintMoreDiggRedditStumbleUponTumblrPinterest [...]

  2. What Makes Your Analytics “Big Data Analytics”? | Big Data Analytics - July 30, 2013

    […] or Kettle into a traditional RDBMS into a star schema? Based on feedback from my post called “Did Big Data Kill OLAP Cubes“, my guess would be that most of you do not think that is […]

  3. MDX OLAP on Cassandra | Big Data Analytics - September 26, 2013

    […] I guess this means that the answer to my question my last year is “No”. In all fairness to myself, I guess … I was really referring to MPP in-analtyics databases and Hadoop MR with Mahout where analytics are “in-engine” instead of forming logical in-memory OLAP models. There, that’s out of the way. The intention of those systems is to store large data sets AND allow analytics directly against those distributed data stores. […]

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Pentaho Business Analytics Blog

This blog provides views on the value of business analytics, and what companies are gaining with reporting, analysis, data integration, dashboards, and data mining.

Journey to SQL Authority with Pinal Dave

SQL, SQL Server, MySQL, Big Data and NoSQL

Paras Doshi - Blog

Notes of a Business Analytics Consultant

The SQL Herald

Databases et al...

Chris Webb's BI Blog

Analysis Services, MDX, PowerPivot, DAX and anything BI-related

Bill on BI

Info about Business Analytics and Pentaho

Big Data Analytics

Regular musings from a BI professional in the world of Big Data

Blog Home for MSSQLDUDE

The life of a data geek

Follow

Get every new post delivered to your Inbox.

Join 977 other followers

%d bloggers like this: