Category Archive: Big Data BI

Applying business intelligence to structured and unstructured data sets typically too large to store or process on a single machine

Finding balance between data science and data engineering

Previously, I wrote about the two-tiered data lakehouse with an analytical sandbox and a curated data warehouse in the second layer – the one for productised BI and the other for data science work. I was therefore intrigued when coming across a Forbes article titled ‘Three Keys to a Harmonious Relationship between Data Science and …

Continue reading »

Finding value in the data lakehouse

As you may have gathered from my previous post, I have become very interested in cloud-based data lakehouses. It was therefore with a keen interest that I read the article ‘Five Effective Ways to Build a Robust Data Lake Architecture’ on Enterprise Talk. While initially I was hoping that the author was going to review …

Continue reading »

Big Data – Round 2

If you had told me a decade ago that big data was going to get bigger, I may not have believed you – given that most IT terms are often surrounded by so much hype, and given that growing data types and volumes is, in fact, nothing new. Many people thought this ‘fad’ would not …

Continue reading »

The Elastic Data Warehouse

Some days I get really flexed out of shape about the rate at which new terms become spontaneously combusted in the BI and analytics industry. The latest I came across is the term “elastic data warehouse.” So what are we doing here – bending the rules, stretching the imagination or flexing our muscles here? Now …

Continue reading »

Technologies to improve Customer Centricity

With all the talk and hype around technology and the benefits it provides, which supposedly must be capitalised on for organisations to remain competitive, organisations have to focus even more on the customer to stay competitive. How many organisations really utilise their tech to be more customer centric?

Continue reading »

Big Data Science Trends in 2015

It is that time of the year for all and sundry to come up with‘Trends for 2015’, so here is my commentary on two of the technology trends that have received a lot of attention and have made a big impact in the previous year. I am sure you will agree that the “technology” which …

Continue reading »

Revolt against the Data Lake as Staging Area

In previous posts I covered the data lake, approaches to “building” the lake and the data lake’s relationship with the traditional data warehouse. However as rosy as all that may seem, there are some people quite opposed to using the data lake as an all-encompassing free-for-all at-scale staging area. To an extent, I tend to …

Continue reading »

Building a Data Lake

The engineering analogy to building a data lake carries quite well. Putting a data lake in place is about as complex as building a man-made lake – there are so many aspects to consider. In this post I comment on some of the wisdom that have been published about building and populating data lakes. At …

Continue reading »

Data Lake vs Data Warehouse

In a previous post I gave a high level description and overview of the data lake. Informally speaking, from a BI point of view, a data lake is a large scaled-out all-encompassing free-for-all unstructured data staging area. In this post I take the discussion further to investigate whether it replaces or interacts with the data …

Continue reading »

Data Lake

My mini-series on big data would be incomplete without a discussion on data lakes. The data lake is emerging as a popular concept to address big data challenges, especially in the context of big data analytics and the integration of big data into the BI ecosystem. Vendors tote the data lake as the new approach to …

Continue reading »

Older posts «

hope howell has twice the fun. Learn More Here anybunny videos