More on Interval Partitioning

Saturday, August 7th, 2010 by Peter Scott

As I mentioned in the past, I am a great fan of Oracle bitmap indexes; they allow the database to do some really good optimizations and reduce the impact of typical data warehouse queries that need to filter and fetch large chunks of fact data. The flip side to their success in queries is that [...]

Realtime Data Warehouse Challenges – Part 2

Sunday, June 27th, 2010 by Peter Scott

Last time I mentioned some of the challenges of taking realtime feeds and publishing them into a data warehouse. This time I am going propose a way to meet those challenges.
But before that I will take a small detour around what Oracle refers to as their Reference Data Warehouse and Business Intelligence Architecture. Here we [...]

Realtime Data Warehouse Challenges – Part 1

Thursday, May 27th, 2010 by Peter Scott

In a previous part of my notes on Realtime Data Warehousing I mentioned some of the challenges of reducing latency. The piece picked up quite a few comments – to which I say thanks to all that posted responses. One of the comments from Matt Hosking mentioned some of the points I was to raise [...]

Realtime Data Warehouse Loading

Thursday, May 6th, 2010 by Peter Scott

Last time I wrote about the use of replication to provide a source for realtime BI. This time I am going to look at putting data in to a data warehouse in “realtime”. Note the quotes, when we speak of realtime there is always some degree of latency: the time from the source transaction to [...]

Realtime BI Is Not Realtime DW

Saturday, April 24th, 2010 by Peter Scott

This posting is slightly edited to clarify that the majority of  the post is about using transactional or transactionally structured sources for reporting.
One of the points I make early on in my talk “Getting Real Data Warehouse Loading as it Happens” is that realtime business intelligence is not the same as realtime data warehousing; having [...]

Website Design & Build: tymedia.co.uk