ETL Offload with Spark and Amazon EMR - Part 5 - Summary
This is the final article in a series documenting an exercise that we undertook for a client recently. Currently running an Oracle-based datawarehouse platform, the client »
ETL Offload with Spark and Amazon EMR - Part 3 - Running pySpark on EMR
In the previous articles (here, and here) I gave the background to a project we did for a client, exploring the benefits of Spark-based ETL processing »
ETL Offload with Spark and Amazon EMR - Part 2 - Code development with Notebooks and Docker
In the previous article I gave the background to a project we did for a client, exploring the benefits of Spark-based ETL processing running on Amazon's »
ETL Offload with Spark and Amazon EMR - Part 1 - Introduction
We recently undertook a two-week Proof of Concept exercise for a client, evaluating whether their existing ETL processing could be done faster and more cheaply using »
Forays into Kafka - Enabling Flexible Data Pipelines
One of the defining features of “Big Data” from a technologist’s point of view is the sheer number of tools and permutations at one’s »
OBIEE SampleApp v406 Amazon EC2 AMI - available for public use
I wrote a while ago about converting Oracle's superb OBIEE SampleApp from a VirtualBox image into an EC2-hosted instance. I'm pleased to announce that Oracle have »
OBIEE SampleApp in The Cloud: Importing VirtualBox Machines to AWS EC2
Virtualisation has revolutionised how we work as developers. A decade ago, using new software would mean trying to find room on a real tin server to »