ETL Offload with Spark and Amazon EMR - Part 3 - Running pySpark on EMR
In the previous articles (here, and here) I gave the background to a project we did for a client, exploring the benefits of Spark-based ETL processing »
ETL Offload with Spark and Amazon EMR - Part 2 - Code development with Notebooks and Docker
In the previous article I gave the background to a project we did for a client, exploring the benefits of Spark-based ETL processing running on Amazon's »
Forays into Kafka - Enabling Flexible Data Pipelines
One of the defining features of “Big Data” from a technologist’s point of view is the sheer number of tools and permutations at one’s »