Rittman Mead Blog

Game of Thrones Series 8: Real Time Sentiment Scoring with Apache Kafka, KSQL, Google's Natural Language API and Python

Hi, Game of Thrones aficionados, welcome to GoT Series 8 and my tweet analysis! If you missed any of the prior season episodes, here are I [https://www.rittmanmead.com/blog/2017/08/how-was-game-of-thrones-s07-e05-tweet-analysis-with-kafka-bigquery-and-tableau/] , II [https://www.rittmanmead.com/blog/2017/08/the-week-after-game-of-thrones-s07-e06-analysis/] and III [https://www.rittmanmead.com/blog/

kafka

Announcing The Kafka Pilot with Rittman Mead

Rittman Mead is today pleased to announce the launch of it's Kafka Pilot service, focusing on engaging with companies to help fully assess the capabilities of Apache Kafka for event streaming use cases with both a technical and business focus. Our 30 day Kafka Pilot includes: * A comprehensive assessment of

Scala

Spark Streaming and Kafka, Part 3 - Analysing Data in Scala and Spark

In my first two blog posts of the Spark Streaming and Kafka series - Part 1 - Creating a New Kafka Connector [https://www.rittmanmead.com/blog/2019/02/kafka/] and Part 2 - Configuring a Kafka Connector [https://www.rittmanmead.com/blog/2019/02/spark-streaming-and-kafka/] - I showed how

kafka

Spark Streaming and Kafka, Part 2 - Configuring a Kafka Connector

In my previous blog post [https://www.rittmanmead.com/blog/2019/02/kafka/], I covered the development of a custom Kafka Source Connector, written in Scala. This blog post is about deploying that Connector. We are getting closer to analysing the stream data in Spark - as promised in the

Kafka, Spark, Scala, Source Connector

Spark Streaming and Kafka, Part 1 - Creating a New Kafka Connector

More Kafka and Spark, please! Hello, world! Having joined Rittman Mead more than 6 years ago, the time has come for my first blog post. Let me start by standing on the shoulders of blogging giants, revisiting Robin's [https://www.rittmanmead.com/blog/author/robin-moffatt/] old blog post Getting Started

kscope18

Kscope18: It's a Wrap!

As announced few weeks back I represented Rittman Mead at ODTUG's Kscope18 [https://www.rittmanmead.com/blog/2018/05/rittman-mead-at-kscope-2018/] hosted in the magnificent Walt Disney World Dolphin Resort [https://www.swandolphin.com/]. It's always hard to be credible when telling people you are going to Disneyworld for work but

kafka

Real-time Sailing Yacht Performance - Kafka (Part 2)

In the last two blogs Getting Started (Part 1) [https://www.rittmanmead.com/blog/2018/01/real-time-yacht-performance/] and Stepping back a bit (Part 1.1) [https://www.rittmanmead.com/blog/2018/06/real-time-sailing-yacht-performance-stepping-back-a-bit-part-1-1/] I looked at what data I could source from the boat's instrumentation and introduced some new hardware

kafka

Real-time Sailing Yacht Performance - stepping back a bit (Part 1.1)

Slight change to the planned article. At the end of my analysis in Part 1 [https://www.rittmanmead.com/blog/2018/01/real-time-yacht-performance/] I discovered I was missing a number of key messages. It turns out that not all the SeaTalk messages from the integrated instruments were being translated to

obiee

Rittman Mead at OUG Norway 2018

This week I am very pleased to represent Rittman Mead by presenting at the Oracle User Group Norway [http://ougn.no] Spring Seminar 2018 delivering two sessions about Oracle Analytics, Kafka, Apache Drill and Data Visualization both on-premises and cloud. The OUGN conference it's unique due to both the really

kafka

Real-time Sailing Yacht Performance - Getting Started (Part 1)

In this series of articles, I intend to look at collecting and analysing our yacht’s data. I aim to show how a number of technologies can be used to achieve this and the thought processes around the build and exploration of the data. Ultimately, I want to improve our

kafka

Taking KSQL for a Spin Using Real-time Device Data

Taking KSQL for a Spin Using Real-time Device Data Evaluating KSQL [https://github.com/confluentinc/ksql/] has been high on my to-do list ever since it was released back in August. I wanted to experiment with it using an interesting, high velocity, real-time data stream that would allow me to

apache

KSQL: Streaming SQL for Apache Kafka

Few weeks back, while I was enjoying my holidays in the south of Italy, I started receiving notifications about an imminent announcement by Confluent [https://www.confluent.io]. Reading the highlights almost (...I said almost) made me willing to go immediately back to work and check all the details about

kafka

Game of Thrones S07 Last Episode: The Summary

Watch the Episode First! It's a friendly suggestion... The final #GoT episode was transmitted last Sunday, now two years waiting for the next season... How can HBO be so cruel??? And how can I find interesting content for my future blog posts??? At least now European football (not soccer) leagues

got

The Week After: Game of Thrones S07 E06 Tweets and Press Reviews Analysis

Another week is gone, another "Game of Thrones" episode watched, only one left until the end of the 7th series. The "incident" [http://www.independent.co.uk/arts-entertainment/tv/news/game-of-thrones-season-7-episode-6-leaks-online-full-hbo-spain-torrents-download-reddit-watch-jon-a7895636.html] in Spain, with the episode released for few hours on Wednesday screwed all my plans to do a

Tableau

How was Game Of Thrones S07 E05? Tweet Analysis with Kafka, BigQuery and Tableau

I don't trust statistics and personally believe that at least 74% of them are wrong.... but I bet nearly 100% of people with any interest in fantasy (or just any) TV shows are watching the 7th series of Game of Thrones [http://www.hbo.com/game-of-thrones] (GoT) by HBO. If

analytics

Analyzing Wimbledon Twitter Feeds in Real Time with Kafka, Presto and Oracle DVD v3

Last week there was Wimbledon, if you are a fan of Federer, Nadal or Djokovic then it was one of the events not to be missed. I deliberately excluded Andy Murray from the list above since he kicked out my favourite player: Dustin Brown. Two weeks ago I was at

Spark Streaming

Data Processing and Enrichment in Spark Streaming with Python and Kafka

In my previous blog post [https://www.rittmanmead.com/blog/2017/01/getting-started-with-spark-streaming-with-python-and-kafka/] I introduced Spark Streaming and how it can be used to process 'unbounded' datasets. The example I did was a very basic one - simple counts of inbound tweets and grouping by user. All very good for

odi

ETL Offload with Spark and Amazon EMR - Part 5 - Summary

This is the final article in a series documenting an exercise that we undertook for a client recently. Currently running an Oracle-based datawarehouse platform, the client asked for our help in understanding what a future ETL and reporting platform could look like, given the current landscape of tools available. You

elasticsearch

Streaming data from Oracle using Oracle GoldenGate and Kafka Connect

This article was also posted on the Confluent blog [http://www.confluent.io/blog/streaming-data-oracle-using-oracle-goldengate-kafka-connect/] , head over there for more great Kafka-related content! -------------------------------------------------------------------------------- Kafka Connect [http://docs.confluent.io/3.0.0/connect/index.html] is part of the Confluent Platform [http://www.confluent.io/product], providing a set

Rittman Mead Life

Rittman Mead at Oracle OpenWorld 2016

The big show is upon us and once again Rittman Mead will be actively participating at [Oracle OpenWorld 2016]( https://www.oracle.com/openworld/index.html" target="_blank). Oracle's premier conference runs September 18–22 at the Moscone Center in beautiful San Francisco, California. I'm looking forward to another great

Oracle GoldenGate

Using logdump to Troubleshoot the Oracle GoldenGate for Big Data Kafka Handler

Oracle GoldenGate [http://www.oracle.com/technetwork/middleware/goldengate/overview/index.html] for Big Data (OGG BD) supports sending transactions as messages to Kafka topics, both through the native Oracle handler [http://docs.oracle.com/goldengate/bd1221/gg-bd/GADBD/GUID-2561CA12-9BAC-454B-A2E3-2D36C5C60EE5.htm#GADBD449] as well as a connector into Confluent's Kafka

Technical

Stream Analytics and Processing with Kafka and Oracle Stream Analytics

In my previous post [http://www.rittmanmead.com/2016/07/introduction-oracle-stream-analytics/] I looked the latest release of Oracle Stream Analytics (OSA), and saw how it provided a graphical interface to "Fast Data". Users can analyse streaming data as it arrives based on conditions and rules. They can also transform the

Technical

An Introduction to Oracle Stream Analytics

Oracle Stream Analytics (OSA) is a graphical tool that provides “Business Insight into Fast Data”. In layman terms, that translates into an intuitive web-based interface for exploring, analysing, and manipulating streaming data sources in realtime. These sources can include REST, JMS queues, as well as Kafka. The inclusion of Kafka

Technical

Rittman Mead at KScope16

June is the perfect month: summer begins, major football [http://www.uefa.com/uefaeuro/] (andfutbol [http://www.ca2016.com/]) tournaments are in full swing, and of course, KScope16 [http://kscope16.com/] is on! Rittman Mead have participated in many of the past KScope conferences and will continue that tradition this

Big Data

Forays into Kafka - Enabling Flexible Data Pipelines

One of the defining features of “Big Data” from a technologist’s point of view is the sheer number of tools and permutations at one’s disposal. Do you go Flume or Logstash? Avro or Thrift? Pig or Spark? Foo or Bar? (I made that last one up). This wealth