Analytics with Kibana and Elasticsearch through Hadoop – part 3 – Visualising the data in Kibana

Tuesday, November 4th, 2014 by

In this post we will see how Kibana can be used to create visualisations over various sets of data that we have combined together. Kibana is a graphical front end for data held in ElasticSearch, which also provides the analytic capabilities. Previously we looked at where the data came from and exposing it through Hive, […]

Analytics with Kibana and Elasticsearch through Hadoop – part 2 – Getting data into Elasticsearch

Tuesday, November 4th, 2014 by

Introduction In the first part of this series I described how I made several sets of data relating to the Rittman Mead blog from various sources available through Hive. This included blog hits from the Apache webserver log, tweets, and metadata from WordPress. Having got it into Hive I now need to get it into […]

Analytics with Kibana and Elasticsearch through Hadoop – part 1 – Introduction

Monday, November 3rd, 2014 by

Introduction I’ve recently started learning more about the tools and technologies that fall under the loose umbrella term of Big Data, following a lot of the blogs that Mark Rittman has written, including getting Apache log data into Hadoop, and bringing Twitter data into Hadoop via Mongodb. What I wanted to do was visualise the […]

Using rlwrap with Apache Hive beeline for improved readline functionality

Friday, October 17th, 2014 by

rlwrap is a nice little wrapper in which you can invoke commandline utilities and get them to behave with full readline functionality just like you’d get at the bash prompt. For example, up/down arrow keys to move between commands, but also home/end to go to the start/finish of a line, and even ctrl-R to search […]

Adding Oracle Big Data SQL to ODI12c to Enhance Hive Data Transformations

Sunday, October 5th, 2014 by

An updated version of the Oracle BigDataLite VM came out a couple of weeks ago, and as well as updating the core Cloudera CDH software to the latest release it also included Oracle Big Data SQL, the SQL access layer over Hadoop that I covered on the blog a few months ago (here and here). […]

Website Design & Build: tymedia.co.uk