Sina Sohangir

Big data has been one of hottest terms of the past few years. Yet, big data and big data analytics are used inseveral different contexts to refer to a wide range of solutions and technologies. In this article, I will go overthe history and the current trends of open source big data technologies and ecosystems starting from Hadoopand HDFS to recent development of Spark and BlinkDB. I will explain the advantages and disadvantages ofseveral key technologies and also how these different technologies fit together to provide an endtoendbigdata solution. I will go over solutions provided by a few companies that provide enterprise big data solutionsbased on open source platforms as well. Next I will talk about a couple of applications of data mining and dataanalytics that are enabled by these technologies and will introduce few solutions that use Hadoop and Spark toprovide big data machine learning and data mining tools.

Big data, MapReduce, Distributed Systems, HDFS, Hadoop, Spark, Machine Learning