Spark SQL using Avro
Today, I’m flashing lights on how to use Avro, a data serialization system, data format on spark sql. Unlike hive spark does not provides direct support for the...
A Learner's Platform
Today, I’m flashing lights on how to use Avro, a data serialization system, data format on spark sql. Unlike hive spark does not provides direct support for the...
Hadoop / Scala / Spark / Spark Sql
by beginnershadoop · Published May 23, 2016 · Last modified October 7, 2016
In this blog I’m going to describe how to integrate hive with spark. You may find this code on spark’s official github page. My effort is to describe...
Scala / Spark / Spark Streaming
by beginnershadoop · Published April 19, 2016 · Last modified April 29, 2016
Network streaming in spark is another interesting topic, here I am going to explain how network streaming works and will provide complete spark scala code. Before jumping to the code, I...
More