Category: Spark


Spark SQL using Avro

Today, I’m  flashing lights on  how to use  Avro, a data serialization system, data format on spark sql. Unlike hive spark does not provides direct support for the...

Spark SQL Using Hive 0

Spark SQL Using Hive

In this blog I’m going to describe how to integrate hive with spark. You may find this code on spark’s official github page. My effort is to describe...


Network Streaming in Spark

Network streaming in spark is another interesting topic, here I am going to explain how network streaming works  and will provide complete spark scala code. Before jumping to the code, I...