Spark SQL Using Parquet
Today, I’m focusing on how to use parquet format in spark. Please get the more insight about parquet format If you are new to this format. Parquet: Apache Parquet is a...
Category: Spark
Spark SQL using Avro
Today, I’m flashing lights on how to use Avro, a data serialization system, data format on spark sql. Unlike hive spark does not provides direct support for the...
Spark SQL Using Hive
In this blog I’m going to describe how to integrate hive with spark. You may find this code on spark’s official github page. My effort is to describe...
Spark Streaming : Word Count Example
Spark Streaming makes it easy to build scalable fault-tolerant streaming applications. Spark Stream API is a near real time streaming it supports Java, Scala, Python and R....
Network Streaming in Spark
Network streaming in spark is another interesting topic, here I am going to explain how network streaming works and will provide complete spark scala code. Before jumping to the code, I...
