Tagged: Scala

Missing Imputation in scala 0

Missing Imputation in scala

Missing imputation algorithm Read the data Get all columns name and the type of columns Replace all missing value(NA, N.A., N.A//,” ”) by null Set Boolean value for...

Spark SQL Using Parquet 0

Spark SQL Using Parquet

Today, I’m focusing on how to use parquet format in spark.  Please get the more insight about parquet format If you are new to this format. Parquet: Apache Parquet is a...


Network Streaming in Spark

Network streaming in spark is another interesting topic, here I am going to explain how network streaming works  and will provide complete spark scala code. Before jumping to the code, I...