Explanation of all Spark SQL, RDD, DataFrame and Dataset examples present on this project are available at https://sparkbyexamples.com/ , All these examples are coded in Scala language and tested in our development environment.

Table of Contents (Spark Examples in Scala)

Spark RDD Examples

• How to create an RDD
• How to create an empty RDD

Spark DataFrame Examples

• Creating Spark DataFrame example
• Creating empty DataFrame example
• Working with Spark DataFrame column
• Renaming Spark DataFrame column
• Spark SQL Schema with StructType & StructField
• Spark Case When and When Otherwise example
• DataFrame Transpose - Pivoting & Unpoting DataFrame
• DataFrame Array column
• DataFrame Map column

Spark SQL Functions Examples

• Spark SQL String Functions
• Spark SQL Array Functions
• Spark SQL map Functions
• Spark SQL Date & Time Functions
• Spark SQL Sort Functions

Spark Datasource Examples

• Spark Accessing Parquet file example
• Spark Accessing XML file example
• Spark Accessing Avro example
• Spark Accessing HBase using hbase-spark connector
• Spark Accessing HBase using hortonworks connector

Spark Dataset Examples