Name		Name	Last commit message	Last commit date
Latest commit History 94 Commits
Archival		Archival
Archival_to_Parquet		Archival_to_Parquet
BatchML		BatchML
Deployment		Deployment
Ingestion-Kafka-Consumer		Ingestion-Kafka-Consumer
Ingestion-Kafka-Producer		Ingestion-Kafka-Producer
Ingestion-StockQuotes-Producer		Ingestion-StockQuotes-Producer
Ingestion-StockTwits-Producer		Ingestion-StockTwits-Producer
SparkStreamingMovingAverage		SparkStreamingMovingAverage
Streaming-Spark		Streaming-Spark
TestScala		TestScala
batch_jobs		batch_jobs
.gitignore		.gitignore
IEX_Json.ipynb		IEX_Json.ipynb
Kafka.md		Kafka.md
README.md		README.md
SP_symbols.txt		SP_symbols.txt
StockTwits.ipynb		StockTwits.ipynb
stock_price_scraper.py		stock_price_scraper.py
stock_quote_kafka_producer.py		stock_quote_kafka_producer.py
stock_twits.py		stock_twits.py
stock_twits_symbols.txt		stock_twits_symbols.txt

Repository files navigation

EB5001 Big Data Engineering

name := "TestScala"

version := "0.1"

scalaVersion := "2.11.12"

libraryDependencies += "org.apache.spark" %% "spark-core" % "2.2.3"

Command to submit spark job : spark2-submit --class HelloScala --master local ./testscala_2.11-0.1.jar