Spark Microbadge

Prerequisites

1. Have a basic understanding of the MapReduce programming model. https://en.wikipedia.org/wiki/MapReduce
2. Need to be familiar with one of the three programming languages: Java, Scala, or Python.
3. Need to be familiar with standard SQL syntax.
4. Java 8 installed.
   • Scala is setup through Maven, so don't worry about installing Scala.
5. Maven installed.

Useful Resources

• Java Docs
• Quick Start
• Spark Programming Guide
• Spark SQL, DataFrames and Datasets Guide
• Submitting Applications

To Earn the Microbadge

1. Fork this repository.
2. You may choose to complete this Microbadge with one of the following languages: Java, Scala, or Python
   • Modules have been created for Java and Scala: spark-java and spark-scala If you wish to use Python, create your own Python files in this repository and follow the instructions from spark-java or spark-scala.
3. Below is a list of classes/objects inside of spark-java and spark-scala. Visit each one in order and follow the instructions documented.
   1. BibleWordCount
   2. BibleWordCount2
   3. BibleWordCountFromCommandLine
   4. WordsUniqueToTwoBooks
   5. BibleWordCountNewTestamentOnly
   6. CreateBibleDataFrameFromRawText
4. Push your changes and send me an email to jensenbl@familysearch.org with a link to your forked repository.