A Giter8 template for Scala with Spark and Maven. The main class contains a sample spark app. The code also contains a sample unit test. Obviously, this is not production-ready code.
- Get Giter8
- Run command
g8 kevinwallimann/scala-spark-maven-template.g8 - Fill in properties or keep defaults
cd <project name>mvn clean packagespark-sumbit target/scala-<scala version>/<project name>-assembly-<project version>.jar
- Run command
sbt new kevinwallimann/scala-spark-maven-template.g8 - Fill in properties or keep defaults
cd <project name>mvn clean packagespark-sumbit target/scala-<scala version>/<project name>-assembly-<project version>.jar
artifactId=spark-example
groupId=com.example
package=com.example
version=0.1.0-SNAPSHOT
sparkVersion=3.1.2
scalaVersion=2.12.10
scalaMajorVersion=2.12
Licensed under Creative Commons Zero v1.0 Universal