A project with examples of using few commonly used data manipulation/processing/transformation APIs in Apache Spark 2.0.0
-
Updated
Aug 5, 2021 - Scala
#
spark-batch
Here are 8 public repositories matching this topic...
Design/Implement stream/batch architecture on NYC taxi data | #DE
-
Updated
Apr 29, 2021 - Scala
Java Application, uses Apache Spark, handles batch as well as streaming processing
-
Updated
Jan 22, 2021 - Java
Various data stream/batch process demo with Apache Scala Spark 🚀
docker dockerfile scala twitter spark apache-spark sbt pipeline stream-processing sbt-plugin spark-streaming sbt-assembly spark-sql spark-dataframes spark-batch spark-rdd
-
Updated
Feb 28, 2020 - Scala
Build an end to end data application with Yelp review dataset. (data collect -> DB config -> data ETL -> data dashboard (analysis/ML)
docker data-science machine-learning database spark etl kaggle yelp business-intelligence redash data-processing database-modeling spark-batch
-
Updated
Dec 17, 2019 - Python
The Road Monitoring System is a real-time software application that utilizes big data technologies to monitor and analyze vehicular data on Tunisian roads. It provides insights into vehicle locations, movements, and real-time analytics. The system offers an effective solution for monitoring cars conditions and detecting potential issues promptly.
-
Updated
Jun 11, 2023 - Java
Learning batch processing with Pyspark Interface for Apache Spark
-
Updated
Mar 8, 2023 - Jupyter Notebook
Batch Data Processing Pipeline using MinIO, Spark, PostgreSQL, Great Expectations, DBT and Dbeaver
-
Updated
Sep 1, 2024 - Python
Improve this page
Add a description, image, and links to the spark-batch topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the spark-batch topic, visit your repo's landing page and select "manage topics."