CSE @ IIITDMJ | Aspiring Data Engineer | SQL • Python • PySpark • Kafka • Airflow • Dbt • AWS S3 • Databricks
Pinned Loading
-
Crypto-Data-Lakehouse-Pipeline
Crypto-Data-Lakehouse-Pipeline PublicEnd-to-end crypto data lakehouse ingesting Bitcoin, Solana & Ethereum via batch (Airflow + PySpark + Databricks) and streaming (Kafka) pipelines using Medallion Architecture on AWS S3.
Python
-
adaptive-schema-fintech-lakehouse
adaptive-schema-fintech-lakehouse PublicResilient Medallion Lakehouse engineered to handle adaptive schema evolution and primitive type mutations (Int➔String) mid-stream without downtime. Uses PySpark Structured Streaming, Kafka, Docker …
Python
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.