Data Transformation with PySpark

Building an ETL Pipeline with databricks Pyspark and AWS S3

Explore further

Following are the published notebooks that are developed in the databricks PySpark environment.

1. M&M Counts
2. San Francisco Fire Calls
3. SQL on US Flights Dataset
4. Spark Data Sources
5. Spark SQL & UDFs
6. File Formats
7. Delta Lake
8. Taxi Trip Analysis
9. Movielens Data Analysis
10. MapReduce Practice
11. Data Wrangling with Spark
12. Data Lake Schema on Read
13. Data Lake on S3
14. Python vs PySpark