MLP 1. [Batch] Data Engineering End-to-End Project - PostgreSQL, Airflow, Pandas

[nnthanh101]

MLP 1. [Batch] Data Engineering End-to-End Project - PostgreSQL, Airflow, Pandas

1. Tech Stack

• Apache Airflow
• SQL & PostgreSQL
• Python & Pandas

2. 🚀 Deliverables:

• Reproducible Local Development with Dev Containers
• Architecture Diagram
• [Batch] Data Engineering End-to-End Project - PostgreSQL, Airflow, Pandas

References:

• https://medium.com/@dogukannulu/data-engineering-end-to-end-project-postgresql-airflow-docker-pandas-91c6aa529030
• https://github.com/dogukannulu/csv_extract_airflow_docker