End-To-End Data Engineering Project. Made to learn some common data engineering practices.
-
Updated
May 26, 2025 - Python
End-To-End Data Engineering Project. Made to learn some common data engineering practices.
Cloud Run Node.js service to monitor and alert on stale BigQuery tables via Slack notifications.
Cloud Run functionsとActiveReports for .NETでつくる帳票生成API
A fully automated ETL pipeline that fetches and stores real-time traffic and weather data in BigQuery, with a live Looker dashboard for visualization.
PySpark-based ETL pipeline leveraging Dataproc, Cloud Storage, Cloud Run Functions and BigQuery, to automate Spotify "New Releases" data processing and visualization in Looker Studio.
Develop and bundle your Cloud Run functions with ease
Build a data pipeline on Google Cloud using an event-driven architecture, leveraging GCS, Cloud Run functions, and BigQuery. Explore both VM and Composer options for Airflow management, and utilize Logging & Monitoring for pipeline health. Discover how SQL-based BigQuery ML can be used for initial ML implementation in specific scenarios.
Add a description, image, and links to the cloud-run-functions topic page so that developers can more easily learn about it.
To associate your repository with the cloud-run-functions topic, visit your repo's landing page and select "manage topics."