End-To-End Data Engineering Project. Made to learn some common data engineering practices.
-
Updated
Aug 22, 2025 - Python
End-To-End Data Engineering Project. Made to learn some common data engineering practices.
Automated text cleaning, translation, and TTS for WordPress posts with n8n and GCP
Build a data pipeline on Google Cloud using an event-driven architecture, leveraging GCS, Cloud Run functions, and BigQuery. Explore both VM and Composer options for Airflow management, and utilize Logging & Monitoring for pipeline health. Discover how SQL-based BigQuery ML can be used for initial ML implementation in specific scenarios.
Serverless loader: copy remote files directly into Google Cloud Storage by a fully automated workflow using Terraform and Cloud Run Functions.
PySpark-based ETL pipeline leveraging Dataproc, Cloud Storage, Cloud Run Functions and BigQuery, to automate Spotify "New Releases" data processing and visualization in Looker Studio.
Cloud Run functionsとActiveReports for .NETでつくる帳票生成API
Cloud Run Node.js service to monitor and alert on stale BigQuery tables via Slack notifications.
Develop and bundle your Cloud Run functions with ease
Los Mirlos Storytelling, a magical serverless backend built with Google Cloud Functions and powered by Gemini (Google's LLM)
A fully automated ETL pipeline that fetches and stores real-time traffic and weather data in BigQuery, with a live Looker dashboard for visualization.
Official LINE account for notifying garbage collection days
Serverless ETL pipeline on GCP using Cloud Run, Pub/Sub, BigQuery & Looker for real-time NYC Taxi ML insights.
Add a description, image, and links to the cloud-run-functions topic page so that developers can more easily learn about it.
To associate your repository with the cloud-run-functions topic, visit your repo's landing page and select "manage topics."