Skip to content
#

data-engineering-project

Here are 64 public repositories matching this topic...

Build a data warehouse in SQL Server from two source systems, a CRM and an ERP, through bronze, silver and gold. The files and scripts of the free full project.

  • Updated Nov 6, 2026
  • TSQL

A data lakehouse on Databricks with the medallion architecture: PySpark, Spark SQL, Delta Lake and Unity Catalog. The project of the free Databricks bootcamp.

  • Updated Nov 6, 2026
  • Jupyter Notebook

Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.

  • Updated Dec 29, 2024
  • Python

Build a data pipeline on Google Cloud using an event-driven architecture, leveraging GCS, Cloud Run functions, and BigQuery. Explore both VM and Composer options for Airflow management, and utilize Logging & Monitoring for pipeline health. Discover how SQL-based BigQuery ML can be used for initial ML implementation in specific scenarios.

  • Updated Aug 25, 2024
  • Python

MCP agent for semantic metrics governance with built-in trust scoring, lineage visualization, and conversational metric definition. Designed for data teams working with dbt, LookML, and modern semantic layers.

  • Updated Oct 28, 2026
  • Python

Add this topic to your repo

To associate your repository with the data-engineering-project topic, visit your repo's landing page and select "manage topics."

Learn more