📄️ load_data_bronze

The loaddatabronze module is the entry point for extracting data from source systems and landing it in the Bronze layer. It handles multiple file formats (CSV, JSON, XML, etc.) and ensures that raw data is captured with minimal transformation while managing pre- and post-processing notebook hooks. The module includes intelligent file change detection to skip unnecessary loads and validation checks to ensure data quality.

📄️ load_data_silver

The loaddatasilver module manages the transition of data from the raw Bronze layer to the validated Silver layer. It is responsible for applying data quality checks, handling historical merging (SCD Type 1/2), and preparing the data for dimensional modeling in Gold.

📄️ load_data_gold

The loaddatagold module is the final stage of the data pipeline. It consumes Silver tables and applies the business logic defined in the Tabular Model to create high-performance semantic models and reporting views.

📄️ load_data_history

run

📄️ load_meta_data

The loadmetadata module provides the foundational logic for reading and parsing the YAML configuration files that drive the automated platform. It translates your project definitions into the technical objects used by the Bronze, Silver, and Gold loaders.