Skip to main content

loaders.notebook

These functions run the hook and loader notebooks configured on a table (prebronzenotebook, midbronzenotebook, postbronzenotebook, presilvernotebook, midsilvernotebook, postsilvernotebook, bronzenotebook, silvernotebook). Global settings such as the KeyVault reference are resolved internally from the initialized configuration — no config_manager parameter is needed.

load_notebook_prebronze​

def load_notebook_prebronze(table_config: TableConfig)

Runs the pre-bronze notebook configured on the table before the bronze layer is loaded. Notebook parameters (source table, source filter, bronze folder, KeyVault reference, and logging context, plus any parameters defined on the notebook configuration) are built from the table configuration and the active global configuration, and the notebook runs with the configured timeout.

Arguments:

  • table_config TableConfig - Configuration object containing the pre-bronze notebook settings (prebronzenotebook), timeout, and the table properties passed to the notebook as parameters.

Raises:

  • Exception - If no pre-bronze notebook is configured, or if the notebook execution exits with an error value.

load_notebook_midbronze​

def load_notebook_midbronze(table_config: TableConfig)

Runs the mid-bronze notebook configured on the table, between the bronze data load and its follow-up processing. Parameter handling, timeout resolution, and error handling are identical to load_notebook_prebronze, using the midbronzenotebook configuration.

Arguments:

  • table_config TableConfig - Configuration object containing the mid-bronze notebook settings (midbronzenotebook), timeout, and the table properties passed to the notebook as parameters.

Raises:

  • Exception - If no mid-bronze notebook is configured, or if the notebook execution exits with an error value.

load_notebook_postbronze​

def load_notebook_postbronze(table_config: TableConfig)

Runs the post-bronze notebook configured on the table after the bronze data layer has been loaded. Parameter handling, timeout resolution, and error handling are identical to load_notebook_prebronze, using the postbronzenotebook configuration.

Arguments:

  • table_config TableConfig - Configuration object containing the post-bronze notebook settings (postbronzenotebook), timeout, and the table properties passed to the notebook as parameters.

Raises:

  • Exception - If no post-bronze notebook is configured, or if the notebook execution exits with an error value.

load_notebook_presilver​

def load_notebook_presilver(table_config: TableConfig)

Runs the pre-silver notebook configured on the table before data is loaded into the silver layer. Parameter handling, timeout resolution, and error handling are identical to load_notebook_prebronze, using the presilvernotebook configuration.

Arguments:

  • table_config TableConfig - Configuration object containing the pre-silver notebook settings (presilvernotebook), timeout, and the table properties passed to the notebook as parameters.

Raises:

  • Exception - If no pre-silver notebook is configured, or if the notebook execution exits with an error value.

load_notebook_midsilver​

def load_notebook_midsilver(table_config: TableConfig)

Runs the mid-silver notebook configured on the table, between the silver data load and its follow-up processing. Parameter handling, timeout resolution, and error handling are identical to load_notebook_prebronze, using the midsilvernotebook configuration.

Arguments:

  • table_config TableConfig - Configuration object containing the mid-silver notebook settings (midsilvernotebook), timeout, and the table properties passed to the notebook as parameters.

Raises:

  • Exception - If no mid-silver notebook is configured, or if the notebook execution exits with an error value.

load_notebook_postsilver​

def load_notebook_postsilver(table_config: TableConfig)

Runs the post-silver notebook configured on the table after the silver layer data processing step. Parameter handling, timeout resolution, and error handling are identical to load_notebook_prebronze, using the postsilvernotebook configuration.

Arguments:

  • table_config TableConfig - Configuration object containing the post-silver notebook settings (postsilvernotebook), timeout, and the table properties passed to the notebook as parameters.

Raises:

  • Exception - If no post-silver notebook is configured, or if the notebook execution exits with an error value.

load_notebook_bronze​

def load_notebook_bronze(object_info: ObjectInfo, table_config: TableConfig)

Runs the bronze-layer loader notebook configured on the table (bronzenotebook), which replaces the standard file-based bronze load for filetype: notebook tables. The notebook receives the source file path from object_info together with the KeyVault reference and logging context, and runs with the configured timeout.

Arguments:

  • object_info ObjectInfo - Contains metadata related to the object being processed, including its file path.
  • table_config TableConfig - Holds the configuration details and parameters for table processing, including the notebook specific to the processing layer and timeout values.

Raises:

  • Exception - If no bronze notebook is configured on the table, or if the configured notebook has no notebook path set.

load_notebook_silver​

def load_notebook_silver(table_config: TableConfig)

Runs the silver-layer loader notebook configured on the table (silvernotebook). The notebook receives the KeyVault reference and logging context as parameters and runs with the configured timeout.

Arguments:

  • table_config TableConfig - An object containing the configuration for the table, including the notebook name and timeout settings for the silver processing layer.

Raises:

  • Exception - If no silver notebook is configured on the table, or if the configured notebook has no notebook path set.