Skip to main content

data.configmanager

ConfigManager Objects​

@dataclass
class ConfigManager(DataClassFromDictMixin)

from_yaml​

@classmethod
def from_yaml(cls, yaml_string: str)

Create a Model instance from a YAML string.

from_yaml_file​

@classmethod
def from_yaml_file(cls, file_path: str = "Files/Configuration/config.yaml")

Create a Model instance from a YAML file.

save_log​

def save_log(save_to_table: bool = True)

Save log to lakehouse file storage and optionally to a table.

Arguments:

  • save_to_table - Whether to also save logs to the logging table (default: True)

save_log_to_lakehouse​

def save_log_to_lakehouse(save_to_table: bool = True)

Legacy method name for backward compatibility.

Arguments:

  • save_to_table - Whether to also save logs to the logging table (default: True)

save_log_file_to_table​

def save_log_file_to_table(batch_id: str)

Read a log file and save its contents to the logging table in bulk. This is more efficient than writing each log entry individually.

Arguments:

  • batch_id - The batch ID to associate with all log entries