Connection config

The Columns section lists the columns that belong to the table in the model. Each entry specifies the source column name and its data type, which is crucial for defining how data is stored and manipulated within the model.

Connection

Name	Description
ConnectionName	Unique name for the connection. This name is also used in the objects that refer to this. The folder and filename of the yamlA simple way to write configurations. It's basically a list that computers can read easily. should be equalto this name
ConnectionPrefix	Prefix that will be used for every object that is generated for this connection (unless otherwise set in the main configuration file)
ConnectionType**	Type of connection. See list of types. For example azblob for Azure Blobstorage
BronzeFolder	The folder that will be used to save the source files. Those will be save in the bronze lakehouseA place where you store both "raw" data (like files) and "organized" data (like tables). It combines the best of a File Cabinet and a Database. in the Files section.
FileType	Type of file for this connection. Parquet, CSV, JSON, XML and more
FileExtension	Extension of the file

** = can be set at the object as well

General loading settings

These optional settings tune how files are loaded. All are optional; defaults are shown.

Name	Description
BronzeMaxFileAgeHours	Maximum age in hours of a source file. If a source file is older than this, the bronze load reports it per BronzeLoadViolationAction (stop raises FabricStaleFileError, continue warns) — guarding against loading stale data. The check fires even when the source is unchanged, so a supplier that stopped delivering is surfaced rather than silently skipped. Default = 2. Was MaxFileAgeHours: the old key still works and carries its value over, logging once per run where it moved to.
NotebookTimeout	Default timeout in seconds for pre/post notebooks run via this connection. Default = 1800.
BronzeSkipIfSourceUnchanged	Skip the load when the source files are unchanged since the last run. See Skip-if-Unchanged. Was SkipIfSourceUnchanged: the old key still works and carries its value over, logging once per run where it moved to.
BronzeMaxUnchangedHours	Longest stretch the source may stay unchanged before one full load runs anyway. Bounds the blind spot of a size-based comparison, which cannot tell apart two deliveries of equal byte length — a supplier delivering fresh files of identical length is otherwise skipped forever while the freshness check stays quiet, because the files are not old. The expiry is reported at BronzeUnchangedSeverity. Default = unset, leaving skipping unbounded. Replaces MaxSkipHours, which is no longer read.
BronzeMaxFileAgeCriticalHours	Age past which a stale source file is reported as critical instead of its base severity, so a warning that keeps coming back for days stops looking like one that started this morning. Escalation moves the severity, never the action. Must be above BronzeMaxFileAgeHours. Default = unset, never escalating.
BronzeLoadSeverity	How loudly a stale source file is reported: none, info, warning, critical. Separate from BronzeLoadViolationAction, which decides whether the load goes on — so an urgent source can warn loudly and still let the load through. Default = warning.
BronzeChecksumMismatchSeverity	How loudly a Validation 2 checksum/row-count mismatch is reported, on the same four rungs. Use info for a source whose row order drifts daily, rather than silencing it. Default = warning.
BronzeUnchangedSeverity	How loudly an expired BronzeMaxUnchangedHours window is reported, on the same four rungs. Default = warning.
IgnoreNullKey	Ignore source records whose primary key is null. Default = true.

Filetype specific settings

** CSV **

Name	Description
Delimiter	The delimiter used in the CSV. For example: , or ; and so on
Multiline	Set to True if the source file uses multiline
Escape	The escape character that is used
Header	Is the header provided
Dateformat	The dateformat that is used in the source file. For example yyyy-MM-dd. This dateformat will be used to convert to the datetime in resulting delta table in bronze
SilverDateConversionViolationAction	Silver counts, per typed column, how many filled source values the date pattern turns into NULL. A column that flips over completely almost always means the pattern does not match the source: continue warns with the column, the pattern used and an example value, stop raises, silent skips the measurement altogether. An object can override it. (Default = continue)

** JSON **

Name	Description
JsonPath	The root path where the records are nested, e.g. $.rows for {"rows": [ ... ]}. Omit it when the file is itself a JSON array (starts with [) — the records are already at the top level and are loaded directly.

** XML **

Name	Description
No extra options	XML is processed by element names

** Parquet **

Name	Description
No extra options	Parquet is read and matched on columnnames

Connectiontype specific settings

azblob

Name	Description
KeyvaultSecretConnectionstring	In case of azblob, the connectionstring is retrieved from the keyvault.
Container	Container on azure blob to connect to
SourceFolder	Folder in the container to look for files

fabricfiles

Set to Fabricfiles when files are delivered to fabric directly by a third-party or custom program. In this case the loader will just look into the defined fabric folder in the Files section and process the file accordingly.

Name	Description
BronzeFolder	Place where the files that should be loaded are dropped by the other party

The folder is defined in the object config itself. It will look in the defined bronzefolder for the SourceTable or SourceFilter.

Basic: Example of connection with a csv on azure blob storage

    ConnectionName: exa-azblob
    ConnectionPrefix: exa
    ConnectionType: azblob
    BronzeFolder: Example
    KeyvaultSecretConnectionstring: kvexample
    Container: Example001
    Sourcefolder: ExaFolder
    FileType: csv 
    FileExtension: csv
    Delimiter: ","
    Multiline: True
    Escape: '"'
    Header: true

This example defines a connection to a azure blobstorage, for the authentication to the blob storage, the connectionstring from the keyvault will be used. The settings for the csv are also set here. Those settings will be used when an object is loaded into the bronze layer of fabric.

Basic: Example of connection with a parquet file that is already on Fabric

    ConnectionName: exa-fabricfiles
    ConnectionPrefix: fbf
    ConnectionType: fabricfiles
    BronzeFolder: Example
    FileType: parquet 
    FileExtension: parquet

This example defines a connection to the Fabric Bronze layer. In this case it will look for files in the Files section in the folder Example.