Configuration config
The general configuration that is used to generate the objects with the requested settings.
Fabric Configuration
The configuration needed to build the model
| Name | Type | Description |
|---|---|---|
| Environment | String | Environment (PRD, TST, ACC, DEV) used in Azure Devops pipelineAn automated "conveyor belt" that moves data from one place to another or performs a task automatically. |
| EnvironmentDescription | String | Longer name for the environment like Production |
| ServiceConnection | String | Name of the service connection in Azure DevOps |
| VsSolutionName | String | Filename of the Visual Studio solution |
| Apiconfigfile | String | Filepath to the api configuration file |
| MetaFolder | String | Path on the Meta lakehouseA place where you store both "raw" data (like files) and "organized" data (like tables). It combines the best of a File Cabinet and a Database. in fabric for the meta data files |
| TenantId | String | The tenant id where this is deployed |
| ApplicationClientId | String | The application id that is used to deploy things that require a service principal for authentication. |
| ApplicationKeyvaultSecret | String | The secret name in the keyvault for the service principal |
| ColumnNamesToLower | bool | All columns generated will be lowercase (except for the system columns, those are in UPPER case |
| ColumnNamesAutoFix | bool | If a column has special characters not suitable for delta table those will be replaced |
| RemoveNewLineFromScripts | bool | |
| BronzeConnectionPrefix | bool | Bronze objects will have a connection prefix |
| DataplatformFolder | String | The root dataplatform folder |
| TempFolder | String | The temp folder for local temp in the project. |
| DatabaseFolder | String | Folder where the object yamlA simple way to write configurations. It's basically a list that computers can read easily. files are located |
| DatabaseOutputFolder | String | Folder where the generated table definitions and view definitions will be saved |
| NotebooksFolder | String | Folder where the notebook folders are located |
| NotebooksOutputFolder | String | Folder where the generated notebooks will be saved |
| RequestFolder | String | Folder where the requests will be saved. Useful for debugging purposes |
| FabricProjectName | String | The project where the generated objects will be saved into |
| DimObjectPrefix | String | A prefix for a dimension table in Gold |
| FactObjectPrefix | String | A prefix for a fact view in Gold |
| DimSurrogatekeyPrefix | String | A prefix for a surrogate key column in Gold |
| TransformationObjectPrefix | String | A prefix for a transformation table in Gold |
| Workspace | String | Workspace for this environment in Fabric |
| Keyvault | String | Keyvault for this environment |
| SchemaHistory | String | History schema used for history tables (default='his') |
| FunctionAppName | String | The name of the Azure Function used for the triggers |
| ResourceGroupName | String | The Azure resource group holding the environment's resources (e.g. the function app) |
Fabric Lakehouse
| Name | Type | Description |
|---|---|---|
| Lakehouse (Required) | String | Name of the lakehouse for the given layer |
| Layer (Required) | FabricMedallionLayer | Layer for the medallion architectureA way of organizing data into three stages: Bronze (raw), Silver (cleaned), and Gold (ready for reports).: Bronze, Silver, Gold, Meta |
| Workspace (Required) | String | Fabric Workspace name (workspace has to exist and user needs access) |
Tabular Models
| Name | Type | Description |
|---|---|---|
| Model (Required) | String | Name of the model (e.g. DM). Used to select the model by name in the loaders |
| TabularName (Required) | String | Name of the tabular database/model as deployed to the workspace |
| CompatibilityLevel (Required) | Number | Compatibility level of the tabular model (e.g. 1700) |
| AddMembers | bool | |
| DatabaseSchema | String | |
| Workspace | String | |
| DefaultPowerBIDataSourceVersion | String | |
| LoginType | String | |
| PartitionDeployment | bool | |
| RoleDeployment | bool | |
| Lakehouse | String | |
| LakehouseSourceConnection | String | Name of the lakehouse connection used as the tabular datasource |
| BimFolder | String | |
| BimFile | String | |
| SourceQueryCulture | String | |
| ModelFolder | String | |
| ModelFile | String | |
| DerivedModelFile | String | Links a derived model file, resolved in the same ModelFolder |
| DataSourceType | String | |
| DataSourceName | String | |
| Dataset | String | |
| TabularSystemFolder | String | |
| MeasureTemplateFile | String | |
| FormatStringFile | String | |
| RoleFile | String | File with the role definitions (e.g. roles.yaml) |
Power BI Reports
| Name | Type | Description |
|---|---|---|
| GroupName | String | A name for the group of reports. Used to reference this setting in Azure DevOps pipeline |
| FilePath | String | Relative filepath to the reports.yaml config file |
| ReportFolder | String | Relative Path to the folder with the PBIX files |
Blob triggers
Defined under blobtriggers: — each entry connects an Azure storage container to a notebook that is triggered when a matching file is dropped. See Blob file trigger for the full setup.
Backups
Defined under backups: — each entry defines a backup of a layer to an Azure storage account:
| Name | Type | Description |
|---|---|---|
| BackupName | String | Name of the backup definition |
| Enabled | bool | Whether this backup runs (default=true) |
| StorageAccount | String | Azure storage account to back up to |
| Container | String | Container in the storage account |
| Layer | String | Layer to back up (e.g. bronze) |
| Schema | String[] | Schema(s) to back up (e.g. [his]) |
| TableFolder | String | Folder with the object YAML files that define the tables to back up |
| ExceptFolders | String[] | Folders to exclude |
Bronze, Silver and Gold Table settings
Can be set as bronzetablesettings, silvertablesettings and goldtablesettings
| Name | Type | Description |
|---|---|---|
| delta.enableChangeDataFeed | bool | |
| delta.autoOptimize.optimizeWrite | bool | |
| delta.autoOptimize.autoCompact | bool | |
| delta.logRetentionDuration | String | |
| delta.deletedFileRetentionDuration | String | |
| spark.sql.parquet.vorder.default | bool | |
| spark.databricks.delta.optimizeWrite.enabled | bool | |
| spark.sql.parquet.vorder.default | bool | |
| delta.stats.extended.collect | bool | |
| delta.stats.extended.inject | bool |
Those settings are added to the table creation script when generated.