Skip to content

definitions

Resource definitions for dltHub integrations.

defs()

Instantiate the dltHub resources required by the Dagster definitions.

Returns:

Type Description
Definitions

dagster.Definitions: Definitions exposing the dlt resource configured with credentials sourced from the local key vault stub. The helper ensures environment variables expected by dlt are populated before constructing the resource.
Source code in data_foundation/defs/dlthub/definitions.py 
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
@definitions
def defs() -> Definitions:
    """Instantiate the dltHub resources required by the Dagster definitions.

    Returns:
        dagster.Definitions: Definitions exposing the ``dlt`` resource configured with
            credentials sourced from the local key vault stub. The helper ensures
            environment variables expected by dlt are populated before constructing the
            resource.
    """
    set_dlt_credentials()

    os.environ["ENABLE_DATASET_NAME_NORMALIZATION"] = "false"

    # Resolve the root folder containing dlt configuration files and scripts.
    config_dir = Path(__file__).joinpath(*[".."], "dlthub").resolve()

    return Factory.build_definitions(config_dir)