LakeHouseSourceOptions

Connection options for the Lakehouse (Delta table) source connector.

class scamander.models.source_config.lakehouse.LakeHouseSourceOptions(*, table: str, filter: str | None = None, columns: list | None = None)

Basisklassen: BaseModel

Connection options for the Lakehouse (Delta table) source connector.

Reads directly from a Delta table registered in a Fabric Lakehouse or Unity Catalog, optionally applying a filter predicate to limit the rows returned.

table

Fully qualified Delta table name, e.g. "bronze.my_schema.customer".

Type:

str

filter

Optional Spark SQL WHERE clause (without the WHERE keyword) to push down to the Delta reader, e.g. "IsActief = true AND GeldigTot IS NULL".

Type:

str | None

columns

Optional list of column names to project. When None all columns are returned.

Type:

list[str] | None

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].