Config

Top-level pipeline configuration model wrapping a source.

class scamander.models.config.Config(*, source: SourceConfig)

Basisklassen: BaseModel

Root configuration passed to Source — its __new__ factory reads source.type to pick the concrete connector.

source

Source connection and read options. source.type determines which connector Source instantiates.

Type:

scamander.models.source_config.source.SourceConfig

Example:

from scamander.models.config import Config

config = Config.model_validate({
    "source": {
        "type": "csv",
        "options": {"file_path": "/data/customers.csv"},
    },
})

model_config = {}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].