User manual

This manual walks through the Sovereign Data Platform from the point of view of the people who use it, step by step and with a screenshot for every screen you have to see or click. It describes what you do and what you see, not how the platform is built.

The manual covers two roles:

• Administrator: a platform administrator, member of the platform-admins group. Creates users and teams and manages the platform-wide settings.

• Data engineer: a member of a team. Owns and uses data products, works in notebooks and queries data with SQL.

The screenshots show the English user interface; the Dutch edition of this manual shows the Dutch one. Button and menu names are written in bold exactly as they appear on screen. The examples use a fictitious organization: a finance team and a marketing team, a catalog called finance and invented people. All data you see is made up.

Where to start

• New to the platform: read the Introduction and Concepts.

• You manage users and teams: Administrator journey.

• You publish data or ask for access to it: Data engineer journey.

• You work with the data in notebooks and SQL: Notebooks and SQL.

• Something does not work: Troubleshooting and FAQ.

Contents

• Introduction
  • What the platform is
  • Roles
  • Your addresses
  • Signing in
  • The language of the screens
• Concepts
  • Catalog, schema, table
  • Data products and owners
  • Product catalogs and container catalogs
  • Roles on a data product
  • Filtered access
  • Access flows down the tree
  • Tables are Delta tables
• Administrator journey
  • Signing in and the administration menu
  • Creating a user
  • Making someone an administrator
  • Teams
  • Unity Catalog settings
  • Approving or rejecting a request to create a catalog
  • Deleting a catalog
  • Synchronizing the Unity Catalog
  • Checking who has access to something
• Data engineer journey
  • The dashboard
  • Browsing the catalog
  • Creating a data product
  • Requesting access to data
  • Deciding on a request
  • Managing your data product
  • Sharing data with another team
• Notebooks and SQL
  • Signing in to JupyterHub
  • Your Spark session
  • Creating a schema and a table
  • Reading data you have filtered access to
  • SQL with Trino and BI tools
  • Scheduled notebooks with Airflow
• Troubleshooting and FAQ
  • “No access to catalog” or “Access Denied”
  • Spark says the table does not exist
  • “Unity Catalog does not support non-Delta managed table”
  • A new catalog or schema is not visible in my notebook
  • I cannot write to a table
  • SQL Server Management Studio cannot connect
  • I see no catalogs on the Trino web page
  • The message “Your Trino token has expired”
  • My notebook server does not start
  • I lost my password
  • Where do I ask for help?