The Keboola integration uses OpenLineage to collect and send metadata to Grai. Complete documentation for integrating OpenLineage with Keboola can be found here (opens in a new tab).
Web App
Fields
| Field | Value | Example |
|---|---|---|
| source | The name of the source, see sources | Spark |
| Name | Name for connection | production |
| Namespace | Namespace for the connection, see namespaces | default |
| namespaces | Optional |
Webhook
ℹ️
In order to authenticate your webhook, you will need to create an API key in the Grai web app.
Grai will open an endpoint at /api/v1/openlineage/<connection_id>/ which can be used to receive OpenLineage events.
See the OpenLineage docs (opens in a new tab) for how to configure your client to send OpenLineage events. As part of the configuration settings you'll need to provide component configuration and will need the variables below.
openlineage_api_url=https://api.grai.io/api/v1/openlineage/<connection_id>Did this doc help you?