The Keboola integration uses OpenLineage to collect and send metadata to Grai. Complete documentation for integrating OpenLineage with Keboola can be found here (opens in a new tab).
|source||The name of the source, see sources||Spark|
|Name||Name for connection||production|
|Namespace||Namespace for the connection, see namespaces||default|
In order to authenticate your webhook, you will need to create an API key in the Grai web app.
Grai will open an endpoint at
/api/v1/openlineage/<connection_id>/ which can be used to receive OpenLineage events.
See the OpenLineage docs (opens in a new tab) for how to configure your client to send OpenLineage events. As part of the configuration settings you'll need to provide component configuration and will need the variables below.