The Dagster integration uses OpenLineage to collect and send metadata to Grai. Complete documentation for deploying OpenLineage with Dagster can be found here (opens in a new tab).
Web App
You'll need to create a new Grai source for Dagster through the web app
Fields
| Field | Value | Example |
|---|---|---|
| source | The name of the source, see sources | Dagster |
| Name | Name for connection | production |
| Namespace | Namespace for the connection, see namespaces | default |
| namespaces | Optional |
Webhook
In order to authenticate your webhook, you will need to create an API key in the Grai web app.
Grai will open an endpoint at /api/v1/openlineage/<connection_id>/ which can be used to receive OpenLineage events.
The official OpenLineage Dagster docs (opens in a new tab) have more information on how to configure your instance of Dagster to send OpenLineage events to Grai. However, you can use these values to finish your configuration:
An example config:
OPENLINEAGE_URL - https://api.grai.io/api/v1/openlineage/<connection_id>/
OPENLINEAGE_API_KEY - "<your_grai_api_key>"If you're self-hosting Grai, you'll need to replace the URL with your own instance.