The Dagster integration uses OpenLineage to collect and send metadata to Grai. Complete documentation for deploying OpenLineage with Dagster can be found here (opens in a new tab).
You'll need to create a new Grai source for Dagster through the web app
|source||The name of the source, see sources||Dagster|
|Name||Name for connection||production|
|Namespace||Namespace for the connection, see namespaces||default|
In order to authenticate your webhook, you will need to create an API key in the Grai web app.
Grai will open an endpoint at
/api/v1/openlineage/<connection_id>/ which can be used to receive OpenLineage events.
The official OpenLineage Dagster docs (opens in a new tab) have more information on how to configure your instance of Dagster to send OpenLineage events to Grai. However, you can use these values to finish your configuration:
An example config:
OPENLINEAGE_URL - https://api.grai.io/api/v1/openlineage/<connection_id>/ OPENLINEAGE_API_KEY - "<your_grai_api_key>"
If you're self-hosting Grai, you'll need to replace the URL with your own instance.