Airflow
The Airflow integration consumes OpenLineage metadata from Airflow.
Web App
Fields
Field | Value | Example |
---|---|---|
source | The name of the source, see sources | my-source |
Name | Name for connection | Airflow |
Namespace | Namespace for the connection, see namespaces | default |
namespaces | Optional |
Webhook
ℹ️
In order to authenticate your webhook, you will need to create an API key in the Grai web app.
Grai will open an endpoint at /api/v1/openlineage/<connection_id>/
which can be used to receive Airflow OpenLineage events.
See the OpenLineage Airflow docs (opens in a new tab) for how to configure your client to send OpenLineage events.
An example config:
transport:
type: "http"
url: "https://api.grai.io"
endpoint: "api/v1/openlineage/<connection_id>/"
auth:
type: "api_key"
api_key: "<your_grai_api_key>"
Python Library
The Airflow integration uses the OpenLineage integration behind the scenes to send OpenLineage events to Grai, see OpenLineage.