Skip to content

Airflow plugin to export dag and task based metrics to Prometheus.

License

Notifications You must be signed in to change notification settings

soundcloud/airflow-exporter

 
 

Repository files navigation

Airflow prometheus exporter

travis build status

Exposes dag and task based metrics from Airflow to a Prometheus compatible endpoint.

Screenshots

Compatibility

Note: this version is compatible with Airflow 1.10.3+ only, see #46 for details

For compatibility with previous versions of Airflow use older version: v0.5.4

  • Airflow: airflow1.10.3+
  • Python: python2, python3
  • DataBase: postgresql, mysql

Install

pip install airflow-exporter

That's it. You're done.

Metrics

Metrics will be available at

http://<your_airflow_host_and_port>/admin/metrics/

airflow_task_status

Labels:

  • dag_id
  • task_id
  • owner
  • status

Value: number of tasks in specific status.

airflow_dag_status

Labels:

  • dag_id
  • owner
  • status

Value: number of dags in specific status.

airflow_dag_run_duration

Labels:

  • dag_id: unique identifier for a given DAG
  • run_id: unique identifier created each time a DAG is run

Value: duration in seconds that a DAG Run has been running for. This metric is not available for DAGs that have already completed.

License

Distributed under the BSD license. See LICENSE for more information.

About

Airflow plugin to export dag and task based metrics to Prometheus.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 85.0%
  • Shell 10.7%
  • Dockerfile 4.3%