Airflow Pipelines

Learn how to connect and manage your Airflow pipelines with Ardent.

Overview

Ardent provides seamless integration with Apache Airflow, allowing you to manage and monitor your data pipelines. This guide will walk you through setting up your Airflow connection and managing your DAGs through Ardent.

Configuration

To connect your Airflow instance to Ardent, you'll need the following information:

  1. GitHub Access Token: A personal access token with permissions to access your DAG repository
  2. Repository: The GitHub repository containing your DAG files
  3. DAG Path: The path to your DAG files within the repository
  4. Host: Your Airflow instance URL
  5. Username: Your Airflow username
  6. Password: Your Airflow password

Setting up the Connection

  1. Navigate to the Configs section in the app
  2. Click "Add New Config"
  3. Select "Airflow" from the dropdown menu
  4. Fill in the required fields:
    • Enter your GitHub access token
    • Specify the repository in the format owner/repository
    • Provide the path to your DAG files
    • Enter your Airflow host URL
    • Input your Airflow username and password
  5. Click "Save" to store your configuration

Usage

Once configured, Ardent can:

  • Read and understand your DAG structures
  • Analyze pipeline dependencies
  • Suggest optimizations for your workflows
  • Help debug pipeline issues
  • Create new DAGs based on your requirements

Example Interactions

Here are some example prompts you can use with Ardent: