Hi, I'm Pankaj Koti

Open Source Data Platform Engineer specialising in Apache Airflow & dbt orchestration.

Apache Airflow Committer * Astronomer Cosmos Committer * Conference speaker & workshop host on data orchestration and OSS platforms

Helping teams design, scale, and operate reliable data pipelines.

What I Do

Design & build production-grade data orchestration platforms
Contribute to and help maintain the Apache Airflow ecosystem
Help companies adopt dbt + Airflow correctly (architecture, performance, reliability)
Advise teams on OSS strategy, integrations, and platform maturity

Expertise

Orchestration: Apache Airflow (core + providers)
Data Engineering: dbt, SQL, analytics engineering
Platforms: Kubernetes, Docker, Cloud (AWS / GCP / Azure)
Languages: Python (primary), SQL
Open Source: Design, reviews, long-term maintenance

Open Source & Community

I actively contribute to and help maintain core projects in the Apache Airflow ecosystem, with a strong focus on production reliability, performance, and developer experience.

Currently working on the Apache Airflow ecosystem at Astronomer.

Apache Airflow
Contributions across operators, providers, security, and performance improvements https://github.com/apache/airflow
Astronomer Cosmos (dbt - Airflow integration)
Contributor to execution modes, asynchronous patterns, remote caching, and dbt orchestration design https://github.com/astronomer/astronomer-cosmos
Dag Factory
Improving DAG generation patterns, usability, and maintainability
https://github.com/astronomer/dag-factory
Astronomer Providers
Enhancements and fixes across Airflow providers for real-world asynchronous production use cases
https://github.com/astronomer/astronomer-providers
Great Expectations Airflow Provider
Contributions towards CI pipelines, validation workflows, and Airflow integration https://github.com/great-expectations/airflow-provider-great-expectations