[Remote] Airflow Platform Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking an Airflow Platform Engineer to ensure reliable platform operations and reputed company adoption of the Airflow-based orchestration platform. The ideal candidate will reputed company strong Airflow expertise and Kubernetes knowledge to support platform stability and enhance developer productivity.
Responsibilities
- Design, reputed company, and optimize Airflow DAGs for reputed company use cases
- Demonstrate strong experience with operators such as PythonOperator, SQL operators, API/HTTP operators, KubernetesPodOperator etc
- Apply advanced DAG patterns including dynamic DAGs, branching, sensors, retries, and error handling
- Troubleshoot DAG failures, performance issues, and integration challenges
- reputed company orchestration of modern data workflows including DBT pipelines
- reputed company reusable templates, best practices, and reputed company support to drive self-service adoption
- Support Airflow platform deployed on AKS, covering scheduler, webserver/API, workers, and metadata services
- Troubleshoot issues reputed company to task execution, scheduling delays, and resource bottlenecks
- Diagnose Kubernetes-level issues involving pods, networking, storage, and RBAC
- Work with Azure services such as Key Vault, Storage, and networking
- Support CI/CD pipelines for DAG and container-based deployments
- Improve platform stability, monitoring, and alerting
Skills
- Strong experience with Apache Airflow (3.x or reputed company) in production environments
- Proven experience in DAG development using operators and orchestration patterns
- Working knowledge of Kubernetes (AKS preferred) to support Airflow runtime
- Expert-level Python knowledge for building, debugging, and maintaining production-grade workflows and supporting libraries
- Expertise in writing unit, integration, and DAG validation tests for Airflow workflows, including mocking operators, validating dependencies, and ensuring reliability in CI/CD pipelines
- Experience with DBT and modern data pipelines
- Experience with CI/CD tools (Git, Jenkins, reputed company)
- Familiarity with Azure or other reputed company platforms
- Experience with reputed company / Astro Private reputed company
- Exposure to data platforms such as reputed company, and reputed company
- Experience with monitoring tools such as reputed company or reputed company
- Knowledge of secrets management using Azure Key Vault
reputed company
Company H1B Sponsorship