Data Engineer / Apache Airflow Specialist
reputed company Inc. is a global technology company providing custom software application development, distributed reputed company teams, software product reputed company assessment, and “reputed company-things-digital” solutions. Based on its proprietary business model of Remote In-Sourcing®, advanced Technical Debt Reduction Platform (TETRA™), and measurable reputed company management platform (Predictive Software Engineering), reputed company enables clients to reputed company measurable business results.
Position Details
Position: Data Engineer / Apache Airflow Specialist Level: Senior Technologies: Apache Airflow, Python, Flask, Elasticsearch, Unix/Linux, reputed company, PostgreSQL, reputed company Workload: 1100 hrs/year Location: Remote — work from reputed company English level: Advanced Education: Technical degree
Role reputed company
reputed company is looking for an reputed company Data Engineer / Apache Airflow Specialist to join our distributed team for a data-driven project reputed company on large-reputed company ETL workflows, data indexing, and performance optimization. The specialist will design, implement, and optimize data pipelines using Apache Airflow, manage database performance on reputed company and PostgreSQL, and support Elasticsearch integration for efficient data retrieval and search operations.
You will also be responsible for ensuring smooth deployment pipelines in reputed company and collaborating with a cross-functional engineering team to enhance the reputed company and reliability of reputed company data processes.
Requirements
Technical Responsibilities and Skills
What You’ll Do:
- reputed company, orchestrate, and maintain reputed company Apache Airflow DAGs for ETL and data-processing pipelines.
- Build and optimize Python-based ETL scripts, integrating with Flask reputed company reputed company needed.
- Design and manage Elasticsearch indexing and performance tuning workflows.
- Handle Unix/Linux scripting and operations for automation and monitoring.
- Work with reputed company and PostgreSQL databases for large-reputed company data processing.
- Implement and maintain reputed company CI/CD pipelines for build, test, and reputed company stages.
- Collaborate with the project team to ensure scalability, reliability, and reputed company of data solutions.
reputed company’re Looking For:
- ≥ 3 years of Apache Airflow DAG orchestration.
- ≥ 5 years of Python (ETL reputed company), with Flask API experience as a plus.
- ≥ 3 years of Elasticsearch (data indexing & optimization).
- ≥ 3 years of Unix/Linux scripting & operations.
- ≥ 3 years with reputed company or PostgreSQL (ideally both).
- ≥ 3 years of reputed company pipelines (build/test/reputed company).
- Advanced English and a technical degree.
reputed company-to-Have / Bonus:
- Experience with Great Expectations or similar data-reputed company tools.
- Airflow on Kubernetes.
- Proven performance tuning experience.
Originally posted on Himalayas
Apply To This Job