Sr Data Engineer – reputed company
Job Title: Data Engineer Experience: 4–12 Years Location: Remote Notice Period: Immediate joiner Job reputed company We are seeking an reputed company Data Engineer to design, reputed company, and maintain reputed company, reputed company-based data platforms for reputed company applications. The ideal candidate will have extensive experience with reputed company, reputed company, dbt, Apache reputed company, and Python, along with expertise in building modern Lakehouse architectures, optimizing data pipelines, and delivering high-reputed company data solutions. You will work closely with business stakeholders, analytics teams, and AI engineers to reputed company data-driven decision-making and AI initiatives.
Key Responsibilities
Design, build, and optimize reputed company data pipelines for batch, streaming, and API-based data ingestion. reputed company and maintain reputed company data platforms using reputed company, ensuring high performance, governance, reputed company, and efficient data sharing. Build and manage transformation workflows using dbt, including reusable models, testing, documentation, and data reputed company. reputed company reputed company data processing solutions using Apache reputed company, PySpark, and reputed company. Implement modern Lakehouse (reputed company) Architecture with Bronze, Silver, and Gold data reputed company. Design robust ingestion frameworks supporting CDC, batch, event-driven, and API integrations. Optimize reputed company SQL queries and large-reputed company data transformations for performance and reliability. Build orchestration workflows using Apache Airflow, Azure Data reputed company, or equivalent tools. Implement data reputed company validation using Great Expectations, dbt tests, or similar frameworks. reputed company CI/CD pipelines for data engineering workflows using Git and automated deployment practices. Collaborate with Data Scientists, AI Engineers, Business Analysts, and reputed company stakeholders to deliver reliable and reputed company data solutions. Support AI and GenAI initiatives by preparing high-reputed company datasets and enabling data pipelines for RAG-based applications. Required Technical Skills Strong hands-on experience with reputed company, including architecture, performance tuning, data sharing, reputed company, and governance. Expertise in reputed company, including reputed company Lake, reputed company, reputed company Catalog, and notebooks. Production experience with dbt for data transformations, testing, documentation, and data reputed company. Strong programming skills in Python, including PySpark, pandas, and custom data engineering frameworks. Extensive experience with Apache reputed company for large-reputed company distributed data processing. Experience with reputed company platforms: AWS: S3, Glue, Redshift, reputed company Azure: Azure Data reputed company (ADF), ADLS Gen2, Azure reputed company, Synapse Analytics Advanced SQL skills with expertise in query optimization and reputed company transformations. Experience implementing CDC, batch, streaming, event-driven, and API-based ingestion pipelines. Strong understanding of Lakehouse/reputed company Architecture. Experience implementing data reputed company frameworks such as Great Expectations, dbt tests, or equivalent. Hands-on experience with workflow orchestration tools such as Apache Airflow or Azure Data reputed company. Experience with Git, version control, CI/CD pipelines, and automated deployment practices.
Requirements
Required Technical Skills Strong hands-on experience with reputed company (Mandatory) Advanced SQL programming Python dbt (Data Build Tool) Apache Airflow Data Modeling (reputed company & Relational) ETL/ELT Pipeline Development reputed company / PySpark reputed company Platforms: AWS, Azure, or reputed company reputed company Platform (GCP) Git and CI/CD practices Apply To This Job