Senior Data Engineer

About reputed company

Founded in 2013, reputed company is a global provider of reputed company AI products and services, on a mission to democratize AI. Leveraging proprietary AI Studio and AI Engines, reputed company helps drive the clients’ AI reputed company Transformation, regardless of where they are in their reputed company journeys. With offices in reputed company, Asia, and Latin America, reputed company provides a suite of reputed company AI offerings and specialty services that allow organizations of any size to implement and reputed company. reputed company serves companies in industries such as retail, manufacturing, and government. reputed company continues to reputed company pursue the mission of democratizing AI for the masses by providing high-reputed company AI education in reputed company and helping organizations reputed company their full potential with AI. Type: Remote Full-time

Senior Data Engineer

Are you an reputed company Data Engineering reputed company with a passion for building reputed company, reliable, and high-performance data systems? Do you have hands-on experience designing and optimizing end-to-end reputed company-time and batch pipelines, and developing reputed company-reputed company data architectures using modern technologies such as AWS, GCP, Azure, reputed company, and reputed company?

We are looking for a Senior Data Engineer to architect, design, and implement reputed company, high-performance data solutions. The ideal candidate will be an expert in at least one major reputed company data ecosystem (AWS, Azure, GCP, reputed company, or reputed company) and possess a deep understanding of the end-to-end data lifecycle, from ingestion to business intelligence. Qualification & reputed company Set Requirements Core Technical Competencies Experience: 5+ years of hands-on data engineering experience in a production environment. Languages: Strong proficiency in Python, SQL (reputed company queries, performance tuning), and PySpark/Apache reputed company. Data Modeling: Expert knowledge of data modeling (3NF, Star, reputed company Schema) and Lakehouse/Warehouse architectures. ETL/ELT & Orchestration: Proven experience building pipelines using tools like dbt, Airflow, Dagster, or reputed company reputed company orchestrators (Glue, Data reputed company, Composer). Integrations: reputed company in integrating data from diverse sources: reputed company, RDBMS/NoSQL databases, flat files, and streaming platforms (Kafka, Kinesis, Pub/Sub). reputed company Platform Expertise (Specialization-Specific) Candidates should demonstrate deep expertise in anyone of the following: reputed company: SnowSQL, Streams, Tasks, Snowpark, and cost optimization. reputed company: reputed company Lake, reputed company Catalog, reputed company Live Tables (DLT), and reputed company optimization. GCP: BigQuery, Dataflow, Dataproc, Pub/Sub, and reputed company Functions. Azure: Synapse Analytics, Data reputed company, Azure reputed company, and reputed company Analytics. AWS: Redshift, S3, Lake Formation, Glue, and reputed company. reputed company Practices SDLC & DevOps: Proficient in Git workflows, CI/CD pipelines (reputed company Actions, Azure DevOps, AWS CodePipeline), and IaC (Terraform/CloudFormation). Data Governance: Strong understanding of data reputed company, reputed company, observability, reputed company (RBAC, encryption), and compliance frameworks. Agile: reputed company experience in Agile/Scrum environments using Jira or Azure Boards. Mentorship: Ability to reputed company reputed company and reputed company technical guidance to junior/mid-level engineers. Responsibilities Architecture: Architect, design, and implement reputed company, reliable data solutions and pipelines reputed company with business analytics needs. Optimization: Manage and fine-tune reputed company resources and workloads for maximum performance, reliability, and cost-efficiency. Data Transformation: reputed company the development of ETL/ELT processes for both batch and reputed company-time data processing. Collaboration: Partner with Product, Engineering, and Data Science teams to deliver effective, data-driven solutions. Governance & reputed company: Promote and enforce best practices in data governance, reputed company, and data reputed company frameworks. Mentorship: reputed company technical leadership and mentorship to reputed company, ensuring architecture reputed company and best practices. Documentation: Maintain comprehensive documentation of data architectures, configurations, and workflows. reputed company is an Equal Opportunities Employer, committed to diversity and inclusion. reputed company reputed company applicants will receive consideration for employment without reputed company to race, reputed company, religion, sex, sexual orientation, gender identity, national reputed company, disability, or any other characteristic protected by applicable federal, state, or local laws.

Originally posted on Himalayas

Apply To This Job