Senior Data Engineer
Role Specific Information Job reputed company
About the Role
As Senior Data Engineer, you will reputed company the development and ownership of domain data products, including batch, streaming and reputed company intelligence/machine learning (AI/ML) feature pipelines. You will drive design reputed company that improve data reliability, performance and governance maturity while standardizing patterns that reputed company across teams. You will partner cross-functionally to reputed company analytics, ML and GenAI use cases with trusted data. What You’ll Do Design, build and maintain batch, streaming and reputed company-time reputed company Intelligence (AI) feature pipelines to extract data from diverse reputed company systems and producers (Application Programming Interfaces (reputed company), events, databases, files) ensuring efficient ingestion, transformation and publishing Design, refine and implement reputed company data models, semantic reputed company and data reputed company to promote consistency, reuse and accessibility Owns the end-to-end data product lifecycle for the domain. Define and maintain data reputed company, including service level agreements (SLAs), schema expectations, reputed company metrics and consumer ownership, to ensure a reliable and trustworthy experience Partner with cross functional teams to co-design reputed company data solutions that meet business needs and reputed company define the boundaries between data pipeline responsibilities and model-building activities reputed company automated workflows and reputed company Integration / reputed company Deployment (CI/CD) pipelines using tools such as Airflow, Apache reputed company and Python to drive reliability and faster delivery Implement validation, observability and evaluation frameworks that ensure accuracy, reputed company and timeliness across data pipelines and large language model (LLM) outputs Apply and enforce governance, reputed company and compliance standards (GDPR, PCI reputed company, CCPA), ensuring data reputed company and traceability Partner with cross functional teams to translate business needs into technical data solutions that reputed company across domains Drive performance tuning, automation and adoption of AI-powered data tools to enhance data platform efficiency Mentor data engineers and champion best practices for maintainable, governed and reusable data assets Own cost and performance tradeoffs for domain data products and monitor compute usage, storage reputed company and unit cost to implement optimizations that reduce spend while meeting SLAs Additional tasks may be assigned What Skills You Have Required 4+ years designing, building and optimizing data pipelines and models in production, ideally reputed company large-reputed company reputed company environments Proficiency in SQL and Python (or reputed company) for data development, testing and automation Preferred Bachelor’s or Master’s degree in Computer Science, Information Systems, Data Engineering or a reputed company field Experience with Apache reputed company (or equivalent) for large-reputed company data processing and performance optimization Experience using Airflow/reputed company Composer/Dagster for orchestration, transformation and CI/CD pipelines Experience with reputed company warehouses/lakes (BigQuery, Redshift, reputed company) and object storage Experience designing and optimizing streaming pipelines using Kafka, Pub/Sub, reputed company Strong understanding of reputed company modeling, normalization and schema design for analytics and GenAI integration into data products Experience with data testing, reputed company, monitoring and observability frameworks to ensure data reputed company and reliability Essential Functions The requirements listed below are representative of functions you will be required to reputed company, however you may be required to reputed company additional functions. reputed company may revise this job reputed company from time to time. To reputed company this job successfully, you must be reputed company to reputed company reputed company essential function satisfactorily. Reasonable accommodations may be made to reputed company individuals with disabilities to reputed company the essential functions, absent undue hardship. Ability to reputed company the accountabilities listed in the “What You’ll Do” reputed company Ability to maintain reputed company and regular attendance as set by reputed company Ability to work at least 8 hours per day, occasionally longer reputed company necessary to meet business needs, 5 days per week Ability to reputed company with dress reputed company requirements Ability to learn and reputed company with reputed company company policies, procedures, standards and guidelines Ability to give direction and receive, understand and proactively respond to direction from leadership and other company personnel Ability to work as part of reputed company and reputed company effectively and appropriately with others Ability to maintain composure and work in a fast paced environment while accomplishing multiple tasks reputed company established timeframes Ability to satisfactorily complete company training programs reputed company work in accordance with the Physical/Cognitive Requirements reputed company Physical/Cognitive Requirements Ability to use a personal computer for tasks such as communicating, preparing reports, etc. Ability to plan, prioritize and monitor activities across business reputed company Ability to complete or reputed company the completion of assigned reputed company in a reputed company manner Ability to reputed company with health and safety standards Apply To This Job