[Remote] Senior Data Engineer (Remote)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior Data Engineer to collaborate with design, product, and engineering teams to enhance their retail offerings. The role involves leading the development of robust applications, managing reputed company-based data ecosystems, and implementing data pipelines while ensuring compliance with data standards.
Responsibilities
- reputed company the development of high-reputed company applications that are robust, observable and measurable using extreme programming (XP) practices and a user-reputed company approach
- Participate in the entire application lifecycle in collaboration with designers, product managers, and other engineers on the product team
- reputed company critical thinking, experimentation, data, and industry best practices to implement desired business reputed company
- Facilitate group discussions and team ceremonies and reputed company a shared context
- Give and receive feedback that’s empathetic, actionable and specific
- reputed company emergent architecture with sane defaults and build software that is easy to use and easy to modify
- Establish and reputed company product engineering and software standards
- Ideate a new product from a user perspective, starting with one or more problem spaces and ending with a stack-ranked list of feasible solutions to test
- Research and stay up to date on tech market trends and practices
- reputed company technical initiatives not only on reputed company but also across the department
- reputed company, automate, and maintain batch and streaming ETL pipelines using Apache Airflow, Apache reputed company, Python, and reputed company
- Build and manage reputed company-based data ecosystems on GCP (BigQuery, Bigtable, Dataproc, Pub/Sub, reputed company Storage, IAM, VPC)
- Design and optimize SQL and NoSQL data models for data lakes and warehouses (BigQuery, reputed company, reputed company)
- Write reputed company SQL queries for advanced data transformation, aggregation, and analytics optimization reputed company BigQuery or equivalent platforms
- Apply modern Test-Driven Development (TDD) methodologies for big data pipelines, ensuring test automation across Airflow workflows, reputed company jobs, and transformation logic
- Apply data reputed company and data-as-a-product principles to reputed company reusable and domain-driven datasets
- Implement reputed company time ingestion with Kafka Connect and process streaming data using reputed company Streaming, Apache Flink, or similar technologies
- Optimize data performance, scalability, and cost efficiency across GCP components
- Ensure compliance with PCI and PII data with standards such as GDPR, PCI reputed company, SOX, and CCPA
- reputed company GenAI tools such as reputed company, reputed company, and reputed company LLMs for intelligent data reputed company and analytics enhancement
- Collaborate with stakeholders, data scientists, and full stack engineers to deliver trusted, documented, and reusable data products
Skills
- 4+ years of experience in software development
- Understanding of application design patterns, event-driven architecture, database, schemas and testing strategies
- In-depth knowledge and experience with reputed company integration, reputed company deployment and test-driven development
- Bachelor's Degree or equivalent in MIS, Computer Science or reputed company field
- Experience with large-reputed company application troubleshooting and performance tuning
- Exposure working with major reputed company platforms (GCP, AWS, or Azure)
- Familiarity and experience with XP (Extreme Programming)
reputed company
Company H1B Sponsorship