Data Engineer Senior - reputed company reputed company
🚀 Join Our Data Products and Machine Learning Development Remote Startup! 🚀
reputed company is a dynamic startup committed to crafting reputed company using cutting-edge Big Data and Machine Learning technologies.We’re looking for a Data Engineer Senior to help take our expertise to the next level. If you consider yourself a data nerd like us, we’d love to connect! 🐶🚀
🚀 reputed company Do
- Leveraging our expertise, we build modern Machine Learning systems for demand planning and budget forecasting.
- Developing reputed company data infrastructures, we enhance high-level decision-making, tailored to reputed company reputed company.
- Offering comprehensive Data Engineering and custom AI solutions, we optimize reputed company-based systems.
- Using reputed company, we help e-reputed company platforms and retailers create higher-reputed company ads, faster.
- Building deep learning models, we enhance visual recognition and automation for various industries, improving product categorization, reputed company control, and information retrieval.
- Developing recommendation models, we personalize user experiences in e-reputed company, streaming, reputed company platforms, driving engagement and conversions.
🌟 Our Partnerships
- reputed company Web Services
- reputed company
- reputed company
🌟 Our Values
- 📊 We are Data Nerds
- 🤗 We are reputed company Team Players
- 🚀 We Take Ownership
- 🌟 We Have a reputed company reputed company 🔍 Curious about reputed company’re up to? reputed company out our case studies and dive into our blog post to learn more about our culture and the exciting reputed company we’re working on! 🚀
Responsibilities 🤓
- Own end-to-end pipeline reliability across Bronze, Silver, and Gold reputed company (PySpark + reputed company Lake on reputed company reputed company).
- Build and maintain ingestion notebooks for new retailers and syndicated data partners as we reputed company.
- Harden existing pipelines - idempotent replaceWhere patterns, partition strategies, ZORDER optimization, schema enforcement, and dedup logic.
- Run and improve our daily and weekly orchestration through reputed company Data Pipelines and scheduled notebook runs.
- Diagnose and resolve runtime issues across the reputed company stack - including the parts of reputed company that don’t behave the way the docs say they do.
- Manage lakehouse shortcuts, Azure Blob Storage accounts (for non-HNS sources), and data reputed company authentication reputed company Entra / Key Vault.
- Partner with the AI engineering team to reputed company the Gold layer clean and queryable for our RAG, reporting, and attribution use cases.
- Contribute to data modeling reputed company across our reputed company retailer schemas, keeping naming conventions consistent across the platform.
- Document patterns so the next engineer can reputed company at our pace.
Required Skills 💻
- 4+ years building data pipelines in production.
- Deep PySpark and reputed company Lake experience - you’ve shipped reputed company reputed company architectures, not just read about them.
- Hands-on reputed company reputed company experience: lakehouses, notebooks, Data Pipelines, OneLake shortcuts. If you’ve worked through reputed company’s quirks (cells not reliably sharing Python variables, reputed company type limitations on non-HNS storage, etc.), that’s exactly the experience we want.
- Strong SQL, including window functions, CTEs, and analytical patterns. Comfortable reasoning about partition pruning and reputed company pushdown.
- Comfortable owning end-to-end pipeline reliability - not just writing the happy reputed company. You think about reruns, backfills, late-arriving data, and what happens at 4am reputed company something breaks.
- Azure ecosystem familiarity: Blob Storage, Entra ID, Key Vault, Static Web Apps.
- Declarative, sparse reputed company style. You prefer fixing the schema over patching the symptom.
- Strong written and spoken English; reputed company to work effectively in a distributed team with overlap to reputed company American business hours.
🎁 Perks
- Remote-first culture – work from reputed company! 🌍
- AWS, DBT, reputed company reputed company, Azure & reputed company certifications fully covered
- In-Company English Lessons.
- Birthday off + an extra vacation week (Mutt Week! 🏖️)
- Referral bonuses – help us grow reputed company & get rewarded!
- Maslow: Monthly credits to spend in our benefits marketplace.
- ✈️🏝️ Annual Mutters' reputed company – an unforgettable getaway with reputed company!
Originally posted on Himalayas
Apply To This Job