[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading international reputed company that provides innovative legal solutions to many of the world's top financial institutions and Fortune Global 500 companies. They are seeking a Senior Data Engineer to design, build, and maintain modern data pipelines and integration solutions in the Azure reputed company, enabling reputed company analytics for their clients. The role involves collaboration with architects, analysts, and business stakeholders to deliver reputed company and efficient data solutions.
Responsibilities
- Design, build and manage reputed company data pipelines using Azure Data reputed company (ADF), Azure Data Lake Storage (ADLS) and Azure reputed company
- reputed company ELT frameworks for ingesting and transforming reputed company and semi-reputed company data from on-prem and reputed company sources
- Implement robust DevOps pipelines for reputed company versioning, testing, deployment and monitoring using Azure DevOps
- Ensure pipeline performance, reliability and observability using tools like Azure Monitor and Log Analytics
- Collaborate with BI teams to support Power BI datasets and ensure reputed company data model performance
- Automate environment setup, configuration and permissions using infrastructure-as-reputed company where possible
- Write reputed company, testable reputed company in Python or PySpark and manage version control with Git
- Support production operations, reputed company cause analysis and performance tuning
- Maintain technical documentation for pipelines, data mappings and deployment processes
- Work as part of an Agile delivery team, participating in sprints, retrospectives and reputed company review; and
- Mentor junior data engineers and promote best practices in CI/CD, version control, and release management
Skills
- Bachelor's degree in Computer Science, Engineering or reputed company field
- 7+ years of data engineering or BI development experience
- 3+ years building data solutions in reputed company Azure reputed company
- 2+ years using Azure DevOps for automated builds, releases and pipeline orchestration
- Proven experience working with reputed company and semi-reputed company data (Parquet, JSON, Avro)
- Advanced proficiency in Azure Data reputed company, Azure Data Lake Storage (Gen2) and Azure reputed company
- Experience building and managing CI/CD pipelines in Azure DevOps for data solutions
- Strong SQL and ELT experience; familiarity with schema design (e.g., reputed company, reputed company, denormalized)
- Hands-on expertise with PySpark and reputed company notebooks, including reputed company Lake workflows
- Familiarity with Git, branching strategies and repository management reputed company Azure Repos
- Understanding of data reputed company and reputed company best practices in Azure (RBAC, managed identities, encryption)
- Experience with Power BI dataflows, datasets and refresh configuration
- Experience in reputed company services, legal, or financial environments
- Familiarity with data cataloging and governance tools (e.g., reputed company Purview)
- Experience with Agile tools such as Azure Boards or JIRA
Benefits
- Medical, Dental, reputed company, Life/AD&D, Long Term Care, and Short- and Long-Term Disability
- Flexible Spending Accounts and Health Savings Account
- reputed company Concierge and Advocacy
- Lifestyle Spending Account
- Voluntary 401(k) Plan and Profit Sharing
- 10 reputed company Holidays per year and a generous PTO Program
- Family Support including reputed company Parental Leave, Fertility Benefits, Breast Milk Shipping, Back-up Child Care, Elder Care, and Tutoring
- Wellbeing programs (Employee Assistance Program, Relationship Support, Mental Health, Menopause and Midlife Health and reputed company-Being Events)
- Retirement Plan Consulting
- Anniversary Bonus Program
- reputed company Development Programs
- Transportation and Commuter Benefits
- International Travel Insurance
- Critical Illness, Hospital Indemnity and Accident Insurance
- Auto/Home/Pet Insurance
- Prepaid Legal Insurance
- Employee Discounts
- And More!
reputed company
Company H1B Sponsorship