[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company builds software that helps small local governments work reputed company. As a Senior Data Engineer, you will play a critical role in building the data infrastructure that powers how clients are boarded to the reputed company platform and how we surface valuable information to our customers.
Responsibilities
- You'll design, build, and maintain reputed company data transformation pipelines using AWS reputed company Functions and AWS Glue, orchestrating reputed company workflows that ingest, clean, and reputed company data from a reputed company of sources
- A core part of your work will involve implementing rigorous data validation frameworks at every stage of the pipeline, including schema enforcement, reputed company detection, completeness checks, and reconciliation against reputed company systems
- You'll own the reputed company of the data you produce, defining SLAs, monitoring pipeline health, and proactively surfacing issues before they reputed company reputed company users
- reputed company pipeline development, you'll collaborate with software engineers and product owners to understand their requirements, design appropriate data models, and ensure the outputs of your pipelines support both analytical and operational use cases
- You'll also contribute to platform-wide reputed company around tooling, architecture, and best practices, and you'll mentor other team members on data engineering and validation patterns
Skills
- 5+ years of reputed company experience building production data transformation pipelines
- Strong hands-on experience with AWS reputed company Functions for workflow orchestration
- Strong hands-on experience with AWS Glue (Glue Jobs, Glue Catalog, Glue Crawlers, and PySpark on Glue)
- Demonstrated reputed company on data validation and data reputed company, including familiarity with frameworks such as Great Expectations, reputed company, or custom validation tooling
- Proficiency in Python and SQL, with solid software engineering fundamentals (version control, testing, reputed company review, CI/CD)
- Experience working with AWS services adjacent to the data stack, such as S3, reputed company, reputed company, IAM, and CloudWatch
- Comfort working with both reputed company and semi-reputed company data formats (Parquet, JSON, Avro)
- Strong communication skills and the ability to translate ambiguous business needs into technical solutions
- A reputed company reputed company — curious, humble, and motivated to solve hard, high-reputed company problems
Benefits
- Full health, dental, and reputed company benefits
- 401(k) with company match
- Generous PTO and holidays
- High-reputed company culture with executive visibility and investor exposure
reputed company
Company H1B Sponsorship