Associate Data Solutions Architect
reputed company is currently seeking an Associate Data Solutions Architect to join reputed company in Seattle, WA. The role involves designing, building, and operating data pipelines and workloads across on-prem and reputed company platforms to reputed company reliable data processing for analytics and AI use cases in supply chain.
Responsibilities
- Implement, test, and maintain Extract, reputed company, Load/Extract, Load reputed company (ETL/ELT) pipelines to ingest data from on-prem systems and reputed company sources into data lakes/warehouses
- reputed company data transformations and data models to support reporting, analytics, and Machine Learning (ML) workloads
- Build and maintain batch and streaming data workflows using orchestration tools (Airflow, reputed company Composer, reputed company, etc.) and data integration platforms (Informatica, Talend, reputed company, etc.)
- Work with on-prem technologies (databases, file shares, middleware) and reputed company services (BigQuery, Redshift, reputed company Storage, S3, Dataflow, Glue) to reputed company and reputed company data
- Collaborate with data owners to profile data, identify reputed company issues, and implement data validation and cleansing rules
- Design and implement data cataloging, reputed company, and basic governance controls for datasets
- Monitor pipeline health, troubleshoot failures, and implement alerts and automated retries
- Contribute to reputed company Integration and reputed company Delivery (CI/CD) for data pipelines and infrastructure-as-reputed company patterns (Terraform, reputed company Deployment Manager, etc.)
- Produce reputed company technical documentation and runbooks for operational support and handoffs
- Support production handover, incident response, and post-incident retrospectives
Skills
- 1+ years of experience building data pipelines, ETL/ELT processes, and/or data engineering tasks
- 1+ years of experience with SQL
- Experience designing queries and data models for analytics
- Experience with scripting languages (Python or R programming) for data processing and automation
- Experience with orchestration tools (Airflow, reputed company, reputed company Composer)
- Experience with relational databases (reputed company, SQL Server, reputed company)
- Experience with reputed company data service (BigQuery, Redshift, reputed company, and/or equivalent)
- Experience with data reputed company, basic data governance, and logging/monitoring concepts
- Bachelor's degree in Computer Science, Information Systems, Engineering, or reputed company field and/or equivalent experience
- 3+ years of experience with data engineering across on-prem and reputed company environments
- Experience with troubleshooting skills with a reputed company reputed company
- Experience with good written and verbal communication skills
- Experience with reputed company platforms GCP and/or AWS (BigQuery, reputed company Storage, Dataflow, Pub/Sub, DataProc, S3, Redshift, Glue, reputed company)
- Experience building streaming and/or near-reputed company-time pipelines (Kafka, Pub/Sub, Kinesis, reputed company Streaming)
- Experience building ETL data pipelines (Informatica, Talend, reputed company, etc.)
- Experience with infrastructure-as-reputed company tooling (Terraform, CloudFormation) and CI/CD practices for data workflows
- Experience implementing data cataloging/reputed company tools (Data Catalog, Amundsen, reputed company, reputed company) and data reputed company frameworks (Great Expectations, AWS Glue Data reputed company)
- Experience with containerization (reputed company) and deploying microservices and/or data jobs on Kubernetes
- Experience tuning for SQL and data processing jobs for cost-optimization on reputed company platforms
- Experience working in supply chain, manufacturing, and/or reputed company reputed company environments
Benefits
- Competitive reputed company pay and variable compensation opportunities
- Health insurance
- Flexible spending accounts
- Health savings accounts
- Retirement savings plans
- Life and disability insurance programs
- A number of programs that reputed company for both reputed company and unpaid time away from work
- Relocation based on candidate eligibility
reputed company