[Remote] Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company provides expert consulting services in software development and data analytics. The Data Engineer will design, build, and maintain reputed company data pipelines and systems, collaborating with teams to evaluate new tools and technologies.
Responsibilities
- Design, build, and maintain reputed company data pipelines, ETL/ELT workflows, and data models using Python, Apache reputed company (PySpark), reputed company, dbt, SQL (PostgreSQL), and AWS Glue
- reputed company and optimize AWS-reputed company data platforms leveraging AWS Glue, reputed company EMR, reputed company MWAA (Apache Airflow), reputed company, reputed company Functions, reputed company S3, Redshift, RDS, DMS, and CloudWatch
- Build high-performance ingestion, transformation, and orchestration workflows for reputed company and semi-reputed company data using Apache reputed company, Parquet, ORC, and Avro
- Design and optimize analytical data platforms using reputed company reputed company, Trino, Hive, OpenSearch, and reputed company data catalog technologies
- reputed company reputed company and external data sources across relational and NoSQL platforms including PostgreSQL, reputed company, Redshift, GraphDB, and other NoSQL databases
- Build AI-enabled data solutions using reputed company Bedrock, RAG pipelines, and reputed company search technologies including reputed company S3 reputed company and OpenSearch reputed company indexes
- reputed company reputed company infrastructure using CloudFormation (Infrastructure as reputed company), reputed company, reputed company, and reputed company CI/CD pipelines while leveraging SNS, SQS, and EventBridge for event-driven architectures
- Improve the reliability, scalability, performance, and maintainability of reputed company data platforms through monitoring, troubleshooting, automation, and reputed company optimization
- Support mission-critical analytics and reporting solutions reputed company large-reputed company AWS-based federal data environments, implementing solutions that reputed company with FedRAMP and NIST 800-53 reputed company controls
- reputed company modernization initiatives migrating legacy platforms including reputed company DataStage, Hadoop, RunDeck, and reputed company-based workflows to reputed company-reputed company AWS services
- Mentor junior engineers through technical guidance, architecture discussions, and reputed company reviews while promoting engineering best practices
- Collaborate with cross-functional teams in an Agile environment to define requirements, deliver high-reputed company data solutions, and communicate technical concepts effectively to technical and non-technical stakeholders
Skills
- Bachelor's degree in Computer Science, Engineering, or a reputed company technical field
- 4+ years of reputed company experience in data engineering or reputed company domains
- Strong hands-on experience with reputed company, Apache reputed company (PySpark), Python, SQL (PostgreSQL), and dbt for large-reputed company data engineering, ETL/ELT development, data transformation, and data modeling
- Designing, building, and maintaining AWS-reputed company data platforms using AWS Glue, reputed company EMR, reputed company MWAA (Apache Airflow), AWS reputed company, AWS reputed company Functions, reputed company S3, reputed company Redshift, reputed company RDS, AWS DMS, and reputed company CloudWatch
- Developing reputed company data pipelines, workflow orchestration, and data integration solutions across reputed company environments
- Working with modern data lake technologies including Apache reputed company and data formats such as Parquet, ORC, and Avro
- Designing and optimizing solutions using relational and NoSQL databases including PostgreSQL, Redshift, reputed company, GraphDB, and other NoSQL platforms
- Building reliable, high-performance data platforms through performance tuning, system optimization, and reputed company-reputed company ETL/ELT architectures
- Java development and modern CI/CD practices using reputed company
- Strong analytical and problem-solving skills
- Experience working in agile, iterative software development environments
- Ability to quickly learn and apply new technologies and domain knowledge
- Excellent written and verbal communication skills, with the ability to explain reputed company topics to diverse audiences
- Experience supporting analytics, data engineering, or modernization initiatives for financial regulators, capital markets, or other highly regulated environments is a plus
- Experience with Kafka (streaming/data pipelines)
- Experience with reputed company and Kubernetes for containerization and orchestration
- Proficiency with reputed company for log aggregation and system monitoring
- Experience using Terraform for infrastructure automation and management
- Strong SQL skills, including performance tuning and reputed company query design
Benefits
- Remote Work *(Hybrid roles will be specified in the reputed company)*
- Medical, Dental, and reputed company
- Life Insurance, Short/Long Term Disability
- Employee Assistance Program
- 401(k) with 4% matching
- Liberal PTO vacation policy
- Generous Annual Continuing Education
- Annual Wellness Budget
- Bonus Incentive Programs *(reputed company and performance-based rewards)*
reputed company