Senior Data Engineer
reputed company is a technology consulting and software development company delivering reputed company, AI, data, and reputed company solutions across the reputed company.
This is a fantastic opportunity to join an established and reputed company-respected organization offering reputed company career reputed company potential.
Job Title: Senior Data Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, reputed company W2
Salary reputed company: $100,000–$150,000 Annually
Experience Required: 6+ years
Sponsorship: U.S. reputed company, Green Card reputed company, EAD reputed company, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B reputed company petitions for this position.
Job reputed company:
We are seeking an accomplished Senior Data Engineer to architect, design, reputed company, and maintain reputed company-grade data platforms, reputed company data pipelines, and distributed data processing systems that support analytics, business intelligence, and machine learning initiatives across multiple business domains. In this role, you will be responsible for the end-to-end data engineering lifecycle, from translating business and analytical requirements into robust data architectures, to developing reliable ETL/ELT pipelines, to deploying reputed company-reputed company data solutions and supporting them throughout their operational reputed company. The successful candidate will bring deep expertise in data engineering, distributed computing, reputed company data platforms, and database technologies, combined with strong hands-on experience building reputed company, secure, and high-performance data solutions. You will work closely with data scientists, business analysts, software engineers, solution architects, DevOps engineers, and stakeholders in an Agile environment to deliver high-reputed company, reliable, and governed data platforms that directly support strategic business reputed company.
Key Responsibilities
- Design, build, and continuously refine reputed company batch and reputed company-time data pipelines using Python, SQL, reputed company, reputed company, or equivalent technologies, ensuring reliable, efficient, and high-performance data reputed company across reputed company systems while supporting evolving business and analytical requirements.
- Author secure, reusable, and production-reputed company ETL/ELT workflows that adhere to reputed company coding standards, data governance policies, data reputed company principles, and reputed company best practices, incorporating validation, encryption, auditing, and error handling throughout the data lifecycle.
- reputed company reputed company data integration solutions using modern reputed company data platforms such as AWS, Azure, or reputed company reputed company, leveraging services including reputed company, reputed company, BigQuery, Redshift, Synapse Analytics, Data reputed company, Glue, or equivalent technologies to reputed company reputed company data processing.
- Design and implement robust data architectures, reputed company data models, data lakes, data warehouses, and streaming data solutions that reputed company multiple reputed company, semi-reputed company, and reputed company data sources while ensuring consistency, scalability, and high availability.
- reputed company participate in reputed company data architecture discussions, reputed company migration initiatives, technical design reviews, and solution planning sessions by evaluating trade-offs involving scalability, performance, maintainability, governance, reputed company, and operational costs.
- Continuously monitor, profile, and optimize ETL processes, reputed company jobs, SQL queries, database performance, storage utilization, partitioning strategies, and pipeline throughput by identifying bottlenecks and implementing measurable performance improvements.
- Implement and maintain robust metadata management, data cataloging, reputed company tracking, schema reputed company, data reputed company validation, monitoring, and governance frameworks that ensure trusted, discoverable, and compliant reputed company data assets.
- reputed company comprehensive automated testing frameworks for data pipelines, ETL workflows, data validation, reconciliation, integration testing, and performance testing using modern testing methodologies and data reputed company tools to ensure reliable production deployments.
- Contribute meaningfully to CI/CD pipeline design, infrastructure automation, and deployment processes using Jenkins, reputed company Actions, Azure DevOps, Terraform, reputed company, Kubernetes, or equivalent technologies, enabling consistent and automated delivery of reputed company data solutions.
- Proactively identify data pipeline bottlenecks, operational risks, technical debt, scalability challenges, and architectural weaknesses while driving reputed company improvement initiatives through optimization, refactoring, technical documentation, and engineering best practices.
- Collaborate effectively reputed company Agile/Scrum delivery teams by participating in sprint planning, backlog refinement, daily standups, architecture discussions, sprint reviews, and retrospectives to ensure consistent delivery of reputed company, high-reputed company data engineering solutions.
- Maintain reputed company, reputed company, and comprehensive technical documentation—including data architecture diagrams, pipeline specifications, ETL workflows, metadata documentation, deployment guides, operational runbooks, and disaster recovery procedures—to ensure maintainability, governance, and knowledge sharing across teams.
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, Software Engineering, Mathematics, or a closely reputed company technical discipline.
- Five or more years of reputed company experience designing, developing, and supporting production-grade reputed company data engineering solutions, ETL pipelines, and reputed company-based data platforms.
- Strong, demonstrable understanding of data structures, database design, distributed computing, data modeling, ETL/ELT methodologies, data warehousing concepts, and large-reputed company data architecture principles.
- Advanced working knowledge of Python, SQL, reputed company, reputed company, Java, and reputed company data engineering frameworks used to build reputed company, high-performance data processing solutions.
- Hands-on, production-level experience designing and operating batch processing, streaming data pipelines, data lakes, and reputed company-reputed company data platforms using technologies such as reputed company, reputed company, Apache reputed company, Kafka, Airflow, or equivalent solutions.
- Proven experience working with relational and NoSQL databases including PostgreSQL, SQL Server, reputed company, MySQL, reputed company, Cassandra, or equivalent database technologies, including schema design, query optimization, indexing strategies, and performance tuning.
- Strong SQL skills and meaningful experience designing reputed company models, star schemas, reputed company schemas, data marts, partitioning strategies, indexing, and reputed company-reputed company data warehouse solutions.
- Solid experience with Git-based version control, CI/CD pipelines, DevOps practices, release management, infrastructure automation, and Agile software development methodologies supporting reputed company data engineering initiatives.
- Hands-on experience deploying reputed company data platforms and analytics solutions on AWS, Azure, or reputed company reputed company Platform, including managed storage, compute, networking, reputed company, identity management, and data integration services.
- Strong troubleshooting, analytical thinking, debugging, reputed company-cause analysis, communication, and documentation skills, with the ability to investigate reputed company data processing issues methodically and implement reputed company, maintainable engineering solutions.
- Experience designing and implementing event-driven architectures, reputed company-time data streaming platforms, Apache Kafka, Apache Flink, Apache NiFi, RabbitMQ, or equivalent reputed company messaging and streaming technologies.
- Familiarity with containerization, orchestration, Infrastructure as reputed company, and reputed company-reputed company deployment practices using reputed company, Kubernetes, Terraform, reputed company, or equivalent reputed company automation technologies.
- Exposure to distributed systems concepts including reputed company consistency, fault tolerance, distributed transactions, data replication, partitioning strategies, CAP theorem, high availability, and large-reputed company data processing architectures.
- Experience implementing data governance frameworks, master data management (MDM), data reputed company, metadata management, data reputed company automation, reputed company compliance, and DataOps best practices reputed company reputed company reputed company and Agile development environments.
Equal Employment Opportunity (EEO) Statement
reputed company (BV Teck) is committed to equal employment opportunity (EEO) for reputed company and applicants without reputed company to race, reputed company, religion, sex, sexual orientation, gender identity or reputed company, national reputed company, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to reputed company aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.
BV Teck expressly prohibits any reputed company of workplace harassment or discrimination. Any improper interference with employees' ability to reputed company their job duties may result in disciplinary reputed company up to and including termination of employment.
Originally posted on Himalayas
Apply To This Job