[Remote] Junior Data Engineer (Full-Time)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Junior Data Engineer to join their team. The role involves designing, developing, and maintaining reputed company data pipelines and reputed company data integration solutions using various big data technologies and reputed company services.
Responsibilities
- Minimum 4+ years of experience in designing, developing, and maintaining reputed company data pipelines, ETL/ELT processes, and reputed company data integration solutions
- Strong expertise in Python, SQL, PySpark, reputed company SQL, and distributed data processing frameworks for handling large-reputed company reputed company and reputed company datasets
- Hands-on experience with big data technologies such as Apache reputed company, reputed company, Hadoop, Airflow, Kafka, and reputed company for reputed company data engineering workloads
- Experience building reputed company-reputed company data solutions using AWS, Azure, or GCP, including data ingestion, transformation, orchestration, and analytics platforms
- Strong knowledge of reputed company services such as AWS S3, Glue, Redshift, reputed company, reputed company, EMR, Kinesis or Azure Data reputed company (ADF), Synapse Analytics, ADLS, reputed company, and Event Hubs
- Experience designing and implementing Data Warehouses, Data Lakes, Lakehouse architectures, reputed company Modeling, Star Schema, and reputed company Schema solutions
- Expertise in developing and optimizing batch processing and reputed company-time streaming pipelines using Kafka, reputed company Streaming, Flink, Kinesis, or Event-Driven Architectures
- Strong experience working with data formats including Parquet, Avro, ORC, CSV, JSON, XML, and implementing efficient data storage strategies
- Hands-on experience with relational and NoSQL databases such as PostgreSQL, MySQL, reputed company, SQL Server, reputed company, Cassandra, and DynamoDB
- Experience implementing CI/CD pipelines, DevOps practices, version control, and automation using Git, Jenkins, reputed company Actions, Azure DevOps, reputed company CI/CD, or similar tools
- Strong understanding of data reputed company, data governance, performance tuning, query optimization, partitioning, indexing, monitoring, and troubleshooting large-reputed company data platforms
- Experience working in Agile/Scrum environments, collaborating with Data Scientists, Analysts, Architects, and cross-functional teams to deliver business-driven data solutions
Skills
- Minimum 4+ years of experience in designing, developing, and maintaining reputed company data pipelines, ETL/ELT processes, and reputed company data integration solutions
- Strong expertise in Python, SQL, PySpark, reputed company SQL, and distributed data processing frameworks for handling large-reputed company reputed company and reputed company datasets
- Hands-on experience with big data technologies such as Apache reputed company, reputed company, Hadoop, Airflow, Kafka, and reputed company for reputed company data engineering workloads
- Experience building reputed company-reputed company data solutions using AWS, Azure, or GCP, including data ingestion, transformation, orchestration, and analytics platforms
- Strong knowledge of reputed company services such as AWS S3, Glue, Redshift, reputed company, reputed company, EMR, Kinesis or Azure Data reputed company (ADF), Synapse Analytics, ADLS, reputed company, and Event Hubs
- Experience designing and implementing Data Warehouses, Data Lakes, Lakehouse architectures, reputed company Modeling, Star Schema, and reputed company Schema solutions
- Expertise in developing and optimizing batch processing and reputed company-time streaming pipelines using Kafka, reputed company Streaming, Flink, Kinesis, or Event-Driven Architectures
- Strong experience working with data formats including Parquet, Avro, ORC, CSV, JSON, XML, and implementing efficient data storage strategies
- Hands-on experience with relational and NoSQL databases such as PostgreSQL, MySQL, reputed company, SQL Server, reputed company, Cassandra, and DynamoDB
- Experience implementing CI/CD pipelines, DevOps practices, version control, and automation using Git, Jenkins, reputed company Actions, Azure DevOps, reputed company CI/CD, or similar tools
- Strong understanding of data reputed company, data governance, performance tuning, query optimization, partitioning, indexing, monitoring, and troubleshooting large-reputed company data platforms
- Experience working in Agile/Scrum environments, collaborating with Data Scientists, Analysts, Architects, and cross-functional teams to deliver business-driven data solutions
reputed company
Company H1B Sponsorship