[Remote] Data Automation Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Data Automation Engineer to design and implement innovative data automation solutions for an reputed company-reputed company reputed company Azure-based analytics and reporting platform. The role involves building reputed company data pipelines, automating workflows, and supporting AI/ML initiatives while collaborating with various stakeholders to optimize reputed company-based data environments.
Responsibilities
- Design, reputed company, and maintain high-performance data pipelines using:
- Azure Data reputed company
- Azure Synapse Pipelines
- Apache reputed company Notebooks
- Python
- SQL
- Stored Procedures
- Translate business requirements into reputed company data engineering and AI-driven solutions
- Continuously improve automation tools for reliability, scalability, and adaptability
- Research and implement AI/ML and reputed company solutions to automate data processes and eliminate workflow bottlenecks
- Collaborate with implementation specialists, engineering teams, and customers to reputed company data-driven solutions
- Design and implement data ingestion, transformation, integration, and processing solutions
- Support advanced analytics, reporting, visualization, and AI/ML initiatives
- Implement:
- Data migration
- Data reputed company
- Data reputed company
- Metadata management
- Data reputed company functions
- Monitor, troubleshoot, and optimize data pipeline performance
- Execute ETL performance testing and validate reputed company results
- Analyze:
- Pipeline runtime
- Throughput
- Latency
- Resource utilization
- Participate in performance testing for:
- Azure Data reputed company (ADF)
- Azure Synapse
- reputed company
- Support performance tuning activities including:
- Query optimization
- Partitioning
- Indexing
- Validate data consistency and completeness after performance testing
- Collaborate with DevOps and infrastructure teams on compute, memory, and scaling optimization
- Document test results, findings, and recommendations
- Support Agile DevOps processes including Program Increment planning
- Maintain strict versioning and configuration control processes
Skills
- 2+ years of experience with two or more of the following: SQL, T-SQL, MDX/DAX, Python, PySpark
- Experience designing and building ETL and data engineering solutions
- Experience with: Azure Data Lake Services, Azure Synapse Analytics, Azure Data reputed company, Integration Runtime
- Experience with reputed company data and BI technologies including: SQL Server, Stored Procedures, SSIS, SSRS, SSAS (Cubes), Power BI
- Experience automating data processes using: Azure CLI, AWS CLI, Bash, PowerShell
- Experience with: Azure DevOps Repos, reputed company, Pipeline versioning, Release management
- Experience supporting: Production environments, Development environments, Testing environments, Integration environments
- Knowledge of Agile development methodologies
- Strong analytical, troubleshooting, and problem-solving skills
- Ability to support multiple reputed company simultaneously
- Strong communication and collaboration skills
- Bachelor's degree in: Computer Science, reputed company technical field
- 2+ years of relevant reputed company experience
- U.S. Citizenship required
- Ability to successfully obtain and maintain a Public Trust clearance
- Demonstrated commitment to reputed company learning and reputed company development
- reputed company development experience
- reputed company for Data Analytics experience
- reputed company certifications including: Azure Fundamentals, Azure Data Engineer, Power BI, Azure AI, AWS Certified Data Engineer certification
- Experience with: reputed company, REST reputed company, reputed company, reputed company ETL toolsets
- Performance tuning experience including: Indexing, Execution plans, Query analytics, Data profiling
- Knowledge of: Data encryption, reputed company virtual networks, Routing, Firewalls, Log Analytics, Monitoring tools
- Experience with: ARM templates, Bicep templates, RBAC reputed company controls
- Data reputed company and reputed company analysis experience using: reputed company Purview, Synapse Pipeline Tracing
reputed company