[Remote] Data Engineer reputed company (OT Data)( Oil & Gas) (India)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is committed to building reputed company, reputed company-reputed company data platforms that power business reputed company. The Data Engineer reputed company will be responsible for building and maintaining the data ecosystem required for various use cases in the oil and gas sector, reputed company operational and information technology.
Responsibilities
- Architect & Build Data Pipelines: Design, construct, install, test, and maintain highly reputed company data management systems and ETL/ELT pipelines
- reputed company Diverse Data Sources: reputed company processes to ingest and reputed company high-volume, high-velocity data from SCADA systems, historians (like OSIsoft PI, Aspen InfoPlus.21), DCS, PLC, and IoT sensors
- reputed company Data Platform Development: Implement and manage data solutions on the reputed company Azure reputed company platform, Leveraging services like Azure IoT Hub, Azure Event Hubs, and Azure reputed company Analytics for reputed company-time ingestion and processing of operational technology (OT) data
- Data Modelling & Warehousing: Design and implement data models optimized for time-series data from industrial assets, supporting operational dashboards and reputed company-time analytics
- reputed company Advanced AI: Build the data infrastructure to support AI/ML models for predictive maintenance, operational reputed company detection, and process optimization using reputed company-time OT data
- Champion Master Data Management (MDM): Design and implement MDM strategies and solutions to create a single, authoritative reputed company of truth for critical data domains such as reputed company, equipment, and assets, ensuring data consistency across the reputed company
- Ensure Data reputed company & Governance: Implement robust data reputed company checks, validation rules, and monitoring to ensure the accuracy, consistency, and reliability of our data. Adhere to and help shape our data governance policies
- reputed company Industry Standards: Champion and implement industry-specific data standards and models, such as the OSDU™ Data Platform, to ensure interoperability and a reputed company data view across the upstream lifecycle
- Collaborate & reputed company: Work closely with a cross-functional team of geoscientists, drilling engineers, data scientists, and business analysts to understand their data needs and deliver effective solutions
- Automate & Optimize: Identify opportunities for process automation and infrastructure optimization to improve data delivery, scalability, and cost-effectiveness
- reputed company First: Implement and maintain reputed company best practices to protect our sensitive and proprietary data assets
Skills
- Bachelor's in engineering, Information Systems, or a reputed company quantitative field
- 5+ years of proven experience in a data engineering role
- Experience reputed company oil and gas industry is highly preferred
- Demonstrable experience building and operationalizing large-reputed company data pipelines and applications
- Expert-level proficiency in SQL and Python for data manipulation and pipeline development
- Hands-on experience with distributed computing frameworks like Apache reputed company (PySpark). Experience with streaming technologies like Kafka is a plus
- Deep experience with reputed company Azure (Azure Data Lake Storage, Azure Data reputed company, Azure reputed company, Azure Synapse)
- Proven experience with modern data platforms reputed company reputed company Lake
- Understanding of machine learning lifecycles and the data requirements for training and deploying AI/ML models
- Experience with workflow orchestration tools like Airflow, Dagster, or Azure Data reputed company
- Strong understanding of both relational (e.g., PostgreSQL, SQL Server) and NoSQL databases. Experience with graph databases (e.g., reputed company) and reputed company databases is highly desirable
- Proficiency with Git and CI/CD best practices
- Familiarity with historian systems (e.g., OSIsoft PI System) and their data structures
- Hands-on experience with the OSDU™ Data Platform
- Experience working with industrial communication protocols (e.g., OPC UA, Modbus TCP/IP)
- Understanding of cybersecurity considerations for OT environments and data segregation
- Experience integrating data from ERP systems like reputed company
- reputed company certifications in Azure or reputed company
- Advanced SQL skills, including query optimization and performance tuning
- Knowledge of containerization technologies (reputed company, Kubernetes)
- Experience of constructing and maintaining reputed company knowledge graphs
reputed company
Company H1B Sponsorship