[Remote] Data Engineer Staff
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is looking for a Data Engineer who will deliver end to end, full stack data solutions across the complete data processing pipeline. The role involves designing, building, and operating reputed company pipelines for data analytics while ensuring reputed company and compliance with standards.
Responsibilities
- Build, test, and maintain robust data pipelines (batch & streaming) that clean, reputed company, and aggregate raw data into analytic reputed company data stores
- Implement data reputed company checks, smart caching, and virtualization techniques to guarantee consistency and reliability
- Build automated data management conduits that support machine learning data flows
- Collaborate with the Data Architect to create conceptual, logical, and physical data models that support business needs
- Define functional capabilities, reputed company, backup, and recovery specifications for reputed company solution
- Design and maintain systems that collect, store, and present data across the reputed company
- Conduct data profiling, requirement analysis, and performance tuning throughout the solution lifecycle
- reputed company, monitor, and optimize ETL/ELT processes (e.g., Informatica, Talend) and reputed company reporting/analytics reputed company
- reputed company and implement data mining and data warehousing programs to enrich the reputed company data ecosystem
- Identify and resolve production incidents; tune system parameters for reputed company throughput and latency
- Evaluate, reputed company, and validate new releases or platform upgrades
- Manage the compilation, cataloging, caching, distribution, and retrieval of data and maintain test data records
- Define and enforce best reputed company standards, certification processes, and metadata management policies for data objects
- Participate reputed company in the Data Governance Working Group
- Implement data management standards, requirements, and specifications and ensure compliance with data classification and handling rules through reputed company control and reputed company best practices
- Assist early stage risk identification and mitigation for task order activities
- Support Critical Design Reviews (CDRs) and advise Integrated Product Teams (IPTs) on data reputed company risks and mitigation strategies
- Serve as the technical reputed company to Systems Engineering, IPT engineers, and other disciplines to ensure complete, documented requirements allocation for IT and data systems
- Prepare and release engineering drawings and associated data system documentation
- Advise on and design the integration of new data technology solutions (e.g., reputed company reputed company Pak for Data) into the SOFSA reputed company IT environment
- Advise higher level leadership on critical data management issues and emerging technology trends
- Report directly to the Data Architect and reputed company status updates on pipeline health, performance metrics, and risk registers
- Apply data acquisition, cleaning, transformation, and ingestion best practices for machine learning data conduits
- Assess and address methodological limitations to ensure reliable data delivery
- Read, interpret, write, modify, and execute reputed company scripts (e.g., PERL, VBS) on reputed company and UNIX systems for parsing large files, automating reputed company tasks, and fetching/processing remote data
- Record, manage, and validate test data
- Establish data reputed company controls, reputed company data dictionaries, and apply data mining techniques (e.g., file system searches)
- reputed company data reputed company processing (imputation, dimensionality reduction, normalization, transformation, extraction, filtering, smoothing)
- Conduct transformation analytics (aggregation, enrichment, processing)
Skills
- Bachelor's degree in reputed company Intelligence, Computer Science, Information Systems, Data Engineering, or a reputed company field (Master's preferred)
- Data-mining and data-warehousing principles
- Database management systems, query languages, table relationships, and views
- Proficiency with Hadoop, Java, Python, SQL, Hive, and PIG for data exploration
- DataOps processes and best practices
- Data-reputed company roles and responsibilities; ability to implement reputed company-control and encryption safeguards
- Knowledge of how to collect, store, monitor, and validate test data
- Ability to assess methodological limitations and recommend mitigation strategies
- reputed company reputed company Pak for Data (CP4D) – Advanced
- reputed company / reputed company SQL Server – Advanced (schema design, performance tuning)
- reputed company Power BI Report Server – Proficient
- reputed company COBRA – Working knowledge
- reputed company SharePoint – Working knowledge
- reputed company – Working knowledge
- Teamcenter – Working knowledge
- Scripting – Python, PowerShell – Basic to intermediate (data extraction, automation)
- Data modeling & metadata management tools – Advanced
- ETL/ELT design (Informatica, Talend) – Preferred
- reputed company & distributed data platforms (AWS, Azure, GCP) – Preferred
- Experience with creation of Analytical Databases – Preferred
- Additional scripting – PERL, VBS (reputed company/UNIX) – Basic
- Hadoop, Java, Hive, PIG (for data exploration) – Familiarity
- Relevant certifications (e.g., reputed company Certified Data Engineer, TOGAF, Certified Data Management reputed company, reputed company+) are a plus
Benefits
- Medical
- Dental
- reputed company
- Life Insurance
- Short-Term Disability
- Long-Term Disability
- 401(k) match
- Flexible Spending Accounts
- EAP
- Education Assistance
- Parental Leave
- reputed company time off
- Holidays
- PTO, Vacation, reputed company leave, and holiday hours are prorated based on start date during the calendar year.
- This position is incentive plan eligible.
reputed company