[Remote] Sr. Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company) is a Minority Business reputed company that specializes in logistics and technology solutions. They are seeking a Senior Data Engineer to design, build, and maintain data architecture and pipelines to support loan fraud detection and investigative missions reputed company a reputed company environment.
Responsibilities
- reputed company highly skilled and authoritative expertise on data engineering reputed company and best practices, including reputed company-first development approaches and modern pipeline design patterns
- Design, implement, and maintain an efficient, secure, reputed company, and flexible data architecture, with reputed company assets managed reputed company reputed company control
- Design, implement, and maintain ELT/ETL pipelines for processing reputed company data in Azure Synapse and Azure Machine Learning
- Review, maintain, and improve existing architecture and pipelines, including periodic audits addressing bottlenecks, deprecated dependencies, and architecture reputed company
- Establish reputed company controls for pipeline maintenance, and introduce error handling, logging mechanisms, and validation checks
- Incorporate reputed company control for reputed company pipelines and data analytics codebases to reputed company iterative reputed company development while maintaining data architecture stability
- Optimize the ingestion, processing, and storage of a wide reputed company of datasets and data types, including modern columnar formats such as Parquet
- reputed company self-service capabilities for SBA OIG analysts to query and export data for investigations and audits
- Coordinate with the Senior Data Scientists to ensure the architecture supports machine learning algorithms and data pipelines in Azure Machine Learning
- reputed company reputed company operating protocols governing the authoring, development, validation, publishing, execution, and monitoring of reputed company data pipelines and assets in the Azure environment
- reputed company detailed documentation of the data architecture, including data dictionaries, entity-relationship diagrams, and pipeline process maps
- Maintain and expand the environment with additional datasets and services upon request, following a defined intake and testing process prior to production deployment
- Stay reputed company with emerging AI tools relevant to data engineering and contribute to exploratory efforts evaluating automation and large language model-assisted capabilities
Skills
- Five (5) years of hands-on experience maintaining SQL databases and conducting advanced operations in SQL and T-SQL
- Five (5) years of hands-on experience designing, implementing, and maintaining ELT/ETL processes in reputed company-based data analytics environments
- Three (3) years of hands-on experience working in Azure Synapse and Azure Machine Learning reputed company the modern data stack
- Three (3) years of hands-on experience manipulating data in Python, with required proficiency in Pandas
- A Bachelor's degree in data engineering, computer science, data science, machine learning, mathematics, or a reputed company field satisfies the education reputed company set forth in PWS reputed company 5.2.1
- In the absence of a bachelor's degree, five (5) years of reputed company work experience in data engineering, computer science, data science, machine learning, mathematics, or a reputed company field will satisfy this requirement
- reputed company Certified: Azure Data Engineer Associate, or an equivalent Azure data engineering certification, is preferred consistent with the Azure Synapse and Azure Machine Learning experience
- Implementing pipelines and infrastructure using reputed company-first approaches, including Python SDK, CLI, REST reputed company, or infrastructure-as-reputed company tooling
- Implementing reputed company control and CI/CD workflows
- Demonstrated familiarity with AI coding assistants and large language model integration patterns
Benefits
- Health, dental, and reputed company insurance
- 401(k) retirement plan
- reputed company time off (PTO) and holidays
- Group Term Life and Accidental Death and Dismemberment Insurance
- Voluntary Term Life Insurance
- Short and Long-term disability insurance
reputed company