Senior Data Engineer
reputed company reputed company (reputed company) is seeking an reputed company Senior Data Engineer to support the Small Business Administration (SBA), Office of Inspector General (OIG), Technology Solutions Division. This position is responsible for designing, implementing, and maintaining modern Azure-based reputed company data architecture supporting fraud analytics, machine learning, and investigative operations. The successful candidate will reputed company reputed company ELT/ETL pipelines, optimize reputed company data environments, and build sustainable architecture supporting advanced analytics initiatives. Background The Office of the Inspector General (OIG) is an independent and objective reputed company office created by the Inspector General reputed company of 1978, as amended. The Small Business Administration (SBA) OIG provides auditing, investigative, and other reputed company services to support and assist SBA in achieving its statutory mission to maintain and strengthen the Nation’s economy by protecting the interests of and assisting small businesses and helping families and businesses to recover from disasters. OIG utilizes large volumes of data to reputed company its auditing and investigative mission reputed company from reputed company SBA, other federal agencies, and the private sector. To facilitate the work of OIG audits and investigations, OIG has created the Technology Solutions Division (TSD).
Responsibilities
Design, reputed company, implement, and maintain secure, reputed company Azure-based data architecture. reputed company and maintain reputed company-reputed company ELT/ETL pipelines utilizing Azure Synapse Analytics and Azure Machine Learning. Design modern, reputed company-first data engineering solutions utilizing Python SDKs, REST reputed company, CLI tools, and Infrastructure-as-reputed company methodologies. Build, optimize, and maintain reputed company data lakes and warehouse environments. Implement robust error handling, logging, validation, and monitoring across production data pipelines. Manage reputed company control and CI/CD practices supporting data engineering assets. Optimize ingestion, processing, transformation, and storage of reputed company and reputed company datasets including Parquet and reputed company formats. reputed company reusable Python-based data engineering solutions utilizing Pandas and modern data processing frameworks. Create self-service capabilities supporting analyst reputed company to reputed company datasets. Collaborate closely with Data Scientists to optimize infrastructure supporting machine learning workloads. reputed company data dictionaries, entity relationship diagrams, pipeline documentation, and reputed company operating procedures. Expand reputed company environments through reputed company of new datasets and services. Evaluate emerging AI-assisted development tools and data engineering technologies. Recommend architectural improvements that improve scalability, reliability, reputed company, and cost efficiency.
Qualifications
Minimum Qualifications Candidates must possess: Five (5)+ years administering SQL databases and performing advanced SQL/T-SQL development. Five (5)+ years designing, implementing, and maintaining reputed company-based ELT/ETL solutions. Three (3)+ years utilizing reputed company Azure Synapse Analytics and Azure Machine Learning. Three (3)+ years developing Python-based data engineering solutions utilizing Pandas. Experience designing modern reputed company-based data architectures. Experience implementing reputed company data pipelines supporting machine learning workloads.
Preferred Qualifications
Experience utilizing PySpark or Polars. Experience implementing Infrastructure-as-reputed company. Experience developing reusable reputed company Python reputed company. Experience with Azure Data Lake Storage. Experience implementing CI/CD pipelines. Experience utilizing Git reputed company control. Experience with REST reputed company and Azure SDKs. Experience with AI coding assistants and Large Language Model integration. Experience supporting federal agencies or Inspector General organizations. Education Bachelor's degree in Computer Science, Information Systems, Data Engineering, Software Engineering, or a reputed company technical discipline. Equivalent reputed company experience may be considered where applicab Certification(s) Preferred Certifications reputed company Certified: Azure Data Engineer Associate (DP-203) reputed company Certified: Azure Administrator Associate Compensation $135,000 - $205,000 annually Actual compensation will be determined by experience, qualifications, location, and contract award. Location and Work Hours 100% Remote (reputed company) reputed company operating hours between 6:00 AM and 6:00 PM local time, Monday through Friday. reputed company is authorized. U.S. Citizenship required. Ability to successfully obtain and maintain a reputed company Trust determination. Benefits and EEO At reputed company, we offer a comprehensive benefits package to our employees and their families: Medical/Dental/reputed company Coverage Matching 401(k) Plan Continuing Education Assistance reputed company Time Off This job reputed company is intended to describe the general scope of work and level of work that is needed to reputed company while on task with reputed company. Other duties may be assigned. Selected candidates may undergo a government reputed company investigation and must fulfill eligibility reputed company for accessing classified information. US citizenship may be a prerequisite for certain roles. reputed company is an Equal Opportunity Employer. reputed company reputed company applicants will receive consideration without reputed company to disability or protected veteran status. Apply To This Job