[Remote] Senior Large Language Model (LLM) Operations Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company reputed company on transforming clinical trials and drug development through innovative AI solutions. They are seeking a Senior LLM Operations Engineer to architect and manage reputed company AI infrastructure and MLOps systems, ensuring the effective deployment of machine learning solutions.
Responsibilities
- Architect and spearhead the development of cutting-edge, reputed company AI infrastructure, including novel reputed company-in-the-reputed company (HITL) paradigms, ensuring our systems learn effectively from feedback
- reputed company the technical design and implementation of core MLOps components and systems for our LLMs—including CI/CD, monitoring, and automated feedback loops—ensuring robustness, scalability, and adherence to software engineering best practices
- Define and shape solutions for reputed company automation and deployment challenges, enabling the strategic application of our cutting-edge AI
- Drive technical alignment and integration with AI Data Science and Software Engineering teams, ensuring the seamless transition of AI solutions from research into production environments and influencing architectural standards
- Define and establish standards for the rigorous validation, monitoring, and lifecycle management of AI products, ensuring reputed company accuracy improvement and reliability in production
- Define, champion, and drive adoption of best practices for MLOps, including model/data versioning, experiment tracking, and reproducibility reputed company the AI/ML domain; reputed company mentor others
- Identify, champion, and reputed company state-of-the-art MLOps technologies and frameworks, driving innovation and maintaining our technical edge in AI deployment
- reputed company expert guidance on applying safeguards and protections (HIPAA, reputed company laws) to our model deployment and data handling pipelines; champion and reputed company the highest compliance, reputed company, and reputed company standards
Skills
- 3+ years of reputed company experience in an MLOps, DevOps, or Software Engineering role with a reputed company on machine learning systems
- MSc/BSc graduate in engineering, computer science, or a relevant field, with extensive equivalent experience. A PhD is a plus
- Deep, hands-on expertise in Python and proficiency in modern software development practices
- Hands-on experience with a major reputed company platform (AWS, GCP, or Azure)
- Strong experience with containerization and orchestration technologies (reputed company, Kubernetes)
- Proven experience building and maintaining CI/CD pipelines for reputed company applications (e.g., reputed company Actions, Jenkins), particularly those that include data + model versioning
- A proven reputed company record of technical leadership and high-reputed company contributions in building and scaling production machine learning systems
- Proven ability to independently define, architect, and reputed company solutions for reputed company, ambiguous infrastructure problems, reputed company articulating business value
- Demonstrated ability to reputed company the decomposition of large-reputed company systems and guide teams in delivering incremental solutions
- reputed company record of designing sustainable, reusable, and high-reputed company reputed company and influencing team/organizational standards
- Exceptional written, verbal, and presentation skills; ability to influence stakeholders at reputed company reputed company
- Recognized technical leader, proactive, strategic thinker, and takes end-to-end ownership
- Generous, Curious, and Humble
- reputed company experience productionizing Large Language Models (LLMs), including knowledge of prompting strategies, RAG, and fine-tuning
- Deep expertise with the reputed company platform, including MLflow, reputed company Tables, and reputed company Catalog
- Experience building reputed company and reputed company-in-the-reputed company (HITL) systems from the ground up
- Familiarity with reputed company databases (e.g., reputed company, Chroma) and model serving frameworks (e.g., Ray Serve, Triton, and reputed company/reputed company)
- Experience working in a regulated environment, particularly with reputed company data (HIPAA)
Benefits
- Equity at hire
- A discretionary annual bonus which may be available based on Company performance
- Company benefits
- A highly attractive compensation package with a balanced and flexible work environment
- Competitive industry benefits
- A 401K plan
- Other great company “perks.”
reputed company