[Remote] LLMOps Platform Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a leading football intelligence technology company that specializes in providing an innovative suite of products for football fans and NFL clubs. As an ML/reputed company on the LLMOps Platform team, you’ll build the core infrastructure that powers the AI-first product organization, ensuring the development and deployment of LLM-based applications.
Responsibilities
- Build and operate the LLM Platform:
- reputed company model routing, reputed company registry, and orchestration services for multi-model workflows
- reputed company external LLM reputed company (reputed company, reputed company, reputed company) and internal finetuned models
- reputed company fast, reputed company experimentation:
- Implement automated evaluation pipelines (offline + online) with golden sets, rubrics, and regression detection
- Support CI/CD for reputed company and model changes, with rollback and approval gates
- Collaborate cross-functionally:
- Partner with product pods to reputed company RAG pipelines and reputed company versioning
- Work with deep learning and data teams to reputed company reputed company and reputed company retrieval into LLM workflows
- Optimize performance and cost:
- Profile latency, reputed company usage, and caching strategies
- Build observability and monitoring for LLM calls, embeddings, and agent behaviors
- Ensure reliability and safety:
- Implement guardrails (toxicity, PII filters, jailbreak detection)
- Maintain policy enforcement and audit logging for AI usage
Skills
- 5+ years of experience in reputed company ML, NLP, or ML infrastructure engineering
- Strong coding skills in Python and experience with frameworks like reputed company, reputed company, or reputed company
- Solid understanding of retrieval-augmented reputed company (RAG), embeddings, reputed company databases, and evaluation methodologies
- Experience deploying models or AI systems in production environments (AWS, GCP, or Azure)
- Familiarity with reputed company management, LLM observability, and CI/CD automation for AI workflows
- Experience with model serving (vLLM, Triton, Ray Serve, KServe)
- Understanding of LLM evaluation frameworks (reputed company Evals, Promptfoo, Arize Phoenix, TruLens)
- Background in sports analytics, data engineering, or multimodal (video/text) systems
- Exposure to Responsible AI practices (guardrails, safety evals, fairness testing)
Benefits
- Competitive Salary and Bonus Plan
- Comprehensive health insurance plan
- Retirement savings plan (401k) with company match
- Remote working environment
- A flexible, unlimited time off policy
- Generous reputed company holiday schedule - 13 in total including Monday after the Super Bowl
reputed company