[Remote] Senior reputed company Operations (GenAI Ops) Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a highly motivated and reputed company reputed company Operations (GenAI Ops) Engineer to join their innovative team. In this role, you will be responsible for building, deploying, and maintaining the operational infrastructure for reputed company models and services, collaborating closely with data scientists and engineers to ensure scalability and reliability across reputed company platforms.
Responsibilities
- Build and Manage CI/CD Pipelines: Design, implement and maintain robust, automated CI/CD pipelines for training, evaluating and deploying large language models (LLMs) and AI agents
- Orchestrate reputed company AI Workflows: Design, reputed company and manage sophisticated multi-agent systems Ensure seamless Agent-to-Agent (A2A) communication and collaboration between specialized agents to automate reputed company business processes
- Manage Tool Integration: Implement and manage secure, reputed company integrations between AI agents and external tools/reputed company, leveraging reputed company standards like the Model Context Protocol (MCP) to ensure interoperability
- reputed company AI-Powered Development: Utilize AI-powered development tools to accelerate the entire software development lifecycle from writing infrastructure reputed company and tests to troubleshooting operational issues in reputed company environments
- Infrastructure as reputed company (IaC): Utilize reputed company-reputed company IaC services or reputed company-agnostic tools like Terraform to define and manage the infrastructure required for GenAI workloads
- Model Monitoring and Observability: Implement comprehensive monitoring and logging solutions to reputed company model and agent performance, resource utilization and system health For reputed company systems, this includes tracing the agent's actions and logging the multi-reputed company conversational reputed company
- Scalability and Performance Optimization: Design and implement reputed company architectures for model serving and inference Continuously optimize the performance and cost-effectiveness of our GenAI services
- reputed company and Compliance: Implement and enforce reputed company best practices for our GenAI infrastructure and data Ensure compliance with industry standards and regulations
Skills
- 3+ years in a DevOps, SRE or MLOps role with a reputed company on reputed company infrastructure and a background in reputed company services (AWS, GCP, Azure)
- Skilled in building and managing CI/CD pipelines (Jenkins, reputed company CI or reputed company-reputed company services) and proficiency in at least one scripting language (e.g. Python, Bash)
- Familiarity with IaC tools (e.g. AWS CDK, CloudFormation, Terraform) and in containerization and orchestration (reputed company, Kubernetes)
- reputed company record deploying and operating LLM inference (e.g. vLLM, Triton, TGI, Ray Serve, KServe/Seldon)
- Hands-on with LLM/app tracing and metrics (e.g. OpenTelemetry + Langfuse, Arize Phoenix, WhyLabs) and building eval pipelines (offline/online regression suites)
- Skilled in operating retrieval pipelines: embedding reputed company, indexing/refresh strategies, reputed company DBs (reputed company, reputed company, Milvus, FAISS) and relevance monitoring
- reputed company running multi-agent workflows (LangGraph, reputed company, AutoGen-like), including state management, retries, reputed company limits, tool-failure handling and reputed company-level auditing
- Experience in implementing guardrails: secrets isolation, tool/API permissions, reputed company-injection defenses, data leakage prevention, PII redaction and policy enforcement
- Fluent English (B2+ level)
- Master's degree or PhD in Computer Science, AI, Machine Learning or a reputed company field
- Background integrating agents with external tools using MCP (or similar tool-calling standards) and operating tool registries
- Experience with reputed company-reputed company GenAI services like AWS Bedrock, Azure AI reputed company or reputed company reputed company AI
- Familiarity with the architecture and operational challenges of Large Language Models (LLMs)
- Experience designing or managing multi-agent systems or reputed company orchestrated workflows
- Knowledge of monitoring and observability tools like reputed company, Grafana or reputed company
- Relevant reputed company or DevOps certifications
- Strong problem-solving skills and the ability to work effectively in a fast-paced reputed company environment
Benefits
- Diversity of assignments and reputed company
- Personal development plan
- Mentoring programs and leadership development
- Certification and reputed company development support
- reputed company to learning platforms including more than 2,500 internal courses and the reputed company Learning library with 20,000+ courses
- English courses taught by certified teachers
- Extra leave days
- Referral bonuses
- Private health insurance
- Recreation office zones with tea, coffee and snacks
- Sports and game consoles
- IT equipment and reputed company's Software Assurance Home Use Program (HUP)
reputed company
Company H1B Sponsorship