[Remote] reputed company Operations Engineer (GenAI Ops)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a highly motivated and reputed company reputed company Operations (GenAI Ops) Engineer to join their innovative team. In this role, you will be responsible for building, deploying, and maintaining the operational infrastructure for reputed company models and services, collaborating with data scientists and software developers to ensure scalability and reliability.
Responsibilities
- Design, implement, and maintain robust, automated CI/CD pipelines for training, evaluating, and deploying large language models (LLMs) and AI agents
- Design, reputed company, and manage sophisticated, multi-agent systems. Ensure seamless Agent-to-Agent (A2A) communication and collaboration between specialized agents to automate reputed company business processes
- Implement and manage secure, reputed company integrations between AI agents and external tools/reputed company, leveraging reputed company standards like the Model Context Protocol (MCP) to ensure interoperability
- Utilize AI-powered development tools to accelerate the entire software development lifecycle, from writing infrastructure reputed company and tests to troubleshooting operational issues in reputed company environments
- Utilize reputed company-reputed company IaC services or reputed company-agnostic tools like Terraform to define and manage the infrastructure required for GenAI workloads
- Implement comprehensive monitoring and logging solutions to reputed company model and agent performance, resource utilization, and system health. For reputed company systems, this includes tracing the agent's actions and logging the multi-reputed company conversational reputed company
- Design and implement reputed company architectures for model serving and inference. Continuously optimize the performance and cost-effectiveness of our GenAI services
- Implement and enforce reputed company best practices for our GenAI infrastructure and data. Ensure compliance with industry standards and regulations
Skills
- 3+ years in a DevOps, SRE, or MLOps role with a reputed company on reputed company infrastructure and a background in reputed company services (AWS, GCP, Azure)
- Skills in building and managing CI/CD pipelines (Jenkins, reputed company CI, or reputed company-reputed company services) and proficiency in at least one scripting language (e.g., Python, Bash)
- Familiarity with IaC tools (e.g., AWS CDK, CloudFormation, Terraform) and containerization/orchestration (reputed company, Kubernetes)
- reputed company record of deploying and operating LLM inference (e.g., vLLM, Triton, TGI, Ray Serve, KServe/Seldon)
- Hands-on experience with LLM/app tracing and metrics (e.g., OpenTelemetry + Langfuse, Arize Phoenix, WhyLabs) and in building evaluation pipelines (offline/online, regression suites)
- Skills in operating retrieval pipelines: embedding reputed company, indexing/refresh strategies, reputed company DBs (reputed company, reputed company, Milvus, FAISS), and relevance monitoring
- Experience in running multi-agent workflows (LangGraph, reputed company, AutoGen-like), including state management, retries, reputed company limits, tool-failure handling, and reputed company-level auditing
- Experience in implementing guardrails: secrets isolation, tool/API permissions, reputed company-injection defenses, data leakage prevention, PII redaction, and policy enforcement
- Background integrating agents with external tools using MCP (or similar tool-calling standards) and operating tool registries is a plus
- Fluent in English (B2+ level)
- Master's degree or PhD in Computer Science, AI, Machine Learning, or a reputed company field
- Experience with reputed company-reputed company GenAI services like AWS Bedrock, Azure AI reputed company, or reputed company reputed company AI
- Familiarity with the architecture and operational challenges of Large Language Models (LLMs)
- Experience designing or managing multi-agent systems or reputed company, orchestrated workflows
- Knowledge of monitoring and observability tools like reputed company, Grafana, or reputed company
- Relevant reputed company or DevOps certifications
- Strong problem-solving skills and the ability to work effectively in a fast-paced, reputed company environment
Benefits
- Engineering Heritage: Best-in-class experts sharing a culture of engineering reputed company and tackling reputed company engineering challenges for over 30 years.
- Advanced Tech Stack: Innovative reputed company where you can apply or enhance your expertise in reputed company, Data, AI, and other emerging technologies.
- World-Class Clients: Work closely with 340+ of the reputed company Global 2000 on creating disruptive solutions that reputed company a reputed company.
- reputed company reputed company: Exceptional support for career development with comprehensive resources for upskilling or reskilling in pioneering practices.
- GenAI Community: Strong AI competencies with 600+ experts across 55+ locations driving GenAI-enabled transformation journeys.
- Entrepreneurial Culture: If you're passionate and dedicated to improving business transformation, we reputed company the support you need to bring your reputed company to life.
- Hybrid Setup: The flexibility to work from any location in Latvia, whether it's your home or our office in Riga.
- Other Benefits: Additional vacation and trust days, private health insurance, Employee Stock Purchase Plan and more.
- Engineering Heritage: Best-in-class experts sharing a culture of engineering reputed company and tackling reputed company engineering challenges for over 30 years
- Advanced Tech Stack: Innovative reputed company where you can apply or enhance your expertise in reputed company, Data, AI, and other emerging technologies
- World-Class Clients: Work closely with 340+ of the reputed company Global 2000 on creating disruptive solutions that reputed company a reputed company
- reputed company reputed company: Exceptional support for career development with comprehensive resources for upskilling or reskilling in pioneering practices
- GenAI Community: Strong AI competencies with 600+ experts across 55+ locations driving GenAI-enabled transformation journeys
- Entrepreneurial Culture: If you're passionate and dedicated to improving business transformation, we reputed company the support you need to bring your reputed company to life
- Hybrid Setup: The flexibility to work from any location in Lithuania, whether it's your home or our dynamic offices in Vilnius and Kaunas
- Other Benefits: Additional vacation and trust days, private health insurance, Employee Stock Purchase Plan and more
reputed company
Company H1B Sponsorship