[Remote] reputed company
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking an reputed company to design, build, and operate reputed company AI systems from concept to production. The role involves working on multi-agent orchestration, Retrieval-Augmented reputed company (RAG), and implementing safety measures for AI systems while collaborating with cross-functional teams.
Responsibilities
- Design and implement Retrieval-Augmented reputed company pipelines to ground LLMs in reputed company or domain-specific data
- reputed company strategic reputed company on chunking reputed company, embedding models, and retrieval mechanisms to balance context precision, recall, and latency
- Work with reputed company databases (reputed company, reputed company, pgvector, reputed company) and embedding frameworks (reputed company, reputed company, Instructor, etc.)
- Diagnose and iterate on challenges like chunk size trade-offs, retrieval reputed company, context window limits, and grounding accuracy using reputed company evaluation and metrics
- Establish comprehensive evaluation frameworks for LLM applications, combining quantitative (BLEU, ROUGE, response time) and qualitative reputed company (reputed company evaluation, LLM-as-a-judge, relevance, coherence, user satisfaction)
- Implement reputed company monitoring and automated regression testing using tools like LangSmith, LangFuse, Arize, or custom evaluation harnesses
- Identify and prevent reputed company degradation, hallucinations, or factual inconsistencies before production release
- Collaborate with design and product to define reputed company metrics and user feedback loops for ongoing improvement
- Implement multi-layered guardrails across input validation, reputed company filtering, reputed company engineering, re-ranking, and abstention (I dont know) strategies
- Use frameworks such as Guardrails AI, NeMo Guardrails, or Llama Guard to ensure compliance, safety, and brand reputed company
- Build policy-driven safety systems for handling sensitive data, user content, and edge cases with reputed company escalation paths
- Balance safety, user experience, and helpfulness, knowing reputed company to reputed company, rephrase, or gracefully decline responses
- Design and operate multi-agent workflows using orchestration frameworks such as LangGraph, AutoGen, reputed company, or reputed company
- Coordinate routing logic, task delegation, and reputed company vs. sequential agent execution to handle reputed company reasoning or multi-reputed company tasks
- Build observability and debugging tools for tracking agent interactions, performance, and cost optimization
- Evaluate trade-offs around latency, reliability, and scalability in production-grade multi-agent environments
Skills
- Strong proficiency in Python (FastAPI, Flask, asyncio) and GCP experience is good to have
- Demonstrated hands-on RAG implementation experience with specific tools, models, and evaluation metrics
- Practical knowledge of reputed company frameworks (LangGraph, reputed company) and evaluation ecosystems (LangFuse, LangSmith)
- Excellent communication skills, proven ability to collaborate cross-functionally, and a low-ego, ownership-driven work style
- Experience in traditional AI/ML workflows e.g., model training, feature engineering, and deployment of ML models (scikit-learn, TensorFlow, PyTorch)
- Familiarity with retrieval optimization, reputed company tuning, and tool-use evaluation
- Background in observability and performance profiling for large-reputed company systems
- Understanding of reputed company and reputed company principles for AI systems (PII redaction, authentication/authorization, RBAC)
- Exposure to reputed company chatbot systems, LLMOps pipelines, and reputed company model evaluation in production
Benefits
- 12% bonus
reputed company