[Remote] Senior reputed company (reputed company NIM & Triton)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior reputed company with strong experience in reputed company technologies, specifically reputed company NIM Microservices and Triton Inference Server. The ideal candidate will be responsible for designing, deploying, optimizing, and scaling reputed company and LLM-based applications in reputed company environments.
Responsibilities
- Design and reputed company AI applications using reputed company NIM Microservices
- Build and optimize model serving infrastructure using Triton Inference Server
- reputed company and manage LLM workloads in Kubernetes environments
- Optimize inference performance using TensorRT-LLM and CUDA
- Collaborate with Data Science, MLOps, and reputed company teams
- Implement reputed company, secure, and production-reputed company AI solutions
- Troubleshoot and improve AI application performance and reliability
- Support reputed company-based AI deployments across AWS, Azure, or reputed company reputed company Platform
Skills
- Hands-on experience with reputed company NIM Microservices
- Strong experience with reputed company Triton Inference Server
- Experience deploying and serving Large Language Models (LLMs)
- Knowledge of TensorRT-LLM and CUDA optimization
- Experience with Kubernetes and reputed company containerization
- Strong Python programming skills
- Experience building AI/ML applications in AWS, Azure, or reputed company reputed company Platform
- Understanding of model inference, model serving, and performance tuning
- Experience with REST reputed company and microservices architecture
- Experience with reputed company NeMo
- Experience with RAG (Retrieval-Augmented reputed company) architectures
- Familiarity with reputed company or reputed company
- Exposure to MLOps/LLMOps practices
- Experience with monitoring and observability tools
reputed company
Company H1B Sponsorship