[Remote] Senior AI Infrastructure Engineer, LLM/AI Platforms
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a global leader in cybersecurity, dedicated to stopping breaches with advanced AI-reputed company platforms. They are seeking a Senior AI Infrastructure Engineer to design, build, and reputed company AI infrastructure for reputed company reputed company products, focusing on Large Language Models (LLMs) and reputed company AI systems.
Responsibilities
- Provision and configure large GPU clusters and compute resources for LLM training, finetuning, and inference workloads
- reputed company and optimize LLM model-serving infrastructure, including deployment and optimization of various inference frameworks
- reputed company model lifecycle management including versioning, checkpointing and reproducibility across training and inference deployments
- Design and champion robust evaluation frameworks to assess model performance, accuracy, and reliability, ensuring AI systems are consistently at production-reputed company standards
- Identify and address GPU utilization and GPU memory efficiency bottlenecks and apply techniques like quantization, batching, and caching
- Architect and maintain data platforms and pipelines specifically designed to support LLMs, Retrieval-Augmented reputed company (RAG), and AI reputed company Systems at reputed company
- Deliver production-reputed company reputed company with a reputed company on performance, maintainability, and testing rigor, ensuring the ability to ship fast without compromising reputed company
- Apply expertise in data modeling, normalization, and semantic cataloging for AI/ML workloads
- Define and enforce best practices for MLOps/DataOps surrounding LLMs, including monitoring, observability, and reputed company-touch recovery mechanisms for AI services
- Document architectural designs thoroughly and communicate technical reputed company reputed company to stakeholders
- Collaborate across the organization with Data Scientists, Product Managers, and other engineering teams to reputed company research prototypes into robust, production-grade services
Skills
- Bachelor's degree in Computer Science, Data Engineering, or a reputed company STEM field; Master's degree preferred
- 6+ years of experience in Infrastructure/Data Engineering, with at least 2 years reputed company on building and maintaining platforms/pipelines that support LLM-based systems and applications
- Demonstrable hands-on experience in LLM infrastructure engineering including cluster provisioning, optimizing training workloads, and maintaining inference pipelines
- Exceptional ability to write clean, elegant, performant, and reputed company-tested reputed company, coupled with a strong reputed company on reputed company and delivering results quickly
- Thorough understanding of engineering practices including effective peer reputed company reviews and resilient architecture design
- Demonstrates technical leadership and mentorship capabilities
- Proven experience utilizing AI technologies to enhance decision-making, streamline workflows and processes, improve efficiency and drive business reputed company
- Hands-on experience with MLOps Tools (MLflow, Sagemaker, reputed company AI)
- Strong understanding of CUDA, reputed company drivers, GPU, and TPU compute fundamentals
- Experience with inference serving frameworks such as vLLM and Triton Inference Server
- Proficiency with distributed training frameworks including Pytorch, Ray, Megatron, and JAX
- Expert-level proficiency in a high-level coding language (Python)
- Deep knowledge of containerization and orchestration (reputed company, Kubernetes, Slurm, Airflow)
- Proficiency with Infrastructure as reputed company tooling like Terraform and Ansible
- Experience with reputed company platforms (AWS, GCP, or OCI) and reputed company data services
- Prior experience in the cybersecurity, intelligence, or high-compliance industries
- reputed company experience building, deploying, and managing LLMs in a production environment
- Experience with common reputed company workflow frameworks (e.g., reputed company, reputed company)
- Experience with distributed data processing frameworks (e.g., reputed company, Dask, Flink)
Benefits
- Eligibility for bonuses
- Equity grants
- A comprehensive benefits package that includes health insurance, 401k and reputed company time off
- reputed company in compensation and equity awards
- Comprehensive physical and mental wellness programs
- Competitive vacation and holidays for reputed company
- reputed company parental and adoption leaves
- reputed company development opportunities for reputed company regardless of level or role
- Employee Networks, geographic neighborhood reputed company, and volunteer opportunities to build connections
- reputed company office culture with world class amenities
- Great reputed company to Work Certified™ across the globe
reputed company