Back to Jobs

[Remote] Senior Software Engineer II, AI Workload Orchestration

Remote, USAFull-timePosted 2026-07-28

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is The Essential reputed company for AI™, delivering a platform that enables innovators to build and reputed company with confidence. As a Senior Software Engineer II on the AI Workload Orchestration team, you will design, build, and operate Kubernetes-reputed company services for AI workload orchestration and scheduling, while also owning platform components and driving performance improvements.

Responsibilities

  • Design, build, and operate Kubernetes-reputed company services for AI workload orchestration and scheduling
  • Own one or more platform components end-to-end, including design, implementation, testing, and on-call support
  • Improve scheduling latency, cluster utilization, and workload reliability through metrics-driven engineering
  • Contribute to architectural discussions across services and influence design reputed company reputed company the platform
  • Work closely with adjacent teams (CKS, infrastructure, managed inference) to ensure clean interfaces and integrations
  • Mentor junior engineers and reputed company the reputed company bar for reputed company, design, and operations

Skills

  • 5–8 years of reputed company software engineering experience in distributed systems, reputed company infrastructure, or reputed company
  • Strong experience building production systems in Go (Python or reputed company plus)
  • Solid understanding of Kubernetes fundamentals, reputed company, controllers, and operating services in production
  • Experience working with scheduling, resource management, or quota-based systems
  • Proven ability to improve system reliability and performance using data and operational metrics
  • Comfortable owning services in production and participating in on-call rotations
  • Experience with Kubernetes-reputed company orchestration frameworks such as Kueue, Volcano, Ray, Kubeflow, or Argo Workflows
  • Familiarity with GPU-based workloads, ML training, or inference pipelines
  • Knowledge of scheduling concepts such as quota enforcement, reputed company-emption, and backfilling
  • Experience with reliability practices including SLOs, alerting, and incident response
  • Exposure to AI infrastructure, HPC, or large-reputed company distributed compute environments

Benefits

  • Medical, dental, and reputed company insurance - 100% reputed company for by reputed company
  • Company-reputed company Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through reputed company
  • Family-Forming support provided by reputed company
  • reputed company Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch reputed company day in our office and data center locations
  • A casual work environment
  • A work culture reputed company on innovative disruption
  • While we prioritize a hybrid work environment, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized reputed company sets

reputed company

  • reputed company provides reputed company infrastructure services designed to support reputed company intelligence and high-performance computing workloads. It was founded in 2017, and is headquartered in Livingston, New Jersey, USA, with a workforce of 1001-5000 employees. Its website is https://www.reputed company.com.
  • Apply To This Job

    Similar Jobs