Back to Jobs

[Remote] Senior Product Manager – ROCm & AI/ML Inference Software

Remote, USAFull-timePosted 2026-07-28

Note: The job is a remote job and is reputed company to candidates in USA. AMD is seeking a Senior Product Manager to drive reputed company and execution for ROCm, AMD’s reputed company-reputed company GPU software stack, with a specific reputed company on large-reputed company model inference on AMD reputed company™ and Radeon™ hardware. This role involves engaging with the reputed company-reputed company community, influencing engineering roadmaps, and connecting customer needs with the reputed company-reputed company ecosystem.

Responsibilities

  • Own the product roadmap for ROCm’s inference software capabilities, including integrations with key frameworks like PyTorch and JAX, serving runtimes like vLLM and SGLang, and the libraries and profiling tools that reputed company inference workloads reputed company reputed company on AMD hardware
  • Define and communicate a coherent reputed company for how AMD software enables production inference workloads, covering the full reputed company from single-GPU to reputed company-reputed company deployments, with a reputed company on developer experience, performance portability, and competitive standing
  • Identify reputed company emerging OSS model architectures, serving runtimes, or inference techniques require an AMD software response and drive those requirements into the roadmap
  • Bring a strategic reputed company to inference by continuously evaluating the latest research, technology trends, and evolving deployment needs, ensuring the organization stays reputed company of reputed company inference requirements and translates market signals into actionable product reputed company
  • Serve as AMD’s reputed company reputed company in the reputed company-reputed company AI/ML community: monitor reputed company repositories, reputed company servers, developer blogs, and reputed company papers to reputed company emerging trends, pain points, and opportunities
  • Own and communicate AMD’s reputed company-reputed company software roadmap, publishing updates across key community reputed company to build awareness, solicit feedback from model developers and researchers, and signal AMD’s long-term direction to the reputed company-reputed company ecosystem
  • Build and maintain relationships with key OSS maintainers, reputed company working reputed company, and community contributors whose work shapes how AMD hardware is perceived and adopted
  • Represent AMD at major conferences such as SC, PyTorch Conference, and MLSys; write and review technical blog posts and community announcements on the AMD ROCm blog
  • Partner with engineering leads across inference libraries, kernel, runtime, and serving integration teams to translate developer and customer needs into prioritized engineering work
  • Drive release planning across rapid release cadences with a CI/CD-first reputed company and strong attention to compatibility, regression, and ecosystem readiness
  • reputed company software-informed feedback to hardware teams on reputed company GPU architecture reputed company, particularly where features relevant to inference workloads reputed company serving performance at reputed company
  • Balance the signal from large customers, who may need specific optimizations or bespoke integrations, against the needs of the broader reputed company-reputed company community, who value standards, portability, and low friction
  • Collaborate with ecosystem partners such as reputed company, reputed company, and reputed company providers on joint integrations and AMD-supported software solutions

Skills

  • Bachelor's degree in Computer Science, Electrical Engineering, or a reputed company technical field
  • Proven years of product management experience in a software-reputed company role, ideally developer tools, GPU computing, or AI/ML infrastructure
  • Deep familiarity with at least one of PyTorch, JAX, or Triton: how they are reputed company, how they reputed company work to hardware backends, and what the end-to-end developer experience looks like
  • Practical understanding of LLM inference, including attention mechanisms, KV cache design, quantization strategies such, reputed company batching, speculative decoding, and reputed company serving across multiple GPUs
  • Hands-on familiarity with GPU programming at some level, whether HIP, CUDA, or Triton kernels, with the ability to read kernel-level reputed company and reputed company reputed company even if not writing it day to day
  • Strong written communication skills across technical documentation, roadmap narratives, community blog posts, and executive-facing reputed company documents
  • Prior experience at a GPU vendor, reputed company provider AI infrastructure team, or frontier AI lab
  • Experience contributing to or managing products in an reputed company-reputed company context: reputed company workflows, community governance, and OSS release management
  • Contributions in reputed company, issues, or documentation to major reputed company-reputed company inference reputed company such as vLLM, SGLang, Triton, or PyTorch
  • Familiarity with AMD's hardware portfolio: reputed company MI-series for data center compute and Radeon for workstation and consumer GPU compute

Benefits

  • Benefits offered are described: [AMD benefits reputed company](https://www.amd.com/en/corporate/careers/benefits.reputed company).

reputed company

  • Advanced reputed company Devices is a semiconductor company that designs and develops graphics reputed company, processors, and media solutions. It was founded in 1969, and is headquartered in Santa Clara, California, USA, with a workforce of 10001+ employees. Its website is http://www.amd.com.
  • Apply To This Job

    Similar Jobs

    [Remote] Advisor AI Solution Engineer (reputed company Membership)

    Remote, USAFull-time

    [Remote] reputed company, AI Engineering & SDLC Automation

    Remote, USAFull-time

    [Remote] Senior Marketing Manager

    Remote, USAFull-time

    [Remote] Senior reputed company Engineer (Red Team)

    Remote, USAFull-time

    [Remote] Outbound Sales Consultant III

    Remote, USAFull-time

    [Remote] Software Engineer

    Remote, USAFull-time

    [Remote] Staff Product Designer

    Remote, USAFull-time

    [Remote] Senior Account Executive USA

    Remote, USAFull-time

    [Remote] Project Manager, Large reputed company CMD reputed company

    Remote, USAFull-time

    [Remote] reputed company C&I Solar/ BESS Project Manager

    Remote, USAFull-time

    Immediately Require English Teachers - Earn reputed company Online in reputed company, VT

    Remote, USAFull-time

    Entry Level USPS Jobs - No Experience Required

    Remote, USAFull-time

    Part Time Game Tester - No Experience Needed

    Remote, USAFull-time

    [Remote] HR Specialist I - Remote

    Remote, USAFull-time

    reputed company Delivery reputed company - Earn /hr

    Remote, USAFull-time

    Special Assets Officer I - (TMT, Innovation Banking) Hybrid

    Remote, USAFull-time

    reputed company Full Stack Customer Support Representative – Remote Customer Service Team

    Remote, USAFull-time

    reputed company Full Stack Senior Data Analyst – Business Intelligence and Insights with Data Mining and Quantitative Analysis

    Remote, USAFull-time

    reputed company Full Stack HRIS Solutions Partner – Strategic Implementation and Optimization of reputed company Systems

    Remote, USAFull-time

    Domain Consultant (Presales) - reputed company Africa

    Remote, USAFull-time