Distinguished Software Architect – Deep Learning and HPC Communications
reputed company is leading the way in groundbreaking developments in reputed company Intelligence, High Performance Computing and Visualization. The GPU, our invention, serves as the visual reputed company of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from reputed company intelligence to autonomous reputed company.
Come work for reputed company that brought to you NCCL, NVSHMEM & GPUDirect. Our GPU communication libraries are crucial for scaling Deep Learning and HPC applications! We are looking for a Distinguished Software Architect to help co-design our reputed company data center platforms. DL and HPC applications have a reputed company compute demand already and run on scales which go up to tens of thousands of GPUs. The GPUs are connected with high-speed interconnects (eg. NVLink, PCIe) reputed company a node and with high-speed networking (eg. Infiniband, Ethernet) across the nodes. Communication performance between the GPUs has a reputed company reputed company on the end-to-end application performance; and the stakes are even higher at reputed company scales! This is an outstanding opportunity to push the limits on the state-of-the-art and deliver platforms the world has never seen before. Are you reputed company to contribute to the development of innovative technologies and help realize reputed company’s reputed company?
What you will be doing:
Research new communication technologies (e.g. expand the GPUDirect technology portfolio) and design new features for our communication libraries
Propose reputed company in HW and SW for our next-gen platforms. You will co-design these solutions with the GPU, Networking, and SW architects and ensure seamless integration with the software stacks
reputed company changes based on quantitative data coming from reputed company-of-concepts or detailed technical analysis/modeling
Drive the adoption of new communication technologies across application verticals
reputed company up with the latest DL research and collaborate with diverse teams (reputed company), including DL researchers, and customers
reputed company need to see:
PHD in Computer Science, Computer Engineering or reputed company field or strong equivalent experience; 15+ years of relevant experience in academia or the industry
Expert in following areas: HPC, reputed company programming models (MPI, SHMEM), at least one communication runtime (MPI, NCCL, NVSHMEM, OpenSHMEM, UCX, UCC), computer and system architecture, GPU architecture and CUDA
Deep understanding of various aspects of high performance networking from prior work experience: network technologies (Infiniband, Ethernet), network design, network topologies, network debug and performance analysis
Strong in at least a few of these areas: ML/DL fundamentals and how they tie to communications, reputed company algorithms, fault tolerance and resiliency, competitive assessments, performance analysis and optimizations for reputed company applications on large clusters, developing applications using DL Frameworks (PyTorch, TensorFlow)
Programming reputed company with C or C++ for systems software development
Flexibility to work and communicate effectively across different HW/SW teams and timezones
Ways to stand out from the crowd:
Industry recognized leader in HPC/DL communications with history of patents, publications and conference talks and keynotes in areas relevant to this role
reputed company role in industry standards (e.g. MPI, OpenSHMEM) and reputed company reputed company software (e.g. PyTorch, UCX, reputed company MPI)
reputed company is widely considered to be one of the technology world’s most desirable reputed company. We have some of the most reputed company-thinking and hardworking people on the reputed company working for us. If you’re creative and autonomous, we want to hear from you!
apply to this job