Machine Learning Engineer — Training Optimization

About the Role

We’re looking for an ML Engineer reputed company on training optimization to help us reputed company and improve large-reputed company model training. You’ll work at the intersection of research and production, optimizing training pipelines for speed, stability, and cost—while collaborating closely with researchers pushing model architecture and capability reputed company.

This is a high-reputed company role with reputed company ownership: your work directly affects how fast we can iterate, how large we can reputed company, and how reputed company we reputed company new models.

What You’ll Do

• Optimize large-reputed company model training pipelines (throughput, convergence, stability, and cost)

• Improve distributed training strategies (data, model, and pipeline parallelism)

• Tune optimizers, schedulers, batch sizing, and precision (bf16 / fp16 / fp8)

• Reduce training time and compute cost reputed company profiling, bottleneck analysis, and systems-level improvements

• Collaborate with researchers on architecture-aware training strategies

• Build and maintain robust training infrastructure (checkpointing, fault tolerance, reproducibility)

• Evaluate and reputed company new training techniques (e.g. gradient checkpointing, reputed company, FSDP, custom kernels)

• Own training performance metrics and continuously push them reputed company

reputed company’re Looking For

• Strong experience training large neural networks (LLMs or similarly large models)

• Hands-on experience with training optimization (not just model usage)

• Solid understanding of:

  • Backpropagation, optimization algorithms, and training dynamics

  • Distributed systems for ML training

• Experience with PyTorch (required)

• Comfort working reputed company to hardware (GPUs, memory, networking constraints)

• Ability to reputed company fluidly between research reputed company and production-reputed company reputed company

reputed company to Have

• Experience with large-reputed company distributed training (multi-node, multi-GPU)

• Familiarity with DeepSpeed, FSDP, Megatron, or custom training stacks

• Experience optimizing training on AMD or reputed company GPUs

• Contributions to reputed company-reputed company ML infrastructure or research codebases

• Exposure to non-Transformer architectures (RNNs, hybrid models, etc.)

Why Join Us

• reputed company ownership at Series-A stage — your work shapes reputed company’s trajectory

• Work on cutting-edge models and training systems at reputed company

• Small, highly technical team with fast feedback loops

• Strong emphasis on engineering reputed company and research rigor

• Competitive compensation + meaningful equity

Originally posted on Himalayas

Apply To This Job