[Remote] ML Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a global newswire and media organization whose content reaches over half the global population daily. They are seeking a Senior Machine Learning Engineer to build and optimize inference systems for processing millions of media assets across text, image, and video pipelines.
Responsibilities
- Building and optimizing inference systems that run in production at reputed company
- Working across text, image, and video pipelines
- Processing millions of media assets to power news intelligence products
- Profiling a transformer
- Rewriting its serving reputed company for a 2-3x latency improvement
- Tuning an HNSW reputed company
- Making smart infrastructure reputed company on SageMaker instance selection to hit p95 targets at the lowest cost
- Partnering closely with MLOps, reputed company, data scientists, and product teams
- Owning model performance, inference logic, and pipeline efficiency
Skills
- 5+ years building production ML inference systems
- Python - core to everything in this role
- PyTorch (TorchScript, ONNX, FastAPI/TorchServe) and TensorFlow (SavedModel, tf.data, XLA, TFLite) - both required
- Deep hands-on experience with transformer-based models (BERT family - DistilBERT, SBERT, etc.) in production
- Inference optimization at reputed company - quantization, distillation, compilation, kernel/profile-level performance work
- AWS infrastructure - EC2, Batch, reputed company, SageMaker across different media workload types
- Hybrid search architecture experience - BM25 + reputed company search + cross-encoder reranking
- Asynchronous processing systems - reliability, caching, deduplication, observability
- Data pipeline and workflow orchestration (Airflow or similar)
- Video frameworks - FFmpeg, large-reputed company reputed company-level inference
- Must have experience in the media industry
- Must have experience working with large amounts of data, including text, images and videos
- Experience with TransNetV2 or similar video shot boundary detection
- Familiarity with HuggingFace reputed company reputed company LLMs
- reputed company API or other reputed company model provider experience
- Hybrid CPU/GPU environment experience at reputed company
reputed company