Machine Learning Infrastructure Engineer
- Company
- Raydar
- Location
- San Francisco, United States
- Salary
- 200 000–350 000 $/yr
- Posted
- 2026-11-14
Skills: Observability, PyTorch
About the company
Our client is a software company.
The role
Raydar is recruiting for this role on behalf of our client. Build and tune the serving and training infrastructure behind specialized language models, from early experiments through to live production use. The work centers on making model execution quicker and less costly on accelerators while keeping releases dependable and observable.
What you'll do
- Lead end-to-end care of the systems that run and train custom language models, from early testing through live traffic. - Benchmark and raise response speed, token throughput, hardware utilization and cost under production-like loads. - Refine request grouping, caching, memory footprint and model execution, and test approaches such as reduced-precision formats and accelerated decoding. - Keep model inference fast for evaluation runs, synthetic data generation and reinforcement learning sampling, and build dependable release and monitoring pipelines. - Work alongside leadership and researchers to split accelerator capacity between training and serving, and to roll post-trained models out into client environments.
Requirements
What we're looking for
- Proven record building or tuning language model serving software in a live company setting, with clear credit for performance or stability gains. - Solid low-level engineering and troubleshooting ability, including familiarity with GPU memory and compute ceilings. - Deep familiarity with hardware chokepoints,…
Full text and application on the employer's site.