ML Engineer (LLM Post-Training)
- Company
- ChipAgents
- Location
- San Jose, United States
- Salary
- 150 000–350 000 $/yr
- Posted
- 2026-11-04
Skills: C++, Python, PyTorch
POSITION OVERVIEW
We are seeking an ML Systems Engineer to optimize the performance and efficiency of large language model inference powering our agentic AI platform. This is a technical role focused on low-level systems optimization. You will implement performance optimizations, build evaluation harnesses, and architect multi-node clusters for training and inference that push the limits of LLM throughput and latency. Your work will directly impact the responsiveness and cost-efficiency of AI agents used by leading semiconductor companies to design chips.
KEY RESPONSIBILITIES
- Design, deploy, and optimize LLM inference systems across multi-node clusters, maximizing throughput and minimizing latency for production workloads.
- Implement and benchmark concrete inference optimizations.
- Profile and analyze inference bottlenecks at the systems level—from GPU kernel execution to memory bandwidth constraints.
- Build robust evaluation harnesses and benchmarking frameworks that measure accuracy, throughput, latency, and resource utilization across various parallelism strategies.
- Collaborate with research scientists to integrate new model architectures and optimizations into production inference infrastructure.
- Investigate and apply emerging techniques from research papers and open-source projects to continuously improve inference performance.
QUALIFICATIONS
- B.S., M.S., or PhD in Computer Science, Electrical Engineering, or a related field (or equivalent…
Full text and application on the employer's site.