Senior Software Workload Optimization Engineer
- Company
- NVIDIA
- Location
- Seattle, United States
- Salary
- 184 000 $/yr
- Posted
- 2026-11-17
Our numerics team at NVIDIA works on techniques that make LLMs more efficient. We’re looking for a software optimization engineer to help us get more useful work done from our GPUs. You’ll join a small team and independently lead investigations into a range of AI workloads. One current opportunity is reducing the GPU hours needed to evaluate models, but the work will evolve as priorities and bottlenecks change. You’ll approach workloads as systems: measure how they perform, identify what limits useful throughput, implement improvements, and verify the results. You don’t need to be an expert in quantization algorithms. We’re looking for someone who enjoys understanding how software uses GPUs and finding practical ways to make it run more efficiently.
What you’ll be doing:
• Investigate the performance of evaluation and other AI workloads across GPU systems. • Identify bottlenecks in computation, memory, communication, data movement, orchestration, and resource allocation. • Evaluate and improve parallelism configurations, including how work is distributed across GPUs and nodes. • Understand how effectively workloads use GPU capabilities, including tensor cores, and identify opportunities to improve utilization. • Implement and validate changes that reduce GPU hours per unit of useful work or increase throughput. • Design clear benchmarks and measurements, accounting for tradeoffs among throughput, latency, resource use, and the quality or correctness of results. • Partner…
Full text and application on the employer's site.