Staff/Sr. ML Compute Efficiency Engineer
As a performance engineer in the ML Compute Efficiency team, you’ll tackle ambiguous systems challenges, identify inefficiencies and build solutions that maximize accelerator utilization, reduce idle and fragmented capacity, and minimize recovery periods. This includes analyzing accelerator performance, digging into various parallelism techniques, and refining workload scheduling and orchestration across the compute fleet.
Minimum Qualifications
Experience with large-scale distributed systems for AI/ML workloads running on GPUs or TPUs.
Strong software engineering skills with experience developing and optimizing training frameworks (e.g. PyTorch, JAX) using C/C++ or Python.
Experience working on cross-functional projects with ML research and infrastructure teams.
Familiarity with model architectures and various training techniques.
Bachelor’s degree in Computer Science or equivalent experience, with 7+ years of industry experience.
Preferred Qualifications
Have a track record of delivering transformative performance improvements on large scale infrastructure.
Ability to analyze ambiguous, distributed systems problems and articulate both high-level strategic metrics and underlying technical complexity.