NVIDIA is looking for a Senior ML Compiler Engineer to develop groundbreaking technologies in machine learning compilers and AI systems. You will build innovative AI compiler solutions that integrate with NVIDIA's software stack to accelerate modern machine learning models.
What You'll Do
- Innovate and develop new machine learning compiler and systems technologies.
- Design, implement, and optimize compilers for high impact AI workloads.
- Build strong kernel and domain specific language solutions for state of art kernels in LLM inference workloads.
- Develop AI-driven solutions to automate the overall development flow.
- Co-design learning system solutions with current and future ML compiler and algorithm technologies.
- Collaborate closely with other engineering teams at NVIDIA to build high impact solutions for machine learning acceleration.
What We're Looking For
- Bachelor's degree in Computer Science, Electrical Engineering, or related field (or equivalent experience)
- 4+ years (academic/industry) experience in machine learning systems development – including ML compilers, LLM inference kernels, kernel generations.
- Strong experience in developing or using deep learning frameworks (e.g. PyTorch, JAX).
- Strong Python and C/C++ programming skills.
Nice to Have
- MS or PhD are preferred.
- Expertise in AI frameworks such as PyTorch, TensorFlow, and ONNX.
- Expertise in machine learning compilers (e.g. Apache TVM, MLIR).
- Expertise in domain specific compiler and library solutions for LLM inference and training (e.g. FlashInfer, Flash Attention).
- Strong experience in GPU performance optimizations as well as experience machine learning systems research and productization.
- Open source project ownership or contributions.
Technical Stack
- Languages: Python, C/C++
- Frameworks: PyTorch, JAX, TensorFlow, ONNX
- Compilers: Apache TVM, MLIR
- Libraries: FlashInfer, Flash Attention
Benefits & Compensation
- Compensation: $152,000 USD - $241,500 USD for Level 3, and $184,000 USD - $287,500 USD for Level 4.
- Eligible for equity.
- Benefits package.
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
