New York, New York, United States Remote (Global)

Hugging Face is hiring a Machine Learning Test Engineer, Transformers team - US Remote

About the Role

Hugging Face is hiring a Senior Machine Learning Test Engineer for its Transformers team. You will lead the strategic redesign and scaling of our testing infrastructure, ensuring it can seamlessly support over 100,000 tests across multiple platforms as our projects grow in scope and complexity.

What You'll Do

  • Lead the reinvention and scaling of testing infrastructure to support 100K+ tests across platforms like Transformers, PyTorch, and vLLM.
  • Design growth-oriented testing architectures prioritizing scalability, reliability, and integration with CI/CD pipelines.
  • Partner with the existing testing lead to establish best practices and drive continuous improvement.
  • Collaborate with cross-functional teams to embed testing as a first-class project priority.
  • Anticipate future testing needs and proactively adapt systems for evolving project scope and platform diversity.

What We're Looking For

  • Proven experience with modern machine learning frameworks like Transformers and PyTorch in large-scale software projects.
  • A mindset that treats testing as a strategic priority, not a secondary task.
  • Strong belief in architecting for growth: prioritizing scalable, modular testing systems over isolated tests.
  • Experience managing high-volume test suites (100K+ tests) and cross-platform testing challenges.
  • Familiarity with CI/CD tools and automated testing frameworks.

Nice to Have

  • Background in open-source development or contributions to major ML libraries.
  • Experience in re-architecting testing systems for rapidly growing projects.

Technical Stack

  • Transformers
  • PyTorch
  • vLLM

Team & Environment

You will join the Transformers team.

Benefits & Compensation

  • Reimbursement for relevant conferences, training, and education.
  • Flexible working hours and remote options.
  • Health, dental, and vision benefits for employees and their dependents.
  • Parental leave and flexible paid time off.
  • Opportunity to visit offices in NYC and Paris.
  • Workstation outfitting provided if needed.
  • Company equity as part of compensation package.

Work Mode

This role is US Remote.

Hugging Face is an equal opportunity employer and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Required Skills
TransformersPyTorchvLLMMachine LearningSoftware TestingPythonCI/CDDistributed SystemsPerformance TestingDebuggingQuality AssuranceLarge Language ModelsModel Evaluation
Scaling your freelance income?

Invoice multiple clients effortlessly

Managing 3+ international clients? Glopay streamlines everything. One EU company, unlimited invoices, automatic compliance. You just send and get paid.

Unlimited clients & invoices
Multi-currency support
Automated tax compliance
Client portal for easy payments
Scale with Glopay
Trusted by 10,000+ freelancers
About company
Hugging Face
We’re on a journey to democratize good AI. We are building the fastest growing platform for AI builders with over 10 million users & 100k organizations who collectively shared over 2M models, 500k datasets & 300k apps. Our open-source libraries have more than 600k+ stars on Github. We focus on developing open-source tools and models that push the boundaries of AI while remaining efficient and user-friendly.
All jobs at Hugging Face Visit website
Job Details
Category qa_testing
Posted 6 months ago