San Francisco Hybrid Employment

Baseten is hiring an Engineering Manager, Runtime Fabric

Responsibilities

  • Build and grow a team of skilled systems engineers with strong backgrounds in containers and Linux internals.
  • Promote a culture emphasizing technical excellence, open-source engagement, and ongoing optimization.
  • Deliver consistent coaching, performance feedback, and career growth guidance to team members.
  • Collaborate with engineering leaders to shape the strategic direction and roadmap for container and storage systems.
  • Lead efforts to enhance containerd, runc, and related OCI components to support GPU-intensive AI inference workloads, focusing on fast startup, device access, and secure multi-tenancy.
  • Oversee the design and development of the Baseten Delivery Network, a caching system that accelerates cold starts and prevents overload during traffic spikes.
  • Guide the evolution of the delivery network to support additional artifacts such as container images, training checkpoints, and deployment assets.
  • Provide technical leadership on secure, GPU-enabled isolation for shared inference environments, including hardened runtimes and future micro-VM integration.
  • Ensure accountability for the full container startup lifecycle, from filesystem initialization to first inference response.
  • Support and promote contributions to the open-source containerd project in coordination with core maintainers.
  • Serve as the main internal advocate for Runtime Fabric, enabling integration with dependent teams across the platform.
  • Work with product and engineering partners to align technical priorities with business goals and system reliability.
  • Clearly communicate team progress, architectural choices, and engineering trade-offs to executive leadership.

Benefits

  • Competitive salary and equity package
  • Full medical, dental, and vision coverage for employee and dependents
  • Flexible paid time off policy with a company-wide winter closure from Christmas Eve through New Year's Day
  • Paid leave for new parents
  • Financial support for fertility and family planning via Carrot
  • Company-sponsored 401(k) plan
  • Opportunities to engage with diverse ML startups, enhancing professional growth and industry connections

Compensation

Competitive salary and equity package

Other

  • The company upholds equal employment opportunity, prohibiting discrimination based on race, color, religion, gender, sexual orientation, gender identity, national origin, age, genetic information, disability, or veteran status.
  • Applicants with criminal histories are considered in compliance with applicable laws, including the San Francisco Fair Chance Ordinance where relevant.
Ready to relocate and code from paradise?

Thailand or Vietnam — your office, your rules

Iglu offers relocation to Bangkok, Chiang Mai, Ho Chi Minh City, or Hong Kong. Full employment, legal setup, and a community of 200+ digital professionals.

Relocation to 5 countries
Full legal work setup
Developer community access
Work-life balance culture
Explore locations
Relocation support included
About company
Baseten
Baseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. We’re trusted by leading AI-driven innovators to deliver industry-leading performance, security, and reliability for their mission-critical workloads.
All jobs at Baseten Visit website
Job Details
Department Runtime Fabric
Category management
Posted 2 months ago