Shanghai, People's Republic of China Remote (City)

Kong is hiring a Software Engineering Manager, AI Gateway - Shanghai

About the Role

Lead the future of AI-driven infrastructure by managing a dedicated engineering team in Shanghai. This role centers on building and refining the AI Gateway—a platform empowering developers and enterprises to securely govern AI and large language model (LLM) innovation at scale.

Key Responsibilities

  • Recruit, coach, and sustain high-performing engineering teams committed to collaboration, technical rigor, and innovation.
  • Oversee project execution, performance metrics, and service-level commitments to ensure consistent delivery quality.
  • Act as the technical owner for customer escalations, coordinating with Sales, Customer Experience, and Sales Engineering to resolve complex issues effectively.
  • Align team operations with broader organizational goals, ensuring seamless integration across departments.
  • Establish clear expectations with engineering peers, leadership, and external partners.
  • Conduct regular one-on-one meetings, deliver performance feedback, manage team dynamics, and lead formal review cycles.

Required Qualifications

  • Minimum of five years managing software engineering teams with a strong focus on customer outcomes.
  • Proven technical depth in AI and LLM systems, including experience with APIs, provider-specific consumption models, and self-hosted model deployment.
  • Working knowledge of Retrieval-Augmented Generation (RAG), vector databases, and MCP frameworks.
  • Experience in hiring, performance evaluation, and compensation planning.
  • Track record managing distributed or remote engineering teams.
  • Background in on-premise, cloud, or hybrid software products.
  • Strong interpersonal and customer-facing skills.
  • Fluency in English, both written and spoken, for global collaboration.

Preferred Background

  • Direct experience developing backend services using NGINX or OpenResty.
  • Prior work in an enterprise software environment.
  • Hands-on contributions to Rust-based projects.

Technology Environment

AI, LLM, APIs, model deployment strategies, self-hosted AI models, RAG, vector databases, MCP, NGINX, OpenResty, Rust

Required Skills
AILLMAPIsSelf-hosted modelsRAGVector DatabasesMCPNGINXOpenRestyCustomer ExperienceEngineering Management AILLMAPIsmodelsconsumption modelsSelf-hosted modelsRAGVector DatabasesMCPNGINXengineering managementcustomer experience
Starting a business in Thailand?

Company registration done right

Foreign ownership rules, licenses, tax registration — Thai business setup has many moving parts. SVBL guides you through every step with full legal compliance.

Company registration & structure
Foreign ownership solutions
License & tax registration
BOI promotion eligibility
Start your business
100% foreign ownership possible
About company
Kong
Kong Inc., a leading developer of API and AI connectivity technologies, is building the infrastructure that powers the agentic era. Kong's unified API and AI platform, Kong Konnect, enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI models.
All jobs at Kong Visit website
Job Details
Department R&D
Category management
Posted 12 days ago