Coin Market Cap Ltd is seeking an AI Prompt and Quality Engineer to join our team. You will be responsible for ensuring the accuracy, consistency, and reliability of AI-generated outputs that power our core product offerings.
What You'll Do
- Design, develop, and maintain a comprehensive suite of test prompts to evaluate AI model performance.
- Establish and monitor quality benchmarks and metrics for AI-generated content.
- Analyze AI outputs for accuracy, bias, and adherence to defined guidelines.
- Collaborate with engineering and product teams to translate findings into actionable improvements.
- Document processes and create frameworks for scalable AI quality assurance.
What We're Looking For
- 3+ years of experience in a quality assurance, data annotation, or prompt engineering role.
- Proven ability to craft effective prompts for large language models (LLMs) and analyze their responses.
- Strong analytical and problem-solving skills with a meticulous attention to detail.
- Understanding of AI model capabilities, limitations, and common failure modes.
- Excellent written and verbal communication skills for documenting tests and reporting findings.
Nice to Have
- Experience with scripting languages like Python for automating test processes.
- Familiarity with the cryptocurrency or financial data industry.
- Knowledge of statistical methods for data analysis and quality measurement.
Work Mode
This position operates in a global remote mode. Candidates can be based in Global regions, Hong Kong, Kuala Lumpur, London, Penang, Singapore, or Taipei.
Coin Market Cap Ltd is an equal opportunity employer.
