Remote (Global)

Handshake is hiring a Training and Development Specialist - AI Trainer (Contract)

About the Role

This position involves creating and refining training materials for artificial intelligence models, ensuring high-quality data inputs, and supporting the development of scalable learning systems through structured feedback and iterative improvement processes.

Responsibilities

  • Develop and curate training datasets for machine learning models
  • Annotate and label text and behavioral data to support AI learning
  • Design instructional content that aligns with AI learning objectives
  • Evaluate AI-generated responses for accuracy and relevance
  • Identify patterns in user interactions to improve model performance
  • Collaborate with data scientists to refine training pipelines
  • Maintain consistency in tone and quality across training examples
  • Conduct quality assurance checks on annotated datasets
  • Iterate on training content based on model performance feedback
  • Document processes for data labeling and content creation
  • Support the development of evaluation frameworks for AI outputs
  • Ensure training data adheres to ethical and safety guidelines
  • Provide insights on user intent and language variation
  • Assist in the creation of guidelines for future training tasks
  • Monitor model behavior for inconsistencies or biases
  • Contribute to the improvement of natural language understanding systems
  • Work with cross-functional teams to align training goals with product needs
  • Track progress on training milestones and deliverables
  • Maintain organized records of training datasets and annotations
  • Stay current with advancements in AI and machine learning practices

Nice to Have

  • Master’s degree in a relevant discipline
  • Professional experience in educational technology
  • Background in computational linguistics
  • Experience with large-scale data projects
  • Knowledge of programming languages such as Python
  • Prior work in AI model evaluation
  • Understanding of user experience research
  • Experience with remote collaboration tools
  • Publication or project work involving AI systems

Compensation

Contract position

Work Arrangement

Remote

Team

Learning and Development team

About the Role

This contract position supports the development of AI systems by creating high-quality training content and annotated datasets. The specialist will work closely with technical teams to improve model accuracy and ensure outputs meet real-world usability standards.

What You’ll Do

  • Create and refine training examples for AI models
  • Label data according to defined schemas
  • Assess AI responses for quality and consistency
  • Help shape best practices for AI training workflows

What We’re Looking For

  • Candidates with a background in education, language, or technology
  • Strong writers who can interpret and clarify ambiguous inputs
  • Detail-oriented individuals comfortable with repetitive tasks
  • People passionate about the ethical development of AI

Not available

Required Skills
Content CreationCommunicationProject ManagementQuality Assurance
About company
Handshake
Handshake is building the career network for the AI economy, backed by the largest and most trusted job network on the internet. It is a three-sided job marketplace connecting knowledge workers, educational institutions, and employers for career discovery, hiring, and upskilling.
All jobs at Handshake Visit website
Job Details
Category other
Posted 6 months ago