Evaluators for AI training (English language)

TSMG

Lviv remote Until 8/22/2026 First posted March 29, 2025 Last posted March 29, 2025

Job description

We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).

The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.

Full online training is provided.

The role is fully remote with the possibility of having a flexible schedule.

We are open to both full-time and part-time candidates.

Requirements:

at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
attention to detail
time-management skills
proactive approach
curious mind

Responsibilities:

evaluate replies of the AI agent according to the provided guidelines
recognize and evaluate differences between two possible responses to a request
compare the responses overall by determining which response is better in general, by how much, and then giving each response an absolute overall rating

About this role

Summary

Evaluate AI responses to ensure safety, quality, and appropriateness, based on provided guidelines

Job title

Evaluators for AI training (English language)

Experience level

B2+ English

Industry

software

Location requirements

remote optional, based in Lviv or remote with flexible schedule

Salary

Not specified

Management role

Skills & keywords

Required skills

English B2+attention to detailtime managementproactive

Preferred skills

curious

Specializations

AI traininglanguage evaluationcontent moderation

Locations

Structured locations inferred from the posting.

Lviv, Lviv Oblast, Ukraine, 79000

Remote City