AI Web Search Evaluator

Jobs for Humanity

Apply to this job
Dallas, TX, us remote Until 8/21/2026 First posted October 14, 2025 Last posted February 24, 2026
Job description

Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, Welo Data leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts...and we'd like you to join us!

As a Web Search Evaluator, you will play a key role in improving the quality of search engine results, ensuring users find the most relevant and useful information. Your work will directly impact the development of AI algorithms, making search engines smarter and more intuitive. You won’t need to be a data expert, but your insights will help refine search accuracy, contributing to a seamless online experience.

This role is ideal for individuals who are curious about how search engines work and enjoy analyzing data to improve user experience. It requires a balance of attention to detail, strong analytical skills, and a passion for quality.

Key Responsibilities:

  • Analyze search result performance and provide insights on relevance and quality.
  • Evaluate and rate the effectiveness of search engine results to ensure they meet user expectations.
  • Offer feedback and recommendations to improve algorithm performance.

Ideal Candidate:

  • Experience in AI, search engine evaluation, or data analysis is a plus, but not essential.
  • Surf the internet daily and familiar with online search engines and digital trends.
  • Enjoy researching topics online and enjoys providing feedback and improving digital tools.
  • Background in search engine optimization or data analysis is beneficial.
  • Seeks a flexible, remote job that can easily fit around other commitments.

Project Details:

Pay Rate: $14.50 per hour

Location: Remote/work from home, within the US– Note: Even though the position is WFH, you must reside in the country/state that is noted in this description. This will be automatically checked during the hiring process.

Currently hiring in Florida, Georgia, Indiana, Kansas, Kentucky ,Missouri ,Montana, New Hampshire, North Carolina, Ohio, Oklahoma, Pennsylvania ,Tennessee, Texas, Utah, Virginia, West Virginia, Wisconsin.

Hours: Set your own schedule based on the following – Minimum commitment is 10 hours per week. You can choose to work up to 29 hours per week (if project needs allow). – Note: Data volumes can vary week to week. Some weeks there is more data to review, other weeks less.

Start Date: ASAP

Employment Type: W2 Part-Time Employee; Payment every 2 weeks

Project Duration: 12 months (with possibility of extension

  • Fluent in English (written and spoken)
  • Strong understanding of pop culture in the US
  • Reliable computer system and internet connection
  • Familiar understanding of how to use online search engines
  • Sign a standard Non-Disclosure Agreement and Service Level Agreement

Our raters are also eligible for benefits, including paid sick time and employee assistance programs.

Benefits

Following eligibility requirements, you’ll receive:

  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • HSA
  • Voluntary Life Insurance
  • Accident, Critical Illness, Hospital Indemnity Insurance
  • 401(k) Retirement Plan

Federal Law Compliance

In compliance with federal law, all persons hired will be required to:

  • Verify identity and eligibility to work in the United States
  • Complete a required employment eligibility verification form

 

To be successful in the process, candidates must sign a Non-Disclosure Agreement to protect client confidentiality and pass learning modules and a required quality test designed by our client before starting work.

*Please note, the official title of this position is: Search Quality Rater. *

 

About this role

Summary

Evaluate search results for relevance and quality to enhance AI algorithms.

Job title

AI Web Search Evaluator

Experience level

no experience required

Industry

technology

Location requirements

remote within the US, must reside in specified states

Salary

Pay Rate: $14.50 perhour

Management role

No

Skills & keywords

Required skills

fluent Englishfamiliar with online search enginesreliable internet

Preferred skills

pop culture knowledge USdigital trend awareness

Specializations

search engine evaluationsearch relevancedata analysissearch engine optimization
Locations

Structured locations inferred from the posting.

United States

Remote Country
Related searches