Search Evaluation Specialist - Indonesia

Description

About the Team
The Search Operations team aims to improve search user experience, contribute significant DAU impact to the products and drive for increase in traffic and GMV.

The evaluation and investigation team, working closely with the search team, taking the evaluation standards as the baseline and principles, and manually evaluating the search query and the corresponding search results page to reflect the real user experience of the search function.

It is possible that this role will be exposed to harmful content as part of the core role/as part of project/ in response to escalation requests/by chance.
This may occur in the form of images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals.

What will I be doing?
- Complete regular assessments related to AI model quality in accordance with evaluation standard documents.
- Use evaluation methods to complete daily strategy assessment of AI model quality in accordance with evaluation standard documents.
- Analyze the types of AI model bad cases and rate the quality of the results.
- While it is assumed the evaluator will focus on their area of expertise, there will be occasions in which will work on projects outside this core area that could require other capabilities, such as using assessment methods flexibly to support related projects.
- Willing to work with sensitive issues that include child exploitation, a variety of religious and political views, violence, adult & sexual content.
- Parts of this role will require supporting other products within the ByteDance suite. ByteDance is TikTok's parent company, whose mission is to inspire creativity and enrich life.

Requirements

Minimum Qualifications
- 1 year of experience in data evaluation of search engines.
- Possesses professional experience in companies related to AI, search engines, social media platforms, or related models.
- Fluency in English and Bahasa Indonesia is required. English will be utilized as the primary language for work, while Bahasa Indonesia will be used for market-specific communications.
- Knowledge of common data management/office software.

Preferred Qualifications
- The applicant has completed a Bachelor's degree.
- Those majoring in journalism, literature, mathematics, computers, medicine, law, and economics are preferred.
- Demonstrated experience in cross-functional work and collaborations with international teams is beneficial.
- Understanding of the market's culture and familiarity with the Internet usage patterns of the market's users is preferred.