About the Team
The Search Operations team aims to improve search user experience, contribute significant DAU impact to the products and drive for increase in traffic and GMV.
The T&S evaluation and investigation team, working closely with the search team, taking the evaluation standards as the baseline and principles, and manually evaluating the search query and the corresponding search results page to reflect the real user experience of the search function.
The team is committed to providing search and evaluation services for international products, with resource support provided by different countries around the world, and global members conduct evaluations according to unified guidelines. The evaluation scope covers multiple search sections, such as basic search experience, recommended search, search advertising, and search security. As a bridge for business communication domestically and abroad, the team is responsible for key nodes such as standard writing, training Q&A, report output, and human efficiency management to effectively promote the execution and implementation of projects.
It is possible that this role will be exposed to harmful content as part of the core role/as part of project/ in response to escalation requests/by chance.
This may occur in the form of images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals.
Responsibilities
- Complete regular assessments relating to AI model quality in accordance to evaluation standard documents.
- Use evaluation method to complete daily strategy assessment of AI model quality in accordance with evaluation standard documents.
- Comb the types of AI model bad cases and rate the quality of result.
- While it is assumed the evaluator will focus on their area of expertise, the will be occassions in which, they will work on projects outside this core area that could require other capabilities, such as using assessment method flexibly to support related projects.
- Willing to work on sensitive issues that include child exploitation, a variety of religious and political views, violence, adult and sexual contents.
- Other ad hoc and relevant projects as assigned.
Laporkan kerja