BS/BA degree or equivalent experience in a relevant field (e.g., Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a related analytical field).
Strong Evaluation Acumen: Understanding of personalization concepts, including the ability to identify incorrect personalization, poor inferences, and forced connections.
Willingness to use your primary personal Google account (not a testing account) and enable personal data sources for a genuine assessment.
Creative Prompt Engineering: Experience in designing creative, multi-turn starting prompts based on personal context to thoroughly test the model's capabilities.
Personal Account Usage: Willingness to use your primary personal Google account (not a testing account) and enable personal data sources for a genuine assessment.
Meticulous Attention to Detail: The ability to review side-by-side model responses and spot subtle differences in naturalness and over-narrating.
Willingness to use your primary personal account (not a testing account) and enable personal data sources for a genuine assessment.
Ability to provide constructive feedback and detailed annotations.
Schedule Flexibility: Full-time availability in your local time zone is required, supporting a global, 24-hour operations team.
Self-motivated and able to work independently in a remote setting.
***_Japanese Proficiency_ : Ability to read and write in Japanese with a high degree of comp, as Japanese is the focus language for this project.***
Excellent Written Communication: Superior ability to write clear, concise, and structured rationales for model rankings, explicitly referencing specific turn numbers.
Technical Setup: Desktop/Laptop set up with a good internet connection.
Full-time availability (8 hours per day) and 4 hours overlap with a specific time zone.
Excellent communication and collaboration skills.
Exceptional Analytical Thinking: Demonstrated ability to evaluate nuanced and ambiguous AI responses, specifically assessing personalization quality.