We are looking for Generalist Expert candidates for a project delivered through the hiring partner.
What you'll do
- Write prompts and reference answers on everyday questions that have a right answer, with the context a good response has to account for.
- Grade model output on general reasoning: whether the answer is correct, whether it follows the instruction actually given, whether it is complete without padding.
- Flag where a model is confidently wrong, contradicts itself earlier in the same answer, or answers a question that was not asked.
What you need
- Have careful reading and sound judgment, from a professional or academic background in any field.
- Have clear written communication, since most of the work involves explaining your reasoning.
- Be comfortable with ambiguous tasks, and willing to flag unclear instructions.
Expertise
clear written communicationambiguous tasksjudgmentwriting promptsgrading model outputflagging model errors
RequiredAlso useful
Also listed: attention to detail.
Who you work with
Project and contracting process: the hiring partner. Applications continue on the provider's website.
Pay and hours
This role pays $40–$70/hr, for 40 h/week. The work is remote. That is about 15% below the $65 an hour median for other roles open now.
Who can apply from where
The provider lists this role as open worldwide. With a profile, Tier1 checks your country and languages against this role and every other before you apply.