We are looking for AI Agent Evaluator candidates for a project delivered through the hiring partner.
What you'll do
- Run everyday errands with two AI agents, approve key steps, screen record, and score the results
- Test two AI agents side by side, using own accounts on phone, and report what worked, what didn’t, and how it felt
- Run real-life scenarios including bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms
- Approve or stop the agent at key steps
- Screen record every attempt
- Score each run on completion, quality, control issues, satisfaction, and time
- Share clear written feedback on the agent experience
What you need
- Be US-based
- Already use AI in daily life
- Have an active personal popular AI account (Free, Go, or Plus; not Pro)
- Have an active personal smartphone that can screen record
- Be detail-oriented, great at following instructions and documenting each step
- Have clear written communication
Nice to have
- Domain expert preferred
Expertise
RequiredAlso useful
Also listed: attention to detail.
Who you work with
Project and contracting process: the hiring partner. Applications continue on the provider's website.
Pay and hours
This role pays $25–$45/hr. The work is remote. That is about 24% below the $46 an hour median for AI & data roles open now.
Who can apply from where
Open to candidates in United States. With a profile, Tier1 checks your country and languages against this role and every other before you apply.