We are looking for Engineering & Software Domain Expert candidates for a project delivered through Mercor.
What you'll do
- Vet the quality of engineering knowledge work tasks and model outputs, spotting missing behaviors, thin reasoning, code that runs but is subtly wrong, unhandled edge cases, and answers that read well but would not survive a real code review.
- Write high-quality instruction specs, produce golden solutions to engineering problems, and define new engineering tasks that reflect how the work is actually done in practice.
- Design challenging engineering tasks and evaluation sets, and help build engineering-specific skills and tools together with the research team.
- Work with client researchers and specialists in adjacent fields to keep standards consistent, translating tacit engineering judgment into explicit, teachable criteria.
What you need
- Genuine specialization in at least one area, for example distributed systems and backend infrastructure, security and cryptography, embedded and firmware, machine learning systems, developer tooling and platform engineering, or quality and test engineering.
- Clear progression to a senior level, for example Senior, Staff, Principal, Architect, or Engineering Lead, with real ownership of systems and design decisions.
- Hands-on working use of large language models in your professional work, and the judgment to tell a well-reasoned answer from a plausible-sounding wrong one.
- Living in the Bay Area, California, and able to work on-site with the client's team multiple days each week, when required. Candidates not currently based in the Bay Area must be willing to relocate there at their own cost. Relocation assistance is not provided.
- Excellent written communication, and the ability to give precise, well-structured written feedback.
Nice to have
- An MS or PhD is strongly preferred.
- A visible record of engineering output such as shipped systems, granted patents, open source contributions, or published technical work.
Expertise
Who you work with
Project and contracting process: Mercor. Applications continue on the provider's website.