Every engagement starts with a pilot. This lets both sides validate evaluator fit, alignment to your rubric, and turnaround time before scaling the team.
The process
- Book a call Discuss your workflow, rubric, languages, and the kind of evaluators you need.
- We assemble the team We shortlist evaluators from our pool based on your requirements (domain expertise, language, education level) and onboard them against your spec.
- First batch live Within the first week of work. You review the work, provide feedback, and we recalibrate the team.
- Scale up Once quality benchmarks are met. Most teams have the full evaluator team plugged into their workflow within two weeks of the first call.
What we need from you
- A clear description of the task type (RLHF, SFT, red-teaming, annotation, etc.)
- A rubric or sample data if you have one
- Target languages and domains
- Desired volume and timeline