Data Annotation Specialist, Generalist
Cohere
2 months ago
RemoteContractllm evaluationdata annotationmultimodal ai
2 months ago
Workplace
Remote
Employment
Contract
Posted
2 months ago
Summary
Cohere is hiring a part-time data annotation specialist to evaluate, stress-test, and improve large language models across text, image, and structured data. This is a remote independent contractor role available within Canada, paying CAD 30 per hour for 16 hours per week.
Responsibilities
- Evaluate and rank large language model outputs
- Stress-test models and document reproducible failures
- Create prompts responses and training datasets
- Build and apply annotation rubrics and taxonomies
- Annotate and correct multimodal data
- Calibrate annotations and maintain inter-annotator consistency
- Report model performance trends to partners
data annotationlarge language modelsllm evaluationpreference rankingquality assuranceadversarial testingjsoncsvtsvmarkdownxmlyaml
llm evaluationdata annotationmultimodal aimodel safetyai training data
