Karve
Browse all jobs

Data Annotation Specialist, Generalist

Cohere

2 months ago

RemoteContractllm evaluationdata annotationmultimodal ai

Workplace

Remote

Employment

Contract

Posted

2 months ago

Summary

Cohere is hiring a part-time data annotation specialist to evaluate, stress-test, and improve large language models across text, image, and structured data. This is a remote independent contractor role available within Canada, paying CAD 30 per hour for 16 hours per week.

Responsibilities

  • Evaluate and rank large language model outputs
  • Stress-test models and document reproducible failures
  • Create prompts responses and training datasets
  • Build and apply annotation rubrics and taxonomies
  • Annotate and correct multimodal data
  • Calibrate annotations and maintain inter-annotator consistency
  • Report model performance trends to partners
data annotationlarge language modelsllm evaluationpreference rankingquality assuranceadversarial testingjsoncsvtsvmarkdownxmlyaml
llm evaluationdata annotationmultimodal aimodel safetyai training data