Karve
Browse all jobs

Quality Systems Lead

Encord · London

1 month ago

OnsiteFull_timedata quality assuranceannotation qualityautomated evaluation

Workplace

Onsite

Employment

Full_time

Location

London

Posted

1 month ago

Summary

Quality Systems Lead responsible for building automated data-quality evaluation systems while running an audit team of around ten specialists in India. The role combines hands-on Python and SQL development, statistical quality measurement, operational leadership, and quality reporting, with a strong in-person culture based around Encord's London office.

Responsibilities

  • Build automated dataset quality evaluation pipelines
  • Hire and manage around ten audit specialists
  • Run weekly auditor calibration sessions
  • Define rubrics, golden sets, and acceptance criteria
  • Set certification thresholds and quality standards
  • Report quality kpis to leadership and customers
  • Diagnose remediation needs with project management
pythonsqlllm-as-judgemodel-assisted qaautomated evaluationanomaly detectiondrift detectionsampling methodologycohen's kappafleiss' kappaf1root cause analysisquality framework
data quality assuranceannotation qualityautomated evaluationaudit operationsstatistical agreement analysisai data services