Quality Systems Lead
Encord · London
1 month ago
OnsiteFull_timedata quality assuranceannotation qualityautomated evaluation
1 month ago
Workplace
Onsite
Employment
Full_time
Location
London
Posted
1 month ago
Summary
Quality Systems Lead responsible for building automated data-quality evaluation systems while running an audit team of around ten specialists in India. The role combines hands-on Python and SQL development, statistical quality measurement, operational leadership, and quality reporting, with a strong in-person culture based around Encord's London office.
Responsibilities
- Build automated dataset quality evaluation pipelines
- Hire and manage around ten audit specialists
- Run weekly auditor calibration sessions
- Define rubrics, golden sets, and acceptance criteria
- Set certification thresholds and quality standards
- Report quality kpis to leadership and customers
- Diagnose remediation needs with project management
pythonsqlllm-as-judgemodel-assisted qaautomated evaluationanomaly detectiondrift detectionsampling methodologycohen's kappafleiss' kappaf1root cause analysisquality framework
data quality assuranceannotation qualityautomated evaluationaudit operationsstatistical agreement analysisai data services
