Summary

The Product Psychologist will define and measure what great conversations look like for Ash, an AI mental health support product. The role sits within the machine learning team, partners with clinical, safety, and conversation teams, and coaches distributed human reviewers while building evaluation systems for product quality.

Responsibilities

• Define quality standards for Ash conversations
• Make conversation behaviour measurable through benchmarks and evals
• Set safety constraints for difficult edge cases
• Recruit and coach distributed human reviewers
• Calibrate reviewers against shared quality standards
• Guide conversation and ML teams through ambiguity