Summary

Evaluate AI coding agents and assess the quality of their engineering decisions, explanations, and interactions. This remote contract role focuses on AI-assisted development workflows and offers flexible weekly hours.

Responsibilities

• Evaluate AI-generated coding interactions end-to-end
• Judge outputs for correctness and usefulness
• Assess explanations and reasoning quality
• Differentiate response quality levels
• Write detailed, opinionated evaluation feedback
• Define quality standards for coding agents