Summary

Evaluate AI coding agents using your software engineering judgment and experience with tools such as Codex, Claude Code, and Cursor. This is a remote contract role with flexible hours.

Responsibilities

• Evaluate AI-generated coding interactions
• Judge outputs for correctness and engineering judgment
• Assess explanations and model reasoning quality
• Differentiate response quality across scoring levels
• Write direct feedback on misleading outputs
• Help define standards for coding agents