Summary

This senior software engineer role builds and runs evaluation frameworks for computer-use agents, using production Python and distributed systems. The role is hybrid in London, with three office days each week.

Responsibilities

• Integrate researcher benchmarks into framework
• Define and enforce benchmark standards
• Schedule evaluation jobs across clusters
• Instrument evaluation runs with observability
• Ensure reproducible results across trials
• Automate customer workflow measurements