Staff Software Engineer, AI Reliability Engineering
Anthropic · London
£325k–£390k8 months ago
HybridFull Timellm serving reliabilitydistributed systemsobservability
£325k–£390k
8 months ago
Salary
£325k–£390k
Workplace
Hybrid
Employment
Full Time
Location
London
Posted
8 months ago
Summary
Staff software engineer in ai reliability engineering at anthropic, partnering across teams to improve reliability for large language model serving. You will develop service level objectives, build monitoring and observability for the token path, and help design high-availability infrastructure across regions and cloud providers. The role is hybrid, with staff expected to be in an office at least 25% of the time.
Responsibilities
- Develop service level objectives for llm serving
- Design monitoring and observability for token path
- Implement high-availability serving infrastructure
- Lead incident response for critical ai services
- Conduct incident reviews and drive improvements
- Support reliability of safeguard model serving
distributed systemsservice level objectivesmonitoringobservabilityhigh-availabilityincident responseincident reviewssafeguard model servingrdmainfinibandchaos engineeringresilience testinggputputrainiumai-specific observability toolsml hardware accelerators
llm serving reliabilitydistributed systemsobservabilityhigh-availability infrastructureai safety safeguard model serving
