Karve
Browse all jobs

Staff Software Engineer, AI Reliability Engineering

Anthropic · London

£325k–£390k8 months ago

HybridFull Timellm serving reliabilitydistributed systemsobservability

Salary

£325k–£390k

Workplace

Hybrid

Employment

Full Time

Location

London

Posted

8 months ago

Summary

Staff software engineer in ai reliability engineering at anthropic, partnering across teams to improve reliability for large language model serving. You will develop service level objectives, build monitoring and observability for the token path, and help design high-availability infrastructure across regions and cloud providers. The role is hybrid, with staff expected to be in an office at least 25% of the time.

Responsibilities

  • Develop service level objectives for llm serving
  • Design monitoring and observability for token path
  • Implement high-availability serving infrastructure
  • Lead incident response for critical ai services
  • Conduct incident reviews and drive improvements
  • Support reliability of safeguard model serving
distributed systemsservice level objectivesmonitoringobservabilityhigh-availabilityincident responseincident reviewssafeguard model servingrdmainfinibandchaos engineeringresilience testinggputputrainiumai-specific observability toolsml hardware accelerators
llm serving reliabilitydistributed systemsobservabilityhigh-availability infrastructureai safety safeguard model serving