Summary

Staff software engineer on anthropic’s inference team, building and maintaining the infrastructure that serves claude to millions of users. Work end to end on distributed systems, intelligent request routing, fleet-wide orchestration, and production deployment pipelines across diverse ai accelerators and cloud platforms. Role follows a location-based hybrid policy with staff in an office at least 25% of the time.

Responsibilities

• Design intelligent routing algorithms for accelerators
• Autoscale compute fleet to match demand
• Build deployment pipelines for releasing models
• Integrate new ai accelerator platforms
• Contribute inference features like structured sampling
• Analyze observability data to tune performance
• Manage multi-region deployments and routing