Senior Software Engineer (Serverless)
Nebius · London
2 months ago
Hybridserverless ai platformsdistributed systemsgpu scheduling
2 months ago
Workplace
Hybrid
Location
London
Posted
2 months ago
Summary
Senior Software Engineer role building Nebius Serverless AI, a GPU-native platform for deploying inference endpoints, batch jobs, and AI workloads. The position covers distributed systems, Kubernetes, GPU scheduling, serverless runtimes, and low-latency services, with hybrid work from the Amsterdam or London office.
Responsibilities
- Design and build serverless platform components
- Solve cold-start and gpu scheduling challenges
- Set technical direction for owned areas
- Write architecture and design documentation
- Define slos and lead incident response
- Build observability and improve postmortem actions
- Review architectures with customers and teams
gokubernetescontainer orchestrationsreserverlessfunction-as-a-serviceknativeaws lambdagcp cloud runcloudflare workersmodalreplicatetogetherfireworksanyscalekubernetes device pluginsmigmpstime-slicingnvidia gpu operatorvllmtensorrt-llmtriton inference serversglangfirecrackergvisorcheckpoint/restoreimage streamingcontroller-runtimekubebuilder
serverless ai platformsdistributed systemsgpu schedulingml inference infrastructurekubernetes orchestrationsite reliability engineering
