Karve
Browse all jobs

Senior Software Engineer (Serverless)

Nebius · London

2 months ago

Hybridserverless ai platformsdistributed systemsgpu scheduling

Workplace

Hybrid

Location

London

Posted

2 months ago

Summary

Senior Software Engineer role building Nebius Serverless AI, a GPU-native platform for deploying inference endpoints, batch jobs, and AI workloads. The position covers distributed systems, Kubernetes, GPU scheduling, serverless runtimes, and low-latency services, with hybrid work from the Amsterdam or London office.

Responsibilities

  • Design and build serverless platform components
  • Solve cold-start and gpu scheduling challenges
  • Set technical direction for owned areas
  • Write architecture and design documentation
  • Define slos and lead incident response
  • Build observability and improve postmortem actions
  • Review architectures with customers and teams
gokubernetescontainer orchestrationsreserverlessfunction-as-a-serviceknativeaws lambdagcp cloud runcloudflare workersmodalreplicatetogetherfireworksanyscalekubernetes device pluginsmigmpstime-slicingnvidia gpu operatorvllmtensorrt-llmtriton inference serversglangfirecrackergvisorcheckpoint/restoreimage streamingcontroller-runtimekubebuilder
serverless ai platformsdistributed systemsgpu schedulingml inference infrastructurekubernetes orchestrationsite reliability engineering