Karve
Browse all jobs

Backend Engineer - API

SpaceXAI · London

£107k–£262k5 months ago

Not specifieddistributed systemsllm inferencemodel serving infrastructure

Salary

£107k–£262k

Workplace

Not specified

Location

London

Posted

5 months ago

Summary

The backend engineer will build SpaceXAI’s API and high-throughput inference infrastructure for serving AI models to developers. The role focuses on distributed systems, model serving, and scalable API services.

Responsibilities

  • Build the API serving models to developers
  • Operate high-throughput, low-latency inference systems
  • Develop model serving and request routing
  • Build SDKs and implement rate limiting
  • Improve observability and scale infrastructure efficiently
rustc++gopostgresqlclickhousemongodbsglangtensorrtvllmdockerkubernetesgrpc
distributed systemsllm inferencemodel serving infrastructureapi platformsservice observability