Karve
Browse all jobs

Inference Performance & Deployment - Member of Technical Staff

Callosum · London

£101k–£192k5 months ago

OnsiteFull_timeai inferenceheterogeneous computingmodel serving

Salary

£101k–£192k

Workplace

Onsite

Employment

Full_time

Location

London

Posted

5 months ago

Summary

This member of technical staff role focuses on deploying, benchmarking, and optimising large-model inference across heterogeneous accelerators and infrastructure. It is an in-person position based at Callosum's London office, working across orchestration, serving, performance analysis, and production readiness.

Responsibilities

  • Run experiments across cloud and on-prem hardware
  • Develop reproducible deployment patterns for inference
  • Optimise caching, scheduling, batching, and resource allocation
  • Integrate accelerator and inference engine upgrades
  • Build benchmarking harnesses and regression suites
  • Create performance dashboards and prioritise bottlenecks
cerebrasd-matrixintelnvidiaamdnormal computingtenstorrentgreatskymixxgpudynamotriton inference server
ai inferenceheterogeneous computingmodel servingdistributed systemsperformance benchmarkingcloud deployment