Karve
Browse all jobs

CUDA Engineer

Fuse Energy · London

3 months ago

RemoteFull_timegpu computingtransformer inferencecuda kernel optimisation

Workplace

Remote

Employment

Full_time

Location

London

Posted

3 months ago

Summary

Fuse Energy is hiring a CUDA Engineer to develop and optimise low-level GPU code for transformer inference workloads. The role focuses on custom CUDA kernels, GPU performance tuning, quantisation, mixed precision, and high-performance compute infrastructure, with benefits varying by location.

Responsibilities

  • Write and optimise custom cuda kernels
  • Profile kernels and remove performance bottlenecks
  • Apply kernel fusion across inference pipelines
  • Optimise memory access and hierarchy usage
  • Implement quantised mixed-precision inference kernels
  • Build caching mechanisms for autoregressive decoding
  • Benchmark kernels and write regression tests
cudac++streamsasynchronous executionkernel fusionmemory coalescingquantizationmixed-precision arithmeticptxsassparallel algorithm designmulti-gpumulti-node optimization
gpu computingtransformer inferencecuda kernel optimisationhigh-performance computingparallel algorithms