Karve
Browse all jobs

Research Engineer, Pretraining

Anthropic · London

£260k–£630k8 months ago

HybridFull Timelarge language model pretrainingml training infrastructuredistributed training

Salary

£260k–£630k

Workplace

Hybrid

Employment

Full Time

Location

London

Posted

8 months ago

Summary

Anthropic is seeking a research engineer for its pretraining team to develop the next generation of large language models. The role combines research and practical engineering across model architecture, algorithms, data processing, optimizers, and training infrastructure, with a hybrid office policy (at least 25% in office).

Responsibilities

  • Research and implement model architecture solutions
  • Develop algorithms for data processing and optimizers
  • Design and analyze scientific experiments
  • Optimize and scale training infrastructure
  • Develop and improve developer tooling
  • Contribute across the stack from optimizations
  • Lead small research projects independently
pythonpytorchdeep learninglarge-scale machine learninglanguage modelstransformer architecturesreinforcement learningetlkubernetesgpusdistributed trainingdata processingoptimizer developmentmodel architecturescientific experimentstraining infrastructuredev toolingfault toleranceattention mechanismsdistributed training jobsos internals
large language model pretrainingml training infrastructuredistributed trainingmodel architecturereinforcement learning