Karve
Browse all jobs

Senior Research Scientist (Architectures Research)

Nebius · London

2 months ago

Not specifiednlpllm architectureslong-context modeling

Workplace

Not specified

Location

London

Posted

2 months ago

Summary

This senior research scientist role focuses on developing efficient model architectures and methods for attention, memory, reasoning, and adaptation. The stack includes Python, transformers, sparse and linear attention, model distillation, distributed training, and efficient inference; the working arrangement is not specified.

Responsibilities

  • Formulate original research questions and experimental programs
  • Design and evaluate architectural changes at scale
  • Develop methods reducing training and inference costs
  • Collaborate with engineers on efficient implementations
  • Publish research and contribute to open-source models
  • Mentor researchers and shape research direction
pythontransformersattentionsparse attentionlinear attentionlong-context modelingmemory systemsmodel distillationdistributed trainingefficient inferencelanguage-model trainingopen-source models
nlpllm architectureslong-context modelingmodel efficiencydistributed trainingopen-source ai