Karve
Browse all jobs

Member of Technical Staff, Pre-Training Data

Cohere · London

1 year ago

RemoteFull_timepre-training datadata curationnatural language processing

Workplace

Remote

Employment

Full_time

Location

London

Posted

1 year ago

Summary

This role develops pre-training data pipelines for Cohere's foundation language models, combining machine learning research with software engineering. The position is remote-friendly with location flexibility between EST and EU time zones, and focuses on data quality, curation, mixtures, and training efficiency.

Responsibilities

  • Conduct data ablations and test data mixtures
  • Develop data modeling techniques for training datasets
  • Research and implement data curation methods
  • Build data pipelines for language model training
  • Collaborate with researchers and engineers on pipelines
pythoncurriculum learningdata mixingdata attributiondata modelingdata ablationapache sparkapache beampandas
pre-training datadata curationnatural language processinglanguage modelsdata pipelines