Summary

Senior Member of Technical Staff focused on building large-scale web data pipelines for pretraining Cohere's language models. The role is remote-friendly with no location restrictions, within EST/EU overlap, and involves web data processing, quality assessment, deduplication, and collaboration with research and engineering teams.

Responsibilities

• Maintain large-scale pipelines for web corpora
• Build filtering and quality-scoring systems
• Analyze web data across domains, languages, and periods
• Develop deduplication pipelines for web data
• Collaborate with researchers and engineers on pipelines