Karve
Browse all jobs

Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)

Perplexity

4 weeks ago

Not specifiedFull_timesearch engine indexingdata processing pipelinesdistributed systems

Workplace

Not specified

Employment

Full_time

Posted

4 weeks ago

Summary

This member of technical staff role focuses on building large-scale search engine components, indexing pipelines, and data processing systems using rust, c++, c, and distributed technologies. The role involves systems-level optimization and production operations in a high-load search environment.

Responsibilities

  • Design core search engine components
  • Build indexing pipelines for billions of pages
  • Develop streaming and batch processing systems
  • Optimize hardware performance through low-level tuning
  • Solve multithreading and concurrency challenges
  • Operate and scale production systems
rustc++cpythonytkafkahadooplinuxkubernetesawssimdprofiling
search engine indexingdata processing pipelinesdistributed systemssystems programminginformation retrievallow-latency systems