Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)
Perplexity
4 weeks ago
Not specifiedFull_timesearch engine indexingdata processing pipelinesdistributed systems
4 weeks ago
Workplace
Not specified
Employment
Full_time
Posted
4 weeks ago
Summary
This member of technical staff role focuses on building large-scale search engine components, indexing pipelines, and data processing systems using rust, c++, c, and distributed technologies. The role involves systems-level optimization and production operations in a high-load search environment.
Responsibilities
- Design core search engine components
- Build indexing pipelines for billions of pages
- Develop streaming and batch processing systems
- Optimize hardware performance through low-level tuning
- Solve multithreading and concurrency challenges
- Operate and scale production systems
rustc++cpythonytkafkahadooplinuxkubernetesawssimdprofiling
search engine indexingdata processing pipelinesdistributed systemssystems programminginformation retrievallow-latency systems
