Karve
Browse all jobs

Staff Engineer - Data platform

Kpler

2 months ago

Hybridreal-time data pipelinesbatch data processingdistributed systems

Workplace

Hybrid

Posted

2 months ago

Summary

This principal-level data platform engineer role focuses on real-time and batch pipelines, cloud infrastructure, distributed systems, and data products supporting commodities, energy, and maritime markets. The working arrangement is not specified.

Responsibilities

  • Design and maintain real-time data pipelines
  • Develop and operate batch data pipelines
  • Improve pipeline reliability and observability
  • Own complex cloud-based data infrastructure
  • Manage data products across stakeholder groups
  • Lead and mentor fellow data engineers
  • Deliver end-to-end data platform features
javakafkaflinkawsgcpazuresparkterraformpulumipythonscalaai agents
real-time data pipelinesbatch data processingdistributed systemscloud infrastructurecommoditiesmaritime data