Staff Engineer - Data platform
Kpler
2 months ago
Hybridreal-time data pipelinesbatch data processingdistributed systems
2 months ago
Workplace
Hybrid
Posted
2 months ago
Summary
This principal-level data platform engineer role focuses on real-time and batch pipelines, cloud infrastructure, distributed systems, and data products supporting commodities, energy, and maritime markets. The working arrangement is not specified.
Responsibilities
- Design and maintain real-time data pipelines
- Develop and operate batch data pipelines
- Improve pipeline reliability and observability
- Own complex cloud-based data infrastructure
- Manage data products across stakeholder groups
- Lead and mentor fellow data engineers
- Deliver end-to-end data platform features
javakafkaflinkawsgcpazuresparkterraformpulumipythonscalaai agents
real-time data pipelinesbatch data processingdistributed systemscloud infrastructurecommoditiesmaritime data
