Senior Data Engineer
Super Payments · London
1 month ago
Not specifiedevent-driven ingestionstreaming pipelinesdata warehousing
1 month ago
Workplace
Not specified
Location
London
Posted
1 month ago
Summary
Senior data engineer role building and operating an event-driven data platform using AWS, Snowflake, Python, Terraform, dbt, and Datadog. The work focuses on streaming ingestion, warehouse engineering, infrastructure reliability, data security, and quality, with a flexible working model and work-from-home setup.
Responsibilities
- Build event-driven ingestion pipelines across aws services
- Design snowpark python procedures for batch loads
- Manage schema evolution and late-arriving data
- Extend terraform modules across multiple environments
- Create datadog monitors and resolve ingestion failures
- Develop dbt pipelines and data quality tests
- Secure pii with masking and access controls
awseventbridgekinesis firehoses3snowpipesnowflakesnowparkpythonpoetrypydanticpytestterraformterragruntgithub actionsdatadogsqldbtsnowflake dynamic tablessnowflake taskshashingdata masking
event-driven ingestionstreaming pipelinesdata warehousinginfrastructure as codedata securitydata quality