Karve
Browse all jobs

Senior Data Engineer

Super Payments · London

1 month ago

Not specifiedevent-driven ingestionstreaming pipelinesdata warehousing

Workplace

Not specified

Location

London

Posted

1 month ago

Summary

Senior data engineer role building and operating an event-driven data platform using AWS, Snowflake, Python, Terraform, dbt, and Datadog. The work focuses on streaming ingestion, warehouse engineering, infrastructure reliability, data security, and quality, with a flexible working model and work-from-home setup.

Responsibilities

  • Build event-driven ingestion pipelines across aws services
  • Design snowpark python procedures for batch loads
  • Manage schema evolution and late-arriving data
  • Extend terraform modules across multiple environments
  • Create datadog monitors and resolve ingestion failures
  • Develop dbt pipelines and data quality tests
  • Secure pii with masking and access controls
awseventbridgekinesis firehoses3snowpipesnowflakesnowparkpythonpoetrypydanticpytestterraformterragruntgithub actionsdatadogsqldbtsnowflake dynamic tablessnowflake taskshashingdata masking
event-driven ingestionstreaming pipelinesdata warehousinginfrastructure as codedata securitydata quality