Sr Data Engineer

Visa Visa · Fintech · London, United Kingdom, United Kingdom

Senior Data Engineer at Visa, focusing on building and optimizing data platforms, data warehouses (Snowflake), and data governance using tools like dbt and Airflow. The role involves data modeling, ETL, cost optimization, and ensuring data quality within a financial services context.

What you'd actually do

  1. Support the building of robust data models downstream of backend services (mostly in Snowflake) that support internal reporting, financial and regulatory use cases.
  2. Focus on optimisation of our Data Warehouse, spotting opportunities to reduce complexity and cost.
  3. Help define and manage best practices for our Data Warehouse. This may include payload design of source data, logical data modelling, implementation, metadata, and testing standards.
  4. Set standards and ways of working with data across VXBS, working collaboratively with others to make it happen.
  5. Take established best practices and standards defined by the team and apply them within other areas of the business.

Skills

Required

  • Data Modelling
  • ETL projects
  • Big Data
  • Python
  • Java
  • AWS
  • SQL
  • Data Warehousing concepts
  • stream technologies like Kafka, Kinesis, Pulsar
  • IaC tools such as Terraform, AWS CloudFormation, or Ansible

Nice to have

  • finance function or knowledge of accounting
  • highly regulated environment
  • regulatory reporting and treasury operations in retail banking
  • dbt, Databricks
  • orchestration frameworks such as Airflow/Prefect
  • stream processing frameworks like Flink, Spark Streaming
  • AGILE ways of working (Kanban, Scrum)

What the JD emphasized

  • robust data sets requiring a high level of control