Staff Data Engineer

Visa Visa · Fintech · London, United Kingdom, United Kingdom

Staff Data Engineer at Visa focused on building and optimizing the data platform, including data models, data warehouse (Snowflake), ETL processes, and data governance. The role involves cost optimization, best practice definition, and working with stream technologies and IaC tools.

What you'd actually do

  1. Support the building of robust data models downstream of backend services (mostly in Snowflake) that support internal reporting, financial and regulatory use cases.
  2. Focus on optimization of our Data Warehouse, spotting opportunities to reduce complexity and cost.
  3. Help define and manage best practices for our Data Warehouse. This may include payload design of source data, logical data modelling, implementation, metadata, and testing standards.
  4. Set standards and ways of working with data across VXBS, working collaboratively with others to make it happen.
  5. Take established best practices and standards defined by the team and apply them within other areas of the business.

Skills

Required

  • Python
  • Java
  • AWS
  • SQL
  • data modelling
  • Data Warehousing concepts
  • stream technologies (Kafka, Kinesis, Pulsar)
  • IaC tools (Terraform, CloudFormation, Ansible)

Nice to have

  • dbt
  • Databricks
  • Airflow
  • Prefect
  • Flink
  • Spark Streaming
  • finance function experience
  • accounting knowledge
  • regulatory reporting
  • treasury operations
  • AGILE ways of working

What the JD emphasized

  • robust data models
  • optimization of our Data Warehouse
  • reduce complexity and cost
  • best practices for our Data Warehouse
  • standards
  • robust and reliable data sets requiring a high level of control