Senior Software Engineer (data Infrastructure)

Snyk Snyk · Enterprise · London, United Kingdom

Senior Software Engineer focused on data infrastructure, specifically managing and improving large-scale Kafka clusters and Snowflake data warehousing. The role involves designing, implementing, and maintaining these systems using Infrastructure as Code (Terraform) and programming languages like Go, Python, and TypeScript, with a strong emphasis on reliability, scalability, and developer experience within an AI-native development context.

What you'd actually do

  1. Designing, implementing, and managing our large-scale Confluent and AWS MSK Kafka clusters, ensuring their high availability, performance, and scalability.
  2. Developing and maintaining Infrastructure as Code solutions for both Kafka and Snowflake platforms using Terraform.
  3. Crafting and architecting complex data pipelines within cloud-based distributed systems.
  4. Defining and enforcing best practices, governance, and self-service capabilities for our data platforms to improve developer experience.
  5. Coding mainly Go, and occasionally in Python or TypeScript, deploying solutions in a CI/CD workflow.

Skills

Required

  • Kafka administration
  • performance optimization
  • Terraform
  • distributed systems architecture
  • Go
  • TypeScript
  • AWS
  • Snowflake
  • building and operating highly reliable, scalable back-end systems
  • code quality
  • testing
  • operational excellence
  • communication
  • collaboration

Nice to have

  • Kubernetes
  • Schema Registry
  • Kafka Connect
  • data ownership
  • building sustainable solutions

What the JD emphasized

  • AI-native development lifecycle
  • AI transforms how software is built
  • AI era