Senior Software Engineer, Streaming Platform

Sentry Sentry · Enterprise · San Francisco, CA · Engineering

Sentry is seeking a Senior Software Engineer to join their Streaming Platform team. This role will focus on building and operating infrastructure for their ingestion pipelines and real-time data processing systems, handling hundreds of thousands of events per second. The engineer will work on challenges at the intersection of distributed systems, real-time data processing, and developer experience, creating a self-service streaming platform.

What you'd actually do

  1. Design, build, and operate components of our Streaming Platform, including Kafka, the streaming runtime, high-level APIs, and developer-facing abstractions.
  2. Implement resilient, high-throughput stream processing systems that handle unbounded datasets with strong correctness guarantees (delivery, checkpointing, watermarking, and more).
  3. Build scalable automation and control plane for Kafka fleet management and improve efficiency.
  4. Partner with product engineers to ensure our abstractions enable fast, reliable, and consistent ingestion pipelines.
  5. Improve observability, monitoring, and failover for mission-critical real-time systems.

Skills

Required

  • distributed systems
  • data infrastructure
  • real-time streaming
  • Kafka
  • Flink
  • Spark Streaming
  • partitioning
  • watermarks
  • windowing
  • stateful/stateless processing
  • delivery guarantees
  • Kubernetes
  • AWS
  • GCP
  • Python
  • Rust
  • Go
  • Java

Nice to have

  • ClickHouse
  • Arrow
  • Materialize
  • RisingWave

What the JD emphasized

  • 5+ years of software engineering experience
  • distributed systems
  • real-time streaming
  • Kafka
  • Kubernetes
  • AWS
  • GCP