Principal Engineer, Streaming Systems

Hightouch Hightouch · Data AI · New York, NY +1 · Engineering

Principal Engineer to lead high-throughput streaming systems for an AI platform. The role involves building infrastructure for ingesting and processing billions of behavioral events in real-time, supporting an AI agent product. Key responsibilities include maintaining low latency at high message throughput, improving caching, and architecting for message deduplication and zero-downtime deployments.

What you'd actually do

  1. Preserving <1s end to end system latency at throughput over 1,000,000 messages / second.
  2. Improving caching strategies for our online computation service
  3. Architecting a system that can deduplicate message delivery at 1,000,000 messages / second.
  4. Patterns for elegant and zero-downtime deployments in our online computation service

Skills

Required

  • architecting, building, deploying, and maintaining distributed systems at scale
  • leading highly complex and ambitious projects
  • mentoring and up leveling engineers
  • system design
  • high ownership

Nice to have

  • experience with cloud data warehouses like Snowflake and Databricks
  • experience with AI marketing and growth teams
  • experience with AI agents

What the JD emphasized

  • high-throughput systems
  • billions of behavioral events
  • millions of messages per second
  • single second latency
  • realtime computation
  • AI agent product