Software Engineer, Data

Whatnot · Consumer · San Francisco, CA · Engineering

Software Engineer, Data at Whatnot, responsible for the retrieval platform powering next-gen systems. Focuses on defining technical direction, leading development, and ensuring scalability and performance. Integrates data systems, optimizing machine learning, real-time analytics, stream processing, and content understanding.

What you'd actually do

  1. play a critical role in defining the technical direction and leading the development of the retrieval platform to power next-gen systems at Whatnot
  2. driving innovation, ensuring the scalability and performance of our systems, and working with a team of engineers to deliver high-quality solutions
  3. make key decisions about how we integrate data systems at Whatnot – and then make it happen
  4. align efforts to optimize other aspects of our company’s architecture, such as machine learning, real-time analytics, stream processing, and content understanding to name a few

Skills

Required

  • 3+ years of experience
  • Ability to write well-tested, API-driven applications and services that run at scale in production
  • Track record of building scalable and performant distributed systems
  • Expertise in managing cloud data stores (Snowflake, BigQuery, Redshift, etc.) for processing and serving data products
  • Expertise in streaming data systems such as Kafka, Flink, or Pulsar, and the ability to design and manage real-time processing pipelines at scale
  • Strong experience supporting operational systems to ensure uptime, reliability, and maintainability, including monitoring, alerting, and incident management
  • Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (e.g. Terraform)
  • Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles
  • Self-starter ethic, thriving under a high level of autonomy
  • Exceptional interpersonal and communication skills

What the JD emphasized

  • retrieval platform
  • machine learning
  • real-time analytics
  • stream processing
  • content understanding