Data Engineer

Whatnot · Consumer · San Francisco, CA · Engineering

Data Engineer role focused on building and scaling data systems for a livestream shopping platform. Responsibilities include owning data architecture, building pipelines, designing data models, enforcing data quality, automating workflows, and enabling insights for analytics and ML teams. Requires 3+ years of experience in data/software engineering, expertise in modern data tooling (Kafka, dbt, Spark, Airflow, Great Expectations), cloud data warehouses (Snowflake, BigQuery), and production-grade Python/SQL.

What you'd actually do

  1. Own data architecture end-to-end.
  2. Build mission-critical pipelines.
  3. Design and implement canonical models.
  4. Enforce data quality at scale.
  5. Automate operational workflows.

Skills

Required

  • data warehousing
  • distributed data systems
  • event-driven architectures
  • dimensional modeling
  • Data Vault modeling
  • ledger-style modeling
  • Kafka
  • Debezium
  • dbt
  • Spark
  • Flink
  • Dagster
  • Airflow
  • Monte Carlo
  • Great Expectations
  • Snowflake
  • BigQuery
  • Redshift
  • Python
  • SQL
  • CI/CD
  • infrastructure-as-code

Nice to have

  • ML

What the JD emphasized

  • 3+ years of experience as a data or software engineer
  • deep hands-on expertise
  • operated cloud data warehouses
  • writing production-grade code
  • partnering across disciplines
  • self-starter