Software Engineer, Search & Discovery Platform

Whatnot · Consumer · San Francisco, CA · Engineering

Software Engineer role focused on building and scaling the Discovery Platform, including recommendation systems, feed, browse, and search functionalities. This involves integrating retrieval, machine learning ranking, real-time processing, and content understanding to create a personalized discovery experience for a live shopping marketplace.

What you'd actually do

  1. Build the services and infrastructure to enable advanced recommendation systems solutions for real-time, dynamic feeds
  2. Build a scalable, stable, low latency discovery experience
  3. Partner closely across the machine learning, platform, and product engineering teams to utilize models to solve discovery problems
  4. Contribute scalable solutions across various serving stacks at the feed, search, machine learning service, and Discovery application layers.
  5. Define and advance our technical approach to scalable recommendation systems.

Skills

Required

  • 5+ years of experience
  • Bachelor’s degree in Computer Science, Statistics, Mathematics, Software Engineering, or related technical field, or equivalent work experience
  • Industry experience in building and scaling a platform to handle high volume / throughput applications
  • Ability to work autonomously and lead initiatives across multiple product areas and communicate findings with leadership and product teams.
  • Experience in machine learning fields (e.g. Recommendations, Content Understanding and Search).
  • Expert at designing and building scalable and maintainable backend systems.
  • Firm grasp of visualization tools for monitoring and logging e.g. DataDog, Grafana
  • Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Kafka, Flink/Spark, OpenSearch, ElasticSearch, Lucene, SOLR.
  • Experience with concurrent programming patterns across distributed systems (AsyncIO python preferred), and optimizations / profiling / observability associated with them.
  • Experience managing cloud technologies (AWS or Google Cloud) and comfort with infrastructure-as-code approaches (e.g. Terraform).
  • Proficiency in at least one server-side programming language (preferably Python), common algorithms and data structures, and software design principles.
  • Self-starter ethic, thriving under a high level of autonomy.
  • Exceptional interpersonal and communication skills.

What the JD emphasized

  • building discovery backend and data systems at scale
  • real-time
  • low latency
  • scalable recommendation systems

Other signals

  • building discovery backend and data systems at scale
  • integrate retrieval, ranking through machine learning
  • real-time and stream processing
  • content understanding
  • materialization into a highly personalized discovery experience