Full-stack Engineer 5 - Decisioning & Optimization

Netflix Netflix · Big Tech · New York, NY +3 · Engineering

Full-stack engineer to build internal tools and dashboards for ad decisioning stack, focusing on observability, debugging, and monitoring of ML model serving, auction mechanics, and campaign delivery.

What you'd actually do

  1. Design and build end-to-end internal tools and dashboards that give the team visibility into the ad decisioning stack, from model inference through different stages of auction
  2. Build an ad decision debugger: trace the full path of an ad request (features, model scores, ranking, auction, delivery, billing) and surface why a particular ad was selected at a particular bid price
  3. Build model serving observability: inference latency, score distributions, fallback rates, feature coverage, and calibration health across dozens of concurrent models
  4. Build campaign delivery monitoring tools: spend tracking dashboards, frequency cap compliance views, pacing curve visualization, underspend and overspend alerts
  5. Own the UI and BFF layer for experimentation and testing platforms, visualizing counterfactual results and offline vs. online comparison

Skills

Required

  • 7+ years of professional software engineering experience building production systems
  • meaningful full-stack experience across UI, BFF/API layer, and backend services
  • Proficiency in modern UI frameworks (React preferred), TypeScript/JavaScript, and Node.js
  • Experience building scalable backend systems in Java, Kotlin, or similar JVM languages
  • Built observability tooling, operational dashboards, or debugging tools for complex distributed systems
  • Strong analytical mindset with a bias toward building tools that enable self-service investigation and decision-making
  • Comfortable with data: can query, aggregate, and visualize large datasets across SQL, streaming data, and time-series metrics
  • Experience building tools that instrument or trace request paths through multi-service architectures
  • Product mindset that is deeply empathetic to user needs, strategic in orientation, and driven by outcomes

Nice to have

  • Ads domain experience: worked on ad serving, delivery, or marketplace systems and understands the operational data they produce
  • Built model serving monitoring tools: inference latency dashboards, score distribution tracking, fallback and calibration health views
  • Experience with observability platforms: metrics, logging, tracing stacks at scale
  • Familiar with marketplace dynamics: auction behavior, pacing anomalies, budget delivery patterns, and the tooling needed to diagnose them

What the JD emphasized

  • production systems
  • observability tooling
  • complex distributed systems
  • analytical mindset
  • instrument or trace request paths