Senior Software Engineer - Back-end/data Pipeline - Venturaos

The Trade Desk The Trade Desk · Media · San Jose, CA · Software Engineering

Senior Software Engineer focused on backend/data pipeline development for a TV operating system. Responsibilities include designing, building, and maintaining large-scale data pipelines using technologies like Apache Spark, developing efficient data processing workflows, creating robust APIs, integrating with ML models, implementing monitoring, and optimizing data storage. The role emphasizes data warehousing, data governance, and experience with ML pipelines in personalization or ad-tech within streaming/TVOS platforms.

What you'd actually do

  1. Design, build, and maintain data pipelines for processing content catalog data using technologies like Apache Spark for the Ventura OS project
  2. Develop efficient data processing workflows that can handle large-scale data with optimal performance
  3. Create robust APIs that securely expose data services to other parts of our platform
  4. Collaborate with data scientists to integrate with their models and algorithms in production environments
  5. Implement monitoring and observability for data pipelines to ensure reliability and performance

Skills

Required

  • data warehousing solutions like Vertica, Snowflake, or Databricks
  • data governance and data quality frameworks
  • machine learning pipelines and MLOps
  • personalization, content recommendations, ad-tech solutions, or e-commerce optimization
  • streaming or TVOS platforms
  • content metadata processing and management

Nice to have

  • Apache Spark
  • robust APIs
  • monitoring and observability
  • data storage and retrieval optimization
  • architectural decisions around data infrastructure
  • cross-functional collaboration

What the JD emphasized

  • shape the future of personalized content delivery and consumer experiences
  • streaming, TVOS, or e-commerce data ecosystems
  • high-scale, data-intensive environments
  • invent answers no one has thought of yet
  • trust-builders, generous givers, scrappy problem solvers, and relentless pursuers of excellence.