Software Development Engineer - Big Data, Brand Metrics and Benchmarks

Amazon Amazon · Big Tech · NY +1 · Software Development

Software Development Engineer role focused on building and architecting large-scale big data pipelines and data paradigms for advertising data at Amazon. The role involves designing fault-tolerant data pipelines, enabling real-time analytics and ML applications, and collaborating with data scientists and partner teams. It requires experience with big data technologies like Spark and AWS, and focuses on stability, reliability, and continuous improvement of the data platform.

What you'd actually do

  1. Design and build highly scalable, fault-tolerant data pipelines processing petabytes of advertising data
  2. Architect new data paradigms that enable real-time analytics and machine learning applications
  3. Collaborate with data scientists, product managers, and partner teams across Amazon Ads to deliver data solutions that drive business impact
  4. Mentor junior engineers through code reviews, design discussions, and pair programming
  5. Contribute to technical strategy and architectural decisions for our data platform

Skills

Required

  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • 1+ years of big data technologies such as AWS, Hadoop, Spark, Pig, Hive, Lucene/SOLR or Storm/Samza experience

Nice to have

  • 4+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • 4+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling) experience
  • Experience building and operating data pipelines using Apache Spark and Scala on Amazon EMR, spanning extraction, ingestion, batch and streaming processing.
  • Data lake design with Apache Iceberg a plus.