Staff Software Engineer, Batch Processing Platform

Pinterest Pinterest · Consumer · Seattle, WA · Data Engineering

Staff Software Engineer focused on building and optimizing Pinterest's batch processing platform and infrastructure using big data technologies like Spark, Presto/Trino, and Iceberg, handling petabytes of data. Responsibilities include design, implementation, optimization, collaboration, technical leadership, and mentorship.

What you'd actually do

  1. Design, implement, and optimize Pinterest’s batch processing infrastructure.
  2. Collaborate with cross-functional teams to understand data needs.
  3. Lead technical projects and initiatives, driving them to completion.
  4. Mentor and guide junior engineers on best practices and architecture.
  5. Ensure the reliability, scalability, and efficiency of data systems.

Skills

Required

  • Java
  • Scala
  • Python
  • Spark SQL
  • Presto/Trino
  • designing and maintaining scalable data infrastructure
  • building and supporting large scalable big data infrastructure/platforms

Nice to have

  • Iceberg

What the JD emphasized

  • 6+ years of experience building and supporting large scalable big data infrastructure/platforms
  • Extensive experience with big data query technologies such as Spark SQL or Presto/Trino.
  • Proven skills in designing and maintaining scalable data infrastructure.