Senior Software Development Engineer, Big Data

Zillow Zillow · Consumer · Mexico City, Mexico

This role is for a Senior Software Development Engineer on the Data Lifecycle Management Team at Zillow. The team focuses on providing guardrails for security, privacy, and data quality within the data platform, ensuring adherence to industry standards. The engineer will develop and support data platform infrastructure using technologies like Spark, Hive, Airflow, Databricks, Kafka, and Flink, collaborating with data scientists and other teams to empower internal customers with high-quality data solutions. Responsibilities include developing and supporting data platform infrastructure, setting up and optimizing data pipelines, and developing scalable processes. Experience with cloud infrastructure (AWS), Kubernetes, and data governance is required, with Databricks experience being a plus.

What you'd actually do

  1. developing and supporting data platform infrastructure
  2. collaborate to provide Data Platform Environments that empower internal Zillow Group customers to deliver high-quality data solutions that create trust and delight our customers
  3. Experience in software development with one or more programming languages such as Python, Java, C++, etc.
  4. Experience with and ability to debug/troubleshoot container orchestration platforms like Kubernetes.
  5. Experience with data infrastructure systems like Databricks, Spark, Hive, Airflow, Trino, Kafka, and Flink.

Skills

Required

  • Python
  • Java
  • C++
  • AWS
  • Kubernetes
  • Databricks
  • Spark
  • Hive
  • Airflow
  • Trino
  • Kafka
  • Flink
  • data pipelines
  • scalable processes

Nice to have

  • Databricks experience is a plus
  • Experience with Data Governance & Compliance (CCPA/CPRA, GDPR, SOX, etc) is a plus

What the JD emphasized

  • Data Governance & Compliance (CCPA/CPRA, GDPR, SOX, etc)