Data Platform Engineer

Apple Apple · Big Tech · Hyderabad, India · Software and Services

Seeking a Software Engineer / Senior Software Engineer with Data engineering expertise to build and operate large-scale distributed data systems using technologies like Kafka Connect, Apache Spark, and Apache Flink. The role involves leading projects, mentoring junior members, and driving data innovation while upholding privacy commitments.

What you'd actually do

  1. build and operate large-scale distributed data systems using technologies such as Kafka Connect, Apache Spark, and Apache Flink
  2. manage a broad range of stakeholders and clearly communicate complex data strategies
  3. leading projects from initial concept through delivery
  4. mentoring and supporting junior team members

Skills

Required

  • design and development of scaling, and operation of distributed systems
  • Apache Spark
  • Kafka
  • Flink
  • Iceberg
  • Hive
  • Apache Kubernetes
  • Yarn
  • Java
  • Scala
  • designing and developing scalable, reliable APIs
  • debugging complex issues in large-scale distributed systems
  • communication and collaboration skills

Nice to have

  • Rust
  • Contributions to Open-Source projects like Apache Iceberg/Spark/ Kafka / Flink
  • Exposure to building Pub/Sub mechanism for message flow
  • Exposure of building and handling large scale distributed systems
  • Exposure to applied machine learning
  • Analytics
  • business intelligence
  • Curiosity to explore and understand data