Senior Data Platform Engineer (data Core Processing Team), Hyderabad

Warner Bros Discovery Warner Bros Discovery · Media · Hyderabad, Telangāna, India · Technology

Warner Bros. Discovery is seeking a Senior Data Platform Engineer to join their Data Core Processing team in Hyderabad. This role involves building and maintaining scalable data pipelines, real-time streaming infrastructure, data lakes, analytics platforms, and machine learning infrastructure. The engineer will drive best practices, set standards, influence team strategy, and troubleshoot production issues. The role requires proficiency in Python/Scala/Java, distributed data processing frameworks (Spark, Flink), orchestration tools (Airflow), cloud data platforms (AWS, GCP, Azure), and real-time streaming technologies (Kafka).

What you'd actually do

  1. Has a track record of having built multiple high-performance, stable, scalable data systems that have been successfully shipped to production.
  2. Drives best practices and sets standards for the team in areas like data modeling, pipeline architecture, and system design.
  3. Is a key influencer in the team's strategy and contributes significantly to the team planning.
  4. You play a leading role in designing and developing major data infrastructure components, involving yourself and other engineers.
  5. You troubleshoot production issues by reviewing logs, metrics, data pipelines, and system health to pinpoint specific problems and then resolve them.

Skills

Required

  • Python
  • Scala
  • Java
  • Apache Spark
  • Apache Flink
  • Apache Airflow
  • Dagster
  • Prefect
  • AWS
  • GCP
  • Azure
  • S3
  • Redshift
  • BigQuery
  • Databricks
  • Snowflake
  • Apache Kafka
  • Kinesis
  • Parquet
  • Avro
  • Delta Lake
  • Iceberg
  • SQL
  • PostgreSQL
  • DynamoDB
  • Cassandra
  • Docker
  • Kubernetes
  • Terraform
  • CloudFormation
  • Prometheus
  • Grafana
  • CloudWatch
  • Datadog
  • ETL/ELT
  • Data Warehouse design
  • CI/CD
  • Git