Lead Data Platform Engineer

Disney Disney · Media · Burbank, CA +4

Lead Data Platform Engineer responsible for designing and developing enterprise data platform solutions, including a Finance Data Layer data lakehouse, and leading development teams. Focuses on scalable data solutions, ETL/ELT pipelines, and establishing data standards.

What you'd actually do

  1. Leading teams of developers (both Disney Cast Members and external vendors) in major software/data development projects.
  2. Designing and developing highly scalable, distributed enterprise data platform solutions.
  3. Design, develop and implement scalable distributed enterprise data platform solutions, focusing on multi-cluster warehousing, data sharing, and optimized storage.
  4. Write code that establishes and enhances frameworks and design proof of concepts, and review code for correctness, and its impact on software architecture.
  5. Lead the development of high-performance ETL/ELT pipelines using tools like dbt, Python, Airflow and more to integrate diverse data sources.

Skills

Required

  • Scala
  • Java
  • Python
  • SQL
  • dbt
  • Airflow
  • Snowflake
  • Cloud Data Platforms (AWS, Azure, or GCP)
  • Medallion Architecture
  • Data Warehousing
  • Dimensional Modeling
  • ETL/ELT
  • CI/CD for data
  • RBAC
  • Data Quality Frameworks

Nice to have

  • Finance data domains
  • HR data domains
  • AI/ML
  • SAP Systems
  • EPM Systems
  • Data Governance
  • Master Data Management
  • BI tools

What the JD emphasized

  • 7+ years of professional programming and design experience in Scala, Java, Python etc.; demonstrated experience designing and developing enterprise data solutions and platforms
  • Demonstrated experience leading engineering initiatives on major software and data development projects
  • Experience with medallion-based data Lakehouse architectures
  • Experience with high-scale cloud data platforms and with at least one major cloud provider (AWS, Azure, or GCP)
  • Expert knowledge of data integration, dimensional modeling and data warehousing techniques.
  • Experience implementing CI/CD pipelines for data
  • Proficiency in Java, SQL
  • Experience with Snowflake