Lead Software Engineer Data and Payments Data Platform

JPMorgan Chase JPMorgan Chase · Banking · Austin, TX +1 · Commercial & Investment Bank

Lead Software Engineer for a Data and Payments Data Platform at JPMorgan Chase, focusing on designing, building, and maintaining scalable data pipelines and ETL/ELT workflows. The role involves developing data platform components, implementing data modeling strategies, and partnering with stakeholders to deliver data solutions. Requires experience with distributed data processing frameworks, cloud data services, and agile methodologies.

What you'd actually do

  1. Designs, builds, and maintains scalable data pipelines and ETL/ELT workflows for batch and real-time processing using Spark, Airflow, Kafka, and Flink
  2. Develops data platform components including data cataloging, data quality frameworks, and semantic/metrics layers with embedded governance, lineage, and compliance standards
  3. Implements data modeling strategies (fact and dimensional, wide tables) to support analytics, reporting, and downstream consumption
  4. Partners with analytics teams, product managers, and business stakeholders to translate data requirements into production-grade solutions
  5. Develops secure high-quality production code, and reviews and debugs code written by others

Skills

Required

  • software engineering concepts
  • system design
  • application development
  • testing
  • operational stability
  • data engineering
  • data platform development
  • Python
  • Java
  • SQL
  • Apache Spark
  • Apache Flink
  • data modeling
  • Apache Airflow
  • AWS S3
  • AWS Glue
  • AWS Redshift
  • AWS Athena
  • AWS EMR
  • AWS Lake Formation
  • Software Development Life Cycle
  • CI/CD
  • Application Resiliency
  • Security

Nice to have

  • LLMs
  • RAG architectures
  • vector databases
  • embedding-based retrieval systems
  • data mesh
  • data product architectures
  • Infrastructure as Code
  • Terraform
  • Docker
  • Kubernetes
  • data observability
  • data quality
  • metadata management tools
  • semantic layers
  • metrics stores
  • Tableau
  • dbt Metrics