Lead Software Engineer - Aws

JPMorgan Chase JPMorgan Chase · Banking · Dublin, Ireland · Corporate Sector

Lead Software Engineer role focused on data integration, analysis, and building data pipelines within a Workforce Technology team at JPMorgan Chase. Requires experience with Big Data technologies, AWS services, Spark, Kafka, and CI/CD, with a focus on human resources analytics.

What you'd actually do

  1. Manage data integration and data analysis of disparate systems
  2. Build extensible data acquisition and integration solutions to meet the functional and non-functional requirements of the client
  3. Implement processes and logic to extract, transform, and distribute data across one or more data stores from a wide variety of sources
  4. Provide problem-solving expertise and complex analysis of data to develop business intelligence integration designs
  5. Interface with other internal product development teams as well as cross functional teams (Product Management, Integration Engineering, Quality Engineering, System Admin Teams)

Skills

Required

  • Experience in data integration projects using Big Data Technologies, preferably related to human resources analytics
  • Experience in managing team of at least 5-10 engineers.
  • Experience in AWS Data Warehousing and database platforms with hands-on delivery using EMR, S3, AWS Glue, Lambda, Apache Airflow and Infrastructure as Code (IaC) (e.g., Terraform/CloudFormation)
  • 5+ years hands-on experience on Spark engineering with PySpark/Scala for building and optimizing scalable data pipelines and 2+ years hands-on experience building streaming applications using Kafka
  • Strong experience in CICD using Jenkins, Git, Artifactory, Yaml, Maven for Cloud deployments
  • Good knowledge of Big Data querying tools, such as Athena, RDS, Databricks
  • Experience in integrating data from different types of file-storage formats like Parquet, ORC, Avro and table formats like Delta Lake or Iceberg
  • Good knowledge of Java opensource, API standards, JUnits, Spring Boot applications, Swagger Setup
  • Experience using AI-assisted developer productivity tools (e.g., GitHub Copilot) to speed up development, testing, and remediation
  • Strong technical understanding in building scalable, high performance distributed services/systems
  • Strong knowledge of Data Warehousing, Data Modeling and Data Lake, Data Security concepts
  • Possesses strong problem solving, troubleshooting, and analytical skills, as well as excellent communication, presentation and interpersonal, including the ability to communicate complex concepts clearly to different audiences
  • Experience in technologies like Oracle/SQL and NoSQL data stores such as DynamoDB
  • Ability to quickly learn new technologies in a dynamic environment

Nice to have

  • Experience in Databricks
  • Experience in Human Resources analytics

What the JD emphasized

  • Experience in managing team of at least 5-10 engineers.