Software Engineer II - Platform Engineer/databricks

JPMorgan Chase JPMorgan Chase · Banking · Jersey City, NJ +1 · Corporate Sector

Software Engineer II - Platform Engineer/Databricks role within the Chief Data Analytics Office - AIML Data Platforms Team at JPMorgan Chase. The role focuses on enhancing, building, and delivering technology products, specifically managing and supporting an AWS Databricks platform for data engineering, Data Science/ML, and application teams. Responsibilities include executing software solutions, troubleshooting, building solutions around Data Lake tools, and maintaining the Databricks platform.

What you'd actually do

  1. Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
  2. Solves the companies most challenging cloud data platform problems by building innovative technical solutions around Data Lake tools
  3. Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
  4. Designs, implements, and maintains a managed AWS Databricks platform, and provides engineering and operational support for the platform to SRE and app teams.
  5. Performs platform design, set-up and configuration, workspace administration, resource monitoring, providing engineering support to data engineering teams, Data Science/ML, and Application/integration teams.

Skills

Required

  • Formal training or certification on software engineering concepts and 2+ years applied experience
  • Hands-on practical experience in system design, application development, testing, and operational stability
  • Hands-on experience with Python and/or Java application program development with use of automated unit testing
  • Hands-on experience with AWS services including provisioning infrastructure using automated tools
  • Hands-on experience with GitHub / Bitbucket code versioning tool, Jenkins build tool and pypi / maven artifactory integrations
  • Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
  • Knowledge of Big Data distributed compute frameworks like Spark and Terraform

Nice to have

  • Hands-on experience with Big Data Spark Data Pipeline development
  • Hands-on experience with Terraform Enterprise Infrastructure provisioning
  • Hands-on experience with Databricks
  • Knowledge about Platform Administration, Monitoring and Resiliency