Aws Big Data Lead Software Engineer

JPMorgan Chase JPMorgan Chase · Banking · Columbus, OH +1 · Consumer & Community Banking

Lead Software Engineer role focused on designing and building applications using AWS infrastructure and distributed compute technologies like Apache Flink or Spark on large datasets. Responsibilities include implementing batch and real-time software components, ensuring code quality, collaborating with agile teams, and providing production support. Requires strong experience in software engineering, distributed datastores, AWS services, and big data technologies.

What you'd actually do

  1. Design & build new applications utilizing leading edge technologies and modernize existing applications
  2. Implement batch & real-time software components consistent with architectural best-practices of reliability, security, operational efficiency, cost-effectiveness and performance
  3. Ensure quality of deployed code via automated unit, integration & acceptance testing
  4. Collaborate with multi-national agile development, support and business teams to meet sprint objectives
  5. Provide level 2 support for production systems

Skills

Required

  • Formal training or certification on software engineering concepts
  • Hands-on practical experience in Frameworks, system design, application development, testing, and operational stability
  • Experience with Apache Spark, Apache Flink or similar large-scale data processing engines
  • Experience with Distributed Datastores (e.g. Cassandra, Red Shift)
  • Experience designing, developing and deploying software components on AWS using common compute and storage services such as EC2, EKS, Lambda, S3
  • Experience with Big Data / Distributed / cloud technology (AWS Big data services like lambda, glue, glue emr, Performance tuning, Streaming, KAFKA, Entitlements etc., )
  • Experience with Apache Spark, Ray or similar large-scale data processing engines
  • Proficiency in automation and continuous delivery methods
  • Proficient in all aspects of the Software Development Life Cycle
  • Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
  • Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, BigData, artificial intelligence, machine learning, mobile, etc.)

Nice to have

  • Experience building ETL/Feature processing pipelines
  • Experience using workflow orchestration tools—Airflow, Kubeflow etc.
  • Experience using Terraform to deploy infrastructure-as-code to public cloud
  • Experience with Linux scripting such as Bash, KSH, or Python
  • Certified AWS Cloud Practitioner, Developer or Solutions Architect strongly preferred

What the JD emphasized

  • 5+ years applied experience
  • Experience with Apache Spark, Apache Flink or similar large-scale data processing engines
  • Experience with Big Data / Distributed / cloud technology