Lead Software Engineer - Test Automation

JPMorgan Chase JPMorgan Chase · Banking · Chicago, IL +1 · Commercial & Investment Bank

Lead Software Engineer focused on test automation for AI-driven chat solutions within JPMorgan Chase's Commercial & Investment Bank. Responsibilities include designing and executing test strategies, building automation frameworks, integrating tests into CI/CD, and validating AI/ML models for fairness and performance. Requires strong software development, agile, and financial services experience, with preferred skills in LLMs and prompt engineering.

What you'd actually do

  1. Design, implement, and execute test plans and test cases specifically targeting AI-driven conversational flows, natural language understanding (NLU), and machine learning model outputs.
  2. Integrate automated tests into CI/CD pipelines to enable rapid, reliable, and repeatable validation of new features and bug fixes.
  3. Validate AI/ML models, ensuring they meet functional and non-functional requirements, including fairness, bias mitigation, and performance.
  4. The role will involve quality and test advocacy and the individual will need to have hands on Quality Engineering and test automation experience, as well as strong lead skills.
  5. Stay current with advancements in AI, test automation, and quality engineering, and proactively introduce innovative tools and practices to the team.

Skills

Required

  • Formal training or certification on software engineering concepts and 5+ years hands on Software Development Life Cycle experience
  • Advanced level experience with building and maintaining testing automation frameworks with strong problem solving skills
  • Hands-on practical experience delivering system design, application development, testing, and operational stability
  • Advanced in one or more programming language(s), such as Java
  • Proficiency in automation and continuous delivery methods
  • Proficient in all aspects of the Software Development Life Cycle
  • Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
  • Demonstrated proficiency in software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
  • In-depth knowledge of the financial services industry and their technology infrastructure.

Nice to have

  • Working knowledge of Large Language Models and Prompt Engineering
  • Experience managing team - Set clear direction, drive performance and contribute to process efficiencies
  • Exposure to Accessibility Testing
  • Strong experience in Mongo, SQL, Casandra and Oracle preferred
  • Experience in developing In-Sprint Test Automation scripts is an added advantage

What the JD emphasized

  • AI-driven chat solutions
  • validate AI/ML models for fairness and performance
  • AI-driven conversational flows
  • natural language understanding (NLU)
  • machine learning model outputs
  • fairness, bias mitigation, and performance

Other signals

  • AI-driven chat solutions
  • validate AI/ML models for fairness and performance
  • AI-driven conversational flows
  • natural language understanding (NLU)
  • machine learning model outputs