Senior Lead Software Engineer - Python/aws/ai/llm

JPMorgan Chase JPMorgan Chase · Banking · Jersey City, NJ +1 · Asset & Wealth Management

Senior Lead Software Engineer focused on building and deploying AI/ML and LLM-powered solutions within a large enterprise (JPMorgan Chase). The role involves hands-on architecture, implementation, and productionization of ML models, services, and platforms, with a strong emphasis on scalable data processing pipelines and model inference services on AWS. It also includes driving the adoption of AI-assisted engineering practices and ensuring responsible AI use.

What you'd actually do

  1. Hands-on architecture and implementation of lighthouse ML and LLM-powered solutions
  2. Design and implement highly scalable and reliable data processing pipelines and deploy model inference services
  3. Experiment, develop, and productionize high-quality machine learning models, services, and platforms to make a huge technology and business impact; Deploy solutions into public cloud infrastructure.
  4. Drives adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test acceleration, release readiness, incident/root-cause analysis), while establishing measurable validation standards (secure coding, peer review, automated testing) and promoting reuse of proven patterns and automation within the SDLC/TLM toolchain.
  5. Collaborate with firmwide AI/ML teams, Business and Product Partners, peers in geographically dispersed teams, and colleagues across JPMorgan AWM’s lines of business and functions to drive alignment, accelerate adoption of common AI capabilities, and deliver impactful solutions

Skills

Required

  • Python
  • AWS
  • Data Structures
  • Algorithms
  • Machine Learning
  • Data Mining
  • Information Retrieval
  • Statistics
  • Software Development Life Cycle
  • Cloud computing platforms
  • Data management
  • Data model design
  • Real-time data processing
  • SQL
  • NoSQL
  • Leadership capacity
  • GenAI-based solutions
  • Communication skills

Nice to have

  • Azure
  • Kubernetes

What the JD emphasized

  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching senior engineers/leads on compliant usage patterns and controls.
  • Experience in using LLMs (OpenAI, Anthropic, or other models) to solve business problems, including full workflow toolset such as tracing, evaluations, and guardrails

Other signals

  • productionize machine learning models
  • deploy model inference services
  • AI-assisted engineering practices
  • LLM-powered solutions