Sr Lead Software Engineer

JPMorgan Chase JPMorgan Chase · Banking · Jersey City, NJ +1 · Corporate Sector

Senior Lead Software Engineer focused on building and deploying agentic AI systems and LLM-based applications within a regulated financial services environment. Responsibilities include end-to-end design, implementation, and ownership of production AI systems, including RAG pipelines, agent workflows, observability, evaluation, and safety. Also drives adoption of AI-assisted engineering practices.

What you'd actually do

  1. Builds and maintains agentic AI systems, including multi-agent workflows, tool-use integrations, and human-in-the-loop controls appropriate for regulated financial services environments
  2. Implements LLM-based applications including RAG pipelines, embedding workflows, vector store integrations, and model serving infrastructure
  3. Owns observability, evaluation, and safety of production AI systems — including prompt monitoring, output validation, cost tracking, and latency optimization
  4. Drives adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test acceleration, release readiness, incident/root-cause analysis), while establishing measurable validation standards (secure coding, peer review, automated testing) and promoting reuse of proven patterns and automation within the SDLC/TLM toolchain.
  5. Mentors and coaches junior and mid-level engineers, conducting code reviews and sharing engineering best practices

Skills

Required

  • Formal training or certification on software engineering concepts and 5+ years applied experience
  • Hands-on experience building and shipping LLM-based applications and agentic systems with tool use, memory, and multi-step reasoning in production environments
  • Advanced proficiency in one or more programming languages, particularly Python and/or Java
  • Deep experience with large-scale data processing, microservices, API design, and event streaming (Kafka)
  • Working knowledge of relational and NoSQL databases, vector stores, and data lake architectures
  • Experience with caching technologies (Redis, MemCached), observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal)
  • Proficiency in CI/CD, test-driven development, automation, and all aspects of the Software Development Lifecycle
  • Strong understanding of agile methodologies, application resiliency, and security best practices
  • Practical cloud-native engineering experience (AWS, Azure, or GCP)
  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching senior engineers/leads on compliant usage patterns and controls.

Nice to have

  • Experience with LLM orchestration frameworks
  • Hands-on experience with model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI)
  • Familiarity with AI evaluation and observability practices: evals frameworks, red-teaming, prompt drift detection, and cost/latency monitoring
  • Understanding of agentic design patterns and how to constrain agent autonomy in high-stakes financial workflows
  • Experience with modern data platforms such as Databricks or Snowflake
  • Hands-on experience with Spark/PySpark and big data processing at scale
  • Knowledge of the financial services industry and its technology systems
  • Awareness of AI risk and regulatory considerations relevant to AI use in financial decision-making

What the JD emphasized

  • Hands-on experience building and shipping LLM-based applications and agentic systems with tool use, memory, and multi-step reasoning in production environments
  • Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching senior engineers/leads on compliant usage patterns and controls.

Other signals

  • building and shipping LLM-based applications and agentic systems
  • owns observability, evaluation, and safety of production AI systems
  • drives adoption and governance of approved AI-assisted engineering practices