Lead Software Engineer - Python, Observability

JPMorgan Chase JPMorgan Chase · Banking · Houston, TX +1 · Corporate Sector

Lead Software Engineer focused on building and iterating on AI applications, specifically LLM-powered workflows and agentic systems. The role involves designing and implementing these systems, creating observability for AI and data services, and driving the adoption of AI-assisted engineering practices within the team, with a strong emphasis on responsible AI use and validation of AI outputs.

What you'd actually do

  1. Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems.
  2. Build and maintain Python services, scripts, and pipelines for data/AI use cases.
  3. Develop and iterate on AI applications (e.g., LLM-powered workflows, retrieval, evaluation).
  4. Design and implement agentic systems (tool-using agents, orchestration, guardrails, memory patterns where appropriate).
  5. Create monitoring/observability: logging, metrics, traces, and alerting for AI and data services.

Skills

Required

  • Python engineering skills
  • SQL skills
  • Observability tools (OTEL, Grafana, Splunk, Dynatrace)
  • Agile methodologies (CI/CD, Application Resiliency, Security)
  • Debugging production issues
  • Delivering production-grade software
  • Communication skills
  • Leading effective use of AI-assisted software development tools
  • Understanding of responsible AI use in engineering workflows

Nice to have

  • Experience building AI solutions using LLMs (prompting, RAG, evaluation, safety/quality checks)
  • Experience with agent frameworks/orchestration patterns (tool calling, planning/execution loops)
  • Familiarity with data platforms/warehouses and pipelines (e.g., Airflow or similar schedulers)
  • Observability tooling experience (structured logging, metrics, tracing)
  • Performance tuning experience for Python services and SQL workloads
  • Cloud/container experience (Docker, Kubernetes, or managed equivalents)

What the JD emphasized

  • Must have working knowledge in in various observability tools such as OTEL, Grafana, Splunk and Dynatrace
  • Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices

Other signals

  • Develop and iterate on AI applications (e.g., LLM-powered workflows, retrieval, evaluation).
  • Design and implement agentic systems (tool-using agents, orchestration, guardrails, memory patterns where appropriate).
  • Create monitoring/observability: logging, metrics, traces, and alerting for AI and data services.
  • Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes
  • Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with the ability to set team expectations for validating AI outputs for correctness, performance, and security.
  • Strong understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; experience coaching engineers on safe, compliant adoption within delivery practices