Lead Software Engineer - Mlio Virtual Conversation Assist

JPMorgan Chase JPMorgan Chase · Banking · OH · Consumer & Community Banking

Lead Software Engineer for MLIO Virtual Conversation assist, focusing on integrating and deploying LLMs, managing API calls, streaming responses, and understanding performance and quality evaluation. The role involves prompt engineering, leveraging AWS services like Bedrock, and familiarity with Agentic AI concepts within a fintech environment.

What you'd actually do

  1. Hands-on experience with any Large Language Models, including making API calls, handling streaming responses (SSE/WebSocket), and managing end-to-end request lifecycle
  2. Leverage Amazon Bedrock for model invocation and work alongside supporting AWS services
  3. Familiarity with Agentic AI concepts
  4. General understanding of LLM performance considerations, including response latency, token usage and cost implications, and approaches to evaluating model output quality
  5. Proficiency in prompt engineering techniques, including context window management, token budgeting, and applying foundational LLM use cases

Skills

Required

  • Formal training or certification on software engineering concepts
  • 5+ years applied experience
  • Hands-on practical experience delivering system design, application development, testing, and operational stability
  • Advanced in one or more programming language(s) (Java, Python)
  • Practical AWS cloud native experience
  • Advanced knowledge of software applications and technical processes with considerable in-depth knowledge in one or more technical disciplines
  • Ability to tackle design and functionality problems independently with little to no oversight
  • Experience in Computer Science, Computer Engineering, Mathematics, or a related technical field
  • Terraform for infrastructure deployment

Nice to have

  • EAC
  • GenAI and AI Agents
  • AWS Container Orchestration Services like ECS and EKS
  • ML Engineering
  • Extensive experience with Amazon Web Services (AWS), including deploying, managing, and scaling applications using services such as EC2, S3, Lambda, and RDS
  • Proficiency in AWS security best practices and cost optimization strategies

What the JD emphasized

  • 5+ years applied experience
  • Advanced in one or more programming language(s) (Java, Python)
  • Practical AWS cloud native experience
  • Advanced knowledge of software applications and technical processes with considerable in-depth knowledge in one or more technical disciplines (e.g., AI/ML, UI development, mobile development etc.)
  • Ability to tackle design and functionality problems independently with little to no oversight

Other signals

  • Hands-on experience with any Large Language Models
  • Leverage Amazon Bedrock for model invocation
  • Familiarity with Agentic AI concepts