Software Engineer III – Generative AI Platform Engineering

Bank of America Bank of America · Banking · Addison, TX

Software Engineer III role focused on building enterprise-grade Generative AI, Data Science, and AI Platform capabilities. Responsibilities include designing, developing, and delivering reusable GenAI platform services, frameworks, APIs, and application components supporting AI model development, deployment, inferencing, automation, and governance. The role involves partnering with senior engineers and architects to develop scalable, secure, and resilient solutions leveraging modern AI frameworks, cloud-native technologies, and distributed computing platforms. Key tasks include building AI-powered applications, agentic workflows, RAG solutions, and developing APIs and microservices for AI/ML lifecycle management, model fine-tuning, deployment, and inferencing.

What you'd actually do

  1. Develop and enhance enterprise Generative AI platform capabilities, reusable services, and self-service tools.
  2. Design and build AI-powered applications, agentic workflows, RAG solutions, and MCP-enabled services.
  3. Develop scalable APIs, microservices, and platform components supporting AI/ML lifecycle management.
  4. Build and maintain frameworks supporting model development, fine-tuning, deployment, inferencing, monitoring, and observability.
  5. Implement event-driven and streaming solutions leveraging technologies such as Kafka and distributed processing platforms.

Skills

Required

  • Generative AI
  • Platform Engineering
  • Software Engineering
  • API Development
  • Microservices
  • AI/ML Lifecycle Management
  • Model Deployment
  • Model Inferencing
  • Model Monitoring
  • Model Observability
  • Agentic Workflows
  • RAG Solutions
  • Kafka
  • Distributed Computing
  • Cloud-Native Technologies
  • CI/CD
  • DevOps
  • Agile Development

Nice to have

  • Data Science
  • AI Frameworks
  • Automation
  • Self-service Tools
  • Fine-tuning
  • Event-driven Solutions
  • Streaming Solutions

What the JD emphasized

  • enterprise-grade Generative AI
  • reusable GenAI platform services
  • AI model development, deployment, inferencing, automation, and governance
  • AI-powered applications, agentic workflows, RAG solutions
  • AI/ML lifecycle management
  • model development, fine-tuning, deployment, inferencing, monitoring, and observability
  • security, scalability, governance, resiliency, and operational excellence

Other signals

  • Generative AI Platform Engineering
  • enterprise-grade Generative AI, Data Science, and AI Platform capabilities
  • reusable GenAI platform services, frameworks, APIs, and application components
  • AI model development, deployment, inferencing, automation, and governance
  • AI-powered applications, agentic workflows, RAG solutions
  • AI/ML lifecycle management
  • model development, fine-tuning, deployment, inferencing, monitoring, and observability