Architect - AI Platforms Implementation and Integration

Bank of America Bank of America · Banking · Jersey City, NJ +1

This role is responsible for implementing and integrating AI platforms, focusing on deploying vendor AI solutions in an on-prem OpenShift environment. It involves supporting Generative AI solutions like LLM services, RAG pipelines, and agents, integrating them with enterprise systems, and ensuring adherence to AI control and Responsible AI standards. The role also includes building integrations, documenting implementations, and supporting production readiness and troubleshooting.

What you'd actually do

  1. Implement and refine AI and data architecture solutions
  2. Deploy, configure, and operate vendor AI platforms and services within on‑prem OpenShift clusters.
  3. Support implementation of Generative AI solutions including LLM services, RAG pipelines, agents, and supporting data services.
  4. Build, configure, and test integrations between AI platforms and enterprise systems including data platforms, identity services, monitoring tools, and other AI capabilities.
  5. Support production readiness activities including validation, performance testing, observability configuration, and operational handoff.

Skills

Required

  • 4–7 years of experience in data engineering, AI/ML platforms, platform engineering, or architecture-adjacent roles.
  • Hands-on experience deploying and operating applications on Kubernetes or OpenShift platforms.
  • Experience implementing system integrations using APIs, data pipelines, and event-based architectures.
  • Working knowledge of AI/ML and Generative AI platforms, components, and deployment patterns.
  • Proficiency in Python and SQL; familiarity with containerized workloads.
  • Understanding of enterprise security, identity, logging, and operational requirements.
  • Strong execution, problem-solving, and collaboration skills.

Nice to have

  • Hands-on AI platform implementation and integration

What the JD emphasized

  • Hands-on experience implementing and integrating AI platforms
  • applying Responsible AI and governance standards
  • Deploy, configure, and operate vendor AI platforms and services within on‑prem OpenShift clusters.
  • Support implementation of Generative AI solutions including LLM services, RAG pipelines, agents, and supporting data services.
  • Apply standardized architectural patterns for scalability, reliability, and security.
  • Implement predefined AI control standards related to security, privacy, access management, logging, and monitoring.
  • Embed established & new Responsible AI mechanisms such as content filtering, prompt controls, telemetry, and explainability tooling.
  • Build, configure, and test integrations between AI platforms and enterprise systems including data platforms, identity services, monitoring tools, and other AI capabilities.
  • Develop and maintain APIs, data pipelines, and event-driven integrations to support end‑to‑end AI solutions.
  • Support production readiness activities including validation, performance testing, observability configuration, and operational handoff.
  • Troubleshoot deployment, runtime, and integration issues across AI platform components.

Other signals

  • implementing and integrating AI platforms
  • deploying vendor AI platforms
  • integrating AI capabilities
  • Support implementation of Generative AI solutions including LLM services, RAG pipelines, agents
  • Apply standardized architectural patterns for scalability, reliability, and security
  • Implement predefined AI control standards
  • Embed established & new Responsible AI mechanisms
  • Build, configure, and test integrations between AI platforms and enterprise systems
  • Develop and maintain APIs, data pipelines, and event-driven integrations
  • Support production readiness activities including validation, performance testing, observability configuration
  • Troubleshoot deployment, runtime, and integration issues across AI platform components