Global It Genai Software Engineer Director - AI & Innovation

BCG BCG · Consulting · London, United Kingdom +1 · Technology and Engineering

Director-level GenAI Software Engineer role focused on designing, developing, deploying, and optimizing GenAI products at scale within BCG's Risk and Compliance digital products team. The role involves hands-on contribution to product development, managing other engineers, and acting as a technical thought partner for product owners and digital leaders. Requires expertise in Python, backend development (REST, GraphQL), and extensive experience with LLMs, frameworks (LangChain, LlamaIndex), RAG, multi-agent systems, and LLMOps. The role emphasizes building scalable enterprise products and mentoring teams.

What you'd actually do

  1. Conceptualize Generative AI custom products at BCG internally & operate as a technical thought partner for digital leaders and product owners.
  2. Combine data science & engineering expertise in building Generative AI products
  3. Develop Gen AI products to develop scalable high performance enterprise products along with broader squad
  4. Manage a team to deliver Gen AI products.
  5. Share expertise and recommendations on alternate approaches & tools to improve product

Skills

Required

  • Python for data science, engineering & LLMs
  • building & deploying AI/ML/Gen AI solutions
  • developing Gen AI products using variety of LLMs & frameworks
  • leading a team
  • leveraging, training and fine-tuning Foundation Models including multimodal inputs and outputs
  • key LLM models APIs (e.g. OpenAI, Anthropic)
  • LLM Frameworks (e.g. LangChain, LlamaIndex)
  • embeddings across variety of data formats
  • embedding spaces and their applications in semantic search and information retrieval
  • text chunking techniques
  • RAG concepts and fundamentals (vectorDBs, semanticsearch, re-rankers etc.)
  • implementing RAG systems that combine knowledge bases
  • multi-agent frameworks/systems
  • variety of data bases (SQL, no SQL)
  • APIs & microservices development
  • LLMOps tools (e.g. Langsmith)
  • implement guardrails, track accuracy, hallucinations, bias and other metrics in Gen AI products
  • constructing and querying knowledge graphs
  • graph-based reasoning
  • backend development in technologies like python, typescript including REST, GraphQL etc. APIs development, core functional logic, performance, and stability of custom-built products

Nice to have

  • front end development technologies (e.g. REACT)

What the JD emphasized

  • 9+ years of experience in engineering, machine learning & LLMs
  • 6+ years of hands-on experience in building & deploying AI/ML/Gen AI solutions in large business critical applications
  • 2+ years of experience in developing Gen AI products using variety of LLMs & frameworks
  • 1+years of experience leading a team.

Other signals

  • designing, developing, deploying and optimizing Gen AI products at scale
  • full backend development in technologies like python, typescript including REST, GraphQL etc. APIs development
  • Develop Gen AI products to develop scalable high performance enterprise products
  • Manage a team to deliver Gen AI products
  • building & deploying AI/ML/Gen AI solutions in large business critical applications
  • developing Gen AI products using variety of LLMs & frameworks
  • leading a team
  • developing Gen AI applications
  • leveraging, training and fine-tuning Foundation Models including multimodal inputs and outputs
  • Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. LangChain, LlamaIndex)
  • Expertise with RAG concepts and fundamentals (vectorDBs, semanticsearch, re-rankers etc.)
  • Experience with multi-agent frameworks/systems
  • LLMOps tools (e.g. Langsmith) to implement guardrails, track accuracy, hallucinations, bias and other metrics in Gen AI products