Global Ai/ml Engineer Senior Manager

BCG BCG · Consulting · Gurgaon, Haryana, India · Technology and Engineering

Senior Manager role focused on developing and deploying Generative AI solutions at scale within BCG's Risk Product Portfolio. Responsibilities include end-to-end development, fine-tuning LLMs, data analysis, and collaborating with cross-functional teams. Requires strong Python and GenAI framework experience, MLOps/LLMOps, and cloud deployment skills.

What you'd actually do

  1. Develop AI/Gen AI projects as individual coding contributors (IC), from ideation to ensuring they deliver impactful insights
  2. Drive end-to-end design, development & deployment of Gen AI solutions at scale to deliver high-quality outcomes
  3. Fine-tune large language models (LLMs) to meet specific Generative AI business outcomes
  4. Extract and analyze data from various sources to inform modeling and solution development.
  5. Analyze large and complex datasets to extract meaningful trends, patterns, and insights

Skills

Required

  • 9+ years of experience in technology, software engineering or data science/ML
  • 7+ years of hands-on coding experience in python development
  • 2+ years of experience in building Generative AI products at scale
  • Experience in developing Generative AI based solutions using frameworks (e.g. Langchain, Llamaindex, etc.)
  • Experience in working with variety of LLM models and fine tuning
  • Experience in applying MLOps/LLMOps principles to deploy, monitor models and implement automated CI/CD pipelines
  • Experience with LLM evaluation frameworks, guardrails to evaluate and monitor outputs quality, control hallucinations
  • Awareness of ethical AI frameworks to ensure responsible AI deployment
  • Ability to work iteratively on AI/ML/Gen AI solutions to improve performance over time and in response to user feedback
  • Experience in deploying solutions on a cloud platforms – AWS (preferred), Azure, GCP
  • Experience with microservices & serverless architecture, API development
  • Excellent communication skills

Nice to have

  • AWS (preferred)
  • An MVP mindset that emphasizes rapid prototyping and continuous improvement.

What the JD emphasized

  • 2+ years of experience in building Generative AI products at scale
  • Demonstrated experience in developing Generative AI based solutions using frameworks (e.g. Langchain, Llamaindex, etc.) to build retrieval augmented generation (RAG), multi-agent-architecture driven solutions
  • Experience with LLM evaluation frameworks, guardrails to evaluate and monitor outputs quality, control hallucinations
  • Highly curious and fast learner who is keenly keeping pace with latest and greatest happening in Gen AI and agentic AI space
  • Awareness of ethical AI frameworks to ensure responsible AI deployment

Other signals

  • Develop AI/Gen AI projects as individual coding contributors (IC), from ideation to ensuring they deliver impactful insights
  • Drive end-to-end design, development & deployment of Gen AI solutions at scale to deliver high-quality outcomes
  • Fine-tune large language models (LLMs) to meet specific Generative AI business outcomes
  • Demonstrated experience in developing Generative AI based solutions using frameworks (e.g. Langchain, Llamaindex, etc.) to build retrieval augmented generation (RAG), multi-agent-architecture driven solutions
  • Experience with LLM evaluation frameworks, guardrails to evaluate and monitor outputs quality, control hallucinations