Overview
Are you excited about empowering millions of developers and AI/ML builders across enterprises and digital natives with the best experience to build, test, and scale their applications with AI? Do you love turning data into insight, and insight into product decisions that shape how developers code every day?
The GitHub Copilot Science team under CoreAI at Microsoft India Development Center (IDC) is looking for a data-driven product manager to help define, measure, and ship AI-powered coding experiences for developers. Our division's mission is to empower builders and their teams to achieve more.
We are a fast-paced, experimentation-first team. We love to push the boundaries of what is possible with AI-assisted development. If this sounds like the kind of environment where you will grow and have fun, please join us!
Responsibilities
In this role you will:
Partner closely with data science, applied science, and engineering to own the data, models, agentic harness and measurement strategy for Copilot / VS Code experiences and connect them to real online outcomes.
Define the online and offline metrics that tell us whether a feature is working and moving developer productivity.
Perform deep quantitative and qualitative analysis of developer telemetry, usage funnels, and model-quality signals to surface unarticulated and unmet needs.
Design, run, and interpret A/B flights and controlled experiments end to end, from hypothesis and power analysis through readout and ship/no-ship decisions.
Drive prompt engineering and model-behavior improvements in partnership with applied scientists.
Engage directly with the developer community - forums, GitHub, user studies, and early-adopter programs - to validate direction with real users.
Analyze competition and market trends across AI coding assistants to build a coherent strategy for growing adoption and engagement.
Define success metrics, communicate them clearly, measure them, and use them to iteratively improve the services.
Traits we look for in product managers:
Relentless customer obsession paired with rigorous attention to data quality and detail.
Comfort living in the data - you reach for a query or a notebook before an opinion.
Active listening to understand (Growth mindset).
Clarity in communication without ambiguity across all formats. Break down complex ideas and explain them simply with data.
Qualifications
6+ years of product management experience shipping enterprise or consumer products in the software industry. Experience building large-scale AI/ML products/services is preferred.
Demonstrated expertise in data analysis and experimentation - designing and interpreting A/B flights, defining online and offline metrics, and driving decisions from telemetry.
Hands-on comfort with data tools (notebooks, and dashboards such as Kusto/ADX, Power BI, or similar) to independently explore data and validate hypotheses.
Familiarity with LLM and Copilot technologies, including prompt engineering, model evaluation, and awareness of the AI-assisted developer tooling landscape.
Bachelor’s degree or higher in Computer Science, Statistics, Data Science, or a similar discipline, or equivalent industry experience. An MBA is a bonus.
Strong analytical skills and an aptitude for solving complex business problems.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about **requesting accommodations.**