Overview
Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.
Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture.
Power BI is one of Microsoft’s most strategic products. The Power BI Quality Engineering team is building an AI‑driven automation platform that enhances release quality across Power BI Service and Desktop. As an L63 AI Developer, you will lead the design and integration of GenAI solutions that accelerate automation, improve reliability, and elevate engineering productivity
We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.
Responsibilities
- Architect and lead GenAI capabilities for automated test generation, anomaly detection, workflow agents, and ML‑assisted quality insights.
- Build and integrate AI/ML infrastructure supporting test generation, evaluation harnesses, telemetry‑based observability, and model governance. Optimize models for accuracy, latency, memory, and cost.
- Drive automation architecture in partnership with automation leads, ensuring AI components work across Desktop, Service, and Semantic Model test frameworks.
- Collaborate across engineering, PM, and vendor teams to embed AI into release pipelines, improving reliability, flakiness, and regression detection.
- Mentor engineers in AI concepts, prompt engineering, agent design, and responsible AI practices.
- Establish metrics and evaluation systems for AI‑powered quality tooling (accuracy, stability, cost, observability).
- Influence cross‑team direction on secure engineering, CI/CD integration, and pipeline intelligence.
Embody our culture and values
Qualifications
Required/Minimum Qualifications
- Bachelor’s or Master’s degree in Computer Science, AI, ML, or related field (or equivalent experience)
- 8+ Strong software engineering skills in Python, TypeScript/JavaScript, C#, or Java.
- Practical experience building AI/ML powered systems using Azure AI / OpenAI models.
- Expertise in automation frameworks, CI/CD (Azure DevOps or GitHub Actions), telemetry, and observability.
- Experience building production AI systems, not just prototypes
- Ability to design scalable architectures and lead complex technical initiatives.
- Excellent communication skills and ability to collaborate across global teams.
**Job Requirements: Other & Additional **
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:
- This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred/Additional Qualifications
- Experience with LLM evaluation, retrieval‑augmented generation, or agent‑based automation.
- Working knowledge of Power BI, analytics systems, or distributed services.
- Experience building test frameworks, performance harnesses, or developer tools.
- Hands-on experience with frameworks such as PyTorch, TensorFlow, or JAX
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about **requesting accommodations.**