AI Software Engineer

Microsoft Microsoft · Big Tech · Prague, Prague, Czech Republic · Software Engineering

AI Software Engineer role focused on building AI-powered testing capabilities for Visual Studio and .NET CLI. The role involves designing and implementing intelligent agents for test case suggestion, code analysis, and test maintenance, as well as developing benchmarking frameworks to evaluate AI models for coding tasks. The technology stack includes C# and Azure, leveraging LLMs.

What you'd actually do

  1. Research and experiment with emerging AI technologies to identify new opportunities for developer productivity.
  2. Design and implement AI-powered tools for automated unit test generation, code analysis, and intelligent test maintenance.
  3. Develop and maintain benchmarking frameworks to evaluate the performance and quality of AI models for .NET coding tasks.
  4. Work closely with .NET product teams to integrate AI capabilities directly into the developer workflow (Visual Studio, VS Code, CLI).
  5. Mentor junior engineers, conduct code reviews, and contribute to a culture of technical excellence and continuous learning.

Skills

Required

  • BS in Computer Science, EE, Computer Engineering or equivalent experience.
  • Experience with AI/ML concepts, specifically Large Language Models (LLMs) and prompt engineering.
  • Demonstrated passion for developer tools and improving developer productivity.
  • Experience working with one or more of the following languages: C#, Java, Python or similar programming languages.

Nice to have

  • Proficiency in the .NET ecosystem and hands-on experience with testing frameworks and code coverage tools will be a significant advantage.

What the JD emphasized

  • AI-powered testing capabilities
  • intelligent agents
  • benchmarking frameworks
  • evaluate the performance and quality of AI models

Other signals

  • AI-powered testing capabilities
  • intelligent agents that suggest test cases
  • benchmarking frameworks to evaluate AI models