Machine Learning Engineering Manager - AI Insights

Microsoft Microsoft · Big Tech · New York, NY +4 · Software Engineering

Machine Learning Engineering Manager to lead the development of AI Insights, a next-generation Copilot analytics product, focusing on AI-powered analytics for Copilot usage and quality metrics, trend detection, anomaly detection, and predictive insights. The role involves prototyping and productionizing ML models, ensuring data compliance, and integrating with existing platforms.

What you'd actually do

  1. Lead and mentor a team of engineers building AI-powered analytics for Copilot usage and quality metrics.
  2. Own technical strategy for trend detection, cohort analysis, and drill-down workflows linking quantitative metrics to qualitative conversation evidence.
  3. Prototype and productionize ML models for anomaly detection and predictive insights.
  4. Ensure compliance and security for data handling across telemetry, logs, and conversation datasets.
  5. Collaborate with PMs, data scientists, and UX to define roadmap and deliver intuitive, high-impact workflows.

Skills

Required

  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • Experience writing production-quality Python or Java code

Nice to have

  • Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
  • Proven experience leading small engineering and machine learning teams, and collaborating effectively with cross-functional stakeholders including product managers, UX designers, and security specialists.
  • Demonstrated interest in Responsible AI.

What the JD emphasized

  • solid hands-on skills in machine learning, data platforms, and distributed systems
  • solid communicator and great teammate
  • experience leading product development leveraging data pipelines, data science, and machine learning
  • takes the initiative and enjoys building world-class consumer experiences and products in a fast-paced environment
  • solid experience in ML systems, anomaly detection, and large-scale data processing
  • Generalize machine learning (ML) solutions into repeatable frameworks
  • Independently write efficient, readable, extensible code and model pipelines
  • Commit to a customer-oriented focus by acknowledging customer needs and perspectives, validating customer perspectives, focusing on broader customer context, and serving as a trusted advisor.
  • Be hands-on with observability (metrics, tracing, logs) and model evaluation frameworks.

Other signals

  • AI-powered analytics
  • ML models for anomaly detection and predictive insights
  • large scale multi modal Copilot data