Distinguished Engineer

Scale AI Scale AI · Data AI · New York, NY +1 · Enterprise Engineering

Distinguished Engineer to shape the vision and technical roadmap of core AI/ML infrastructure powering enterprise AI applications, driving long-term technical direction for the Scale GenerativeAI Platform (SGP), influencing architecture, and partnering with leaders to deliver advanced AI capabilities to enterprise customers. This hands-on technical leader will set standards, mentor senior engineers, and ensure global-scale deployment readiness.

What you'd actually do

  1. Define and drive the technical strategy for Scale’s AI/ML infrastructure and SGP platform, balancing short and long-term investments.
  2. Partner with senior engineering and product leadership to ensure scalable, secure, and performant enterprise AI systems.
  3. Lead architecture and design reviews across multiple teams, ensuring technical consistency and innovation.
  4. Serve as a trusted advisor and mentor to principal engineers and technical leads across the organization.
  5. Evaluate and integrate emerging technologies in AI, distributed systems, and data infrastructure to keep Scale at the frontier of innovation.

Skills

Required

  • 15+ years of experience as a technical software engineering leader
  • Proven record of technical leadership at AI-native companies, hyperscalers, or equivalent high-scale environments
  • Deep technical expertise in AI/ML infrastructure
  • knowledge of ML models/algorithm design/implementation and their application to real-world problems
  • experience with GenAI preferred
  • Demonstrated success in setting technical vision and leading cross-organizational initiatives with measurable business impact
  • Experience influencing and mentoring engineering teams in complex, matrixed environments
  • Ability to communicate and collaborate effectively to create a shared sense of vision or purpose cross-team and cross-functionality

Nice to have

  • Advanced degree in Computer Science, Engineering, or related field

What the JD emphasized

  • technical leadership at AI-native companies, hyperscalers, or equivalent high-scale environments
  • Deep technical expertise in AI/ML infrastructure, knowledge of ML models/algorithm design/implementation and their application to real-world problems; experience with GenAI preferred.
  • setting technical vision
  • leading cross-organizational initiatives with measurable business impact
  • influencing and mentoring engineering teams in complex, matrixed environments

Other signals

  • driving long-term technical direction for Scale GenerativeAI Platform (SGP)
  • influence architectural decisions across the company
  • partner closely with engineering and product leaders to bring advanced AI capabilities to enterprise customers
  • setting standards for technical excellence
  • mentoring senior engineers
  • ensuring our systems and models meet the demands of global-scale deployment
  • Define and drive the technical strategy for Scale’s AI/ML infrastructure and SGP platform
  • Lead architecture and design reviews across multiple teams
  • Evaluate and integrate emerging technologies in AI, distributed systems, and data infrastructure
  • Drive technical execution and accountability for critical cross-functional initiatives