Software Engineer, AI Compiler

Tenstorrent · Semiconductors · Austin, TX · AI Compiler

Software Engineer role focused on developing and scaling an MLIR-based AI compiler (TT-Forge) for Tenstorrent, involving graph transformations, lowering passes, and kernel optimizations to support both training and inference on custom chip architectures.

What you'd actually do

  1. Lead development on TT-Forge, our MLIR-based compiler, and manage a team focused on scaling graph transformations, lowering passes, and kernel-level optimizations.
  2. Alignment with hardware, software, and ML teams to ensure the compiler supports realistic performance and deployment needs.
  3. Technical ownership of roadmap priorities, planning, and mentorship for a high-performing engineering team.
  4. Insight to identify bottlenecks, debug performance issues, and improve developer workflows across the stack.

Skills

Required

  • C++
  • Python
  • MLIR
  • LLVM
  • PyTorch
  • TensorFlow
  • JAX
  • compiler development
  • optimization passes
  • dialect design

Nice to have

  • RISC-V CPU
  • graph transformations
  • kernel-level optimizations
  • runtime integration
  • developer workflows

What the JD emphasized

  • Experience building compilers or similar systems, with strong fluency in C++ and Python.
  • Strong knoweledge of MLIR, LLVM, or related infrastructure, with hands-on work in dialect design or optimization passes.
  • You have a strong understanding of modern AI frameworks like PyTorch, TensorFlow, or JAX, including how models are transformed and executed.
  • A background in working across teams to ship reliable, scalable tools in fast-paced engineering environments.

Other signals

  • MLIR-based compiler
  • scaling graph transformations
  • kernel-level optimizations
  • support training and inference at scale