Senior AI Platform Engineer, Atlas AI

Cognite Cognite · Industrial · United States · Engineering

Seeking a Senior AI Platform Engineer to build and operate a multi-cloud platform for industrial AI agents. Responsibilities include designing Python SDKs, building the agentic runtime, developing a tool-use framework, managing LLM serving, and implementing evaluation/observability. Requires strong Python, Kubernetes, and LLM orchestration experience.

What you'd actually do

  1. Design, build, and maintain the core Python SDKs and services for the Atlas AI platform. Create clean abstractions that empower Solution Engineers to easily define and test agents and workflows.
  2. Build the core agentic runtime, ensuring it is scalable, meets its SLOs, and can reliably manage the state, orchestration, and execution of industrial agents.
  3. Develop a robust, governed, and secure framework for AI agent tool-use. Engineer the platform components that allow solution engineers to safely add new tools (e.g., API calls, database queries) and that manage the secure execution, monitoring, and access control for those tools.
  4. Manage the LLM serving layer, including deploying and optimizing models for low-latency/high-throughput inference. Build and maintain model routing logic to select the most appropriate model (e.g., performance vs. cost) for a given task.
  5. Implement evaluation and observability for all AI services. Create standardized frameworks for systematically evaluating the performance, accuracy, cost, and safety of LLMs and agentic workflows. Drive the implementation of robust, automated testing strategies for LLM-based systems.

Skills

Required

  • Python
  • backend software engineering
  • platform engineering
  • MLOps
  • architecting and operating complex systems at scale
  • building applications or platforms on top of AI/ML models or LLMs
  • software architecture
  • robust API design
  • building maintainable, well-documented SDKs
  • Kubernetes (K8s)
  • building services on managed PaaS in a multi-cloud environment (AWS, Azure, GCP)
  • Infrastructure as Code (e.g., Terraform)
  • building and operating production-grade SaaS software
  • full development life cycle
  • CI/CD
  • monitoring
  • telemetry
  • on-call incident response
  • LLM orchestration frameworks (Bedrock, Vertex, Semantic Kernel, LangChain)
  • verbal and written communication skills

Nice to have

  • deploying and managing LLMs in production using high-performance serving frameworks
  • MLOps/LLMOps tools for tracing, monitoring, and evaluating LLM applications (LangSmith, Arize, Phoenix, or equivalent)
  • RAG Infrastructure
  • embedding generation pipelines
  • vector database integrations
  • high-performance vector similarity search APIs

What the JD emphasized

  • industrial AI agents
  • agent builder workbench
  • agent runtime
  • tool-use
  • LLM serving
  • evaluation and observability
  • production SaaS environment
  • on-call rotations
  • incident response process
  • LLM orchestration frameworks

Other signals

  • AI agents
  • agent runtime
  • tool use
  • LLM serving
  • evaluation and observability