Senior Software Engineer - AI Infrastructure

Armada Armada · Enterprise · Bellevue, Sunset Corporate · R&D - Platform Engineering

Senior Software Engineer focused on building and scaling on-premise AI infrastructure, including Compute as a Service (CaaS), GPU as a Service (GPUaaS), and a cloud-integrated marketplace for deploying applications on bare metal Kubernetes clusters. Requires strong experience in cloud-native technologies, bare metal infrastructure, and marketplace design.

What you'd actually do

  1. Contribute to the architectural design and implementation of a scalable and efficient CaaS and GPUaaS platform on our on-premise bare metal clusters.
  2. Implement and integrate key technologies for our stack, including hypervisors (e.g., KVM), container runtimes (Docker, containerd), orchestration platforms (Kubernetes), and GPU virtualization technologies (Kubevirt, vGPU).
  3. Develop and implement robust monitoring, logging, and alerting systems for the CaaS and GPUaaS platform.
  4. Contribute to the design and development of a cloud-integrated marketplace for deploying applications onto the on-premise infrastructure.
  5. Implement backend services and API integrations for the marketplace.

Skills

Required

  • infrastructure engineering
  • software development
  • CaaS platforms
  • GPUaaS platforms
  • containerization technologies
  • Docker
  • Kubernetes
  • bare metal infrastructure
  • hardware management
  • cloud platforms
  • AWS
  • Azure
  • GCP
  • marketplace design
  • Python
  • Go
  • Java
  • infrastructure as code tools
  • Terraform
  • Ansible

Nice to have

  • high-performance computing (HPC) environments
  • GPU virtualization and management
  • distributed storage systems
  • security best practices in cloud and on premise environments
  • building CI/CD pipelines