Sr Software Engineer, Infrastructure

Databricks Databricks · Data AI · Mountain View, CA · Infrastructure

Senior Software Engineer on the IT Infrastructure team responsible for evolving core infrastructure and observability platforms. This role involves architecting and automating AWS infrastructure using Terraform/Pulumi, managing Kubernetes workloads, CI/CD pipelines with GitHub Actions, and building internal tools and AI plugins to streamline developer workflows and enhance operational efficiency. The focus is on building resilient, scalable, and automated infrastructure, ensuring AWS environments are cost-optimized, secure, and highly available.

What you'd actually do

  1. Architect and Automate: Design and deploy production-grade infrastructure on AWS using Terraform or Pulumi.
  2. Orchestration: Manage and scale containerized workloads using AKS (Azure Kubernetes Service) or EKS, focusing on cluster security and resource efficiency.
  3. CI/CD Excellence: Architect robust deployment pipelines using GitHub Actions, managing both GitHub-hosted and self-hosted runners for specialized build requirements.
  4. Drive "Observable by Default" Frameworks: Create underlying infrastructure to ensure new internal applications are secure and have logging and metrics enabled by default
  5. Tooling, Scripting & AI : Build internal CLI tools,AI plugins and automation scripts to streamline developer workflows and enhance operational efficiency

Skills

Required

  • Python
  • Terraform
  • AWS
  • Kubernetes
  • Docker
  • GitHub Actions
  • Datadog
  • Prometheus
  • ELK
  • Kafka

Nice to have

  • Pulumi

What the JD emphasized

  • Python (non-negotiable)
  • Terraform
  • AWS
  • Kubernetes
  • Docker
  • GitHub Actions
  • Datadog, Prometheus, or ELK
  • Kafka