Senior Data Engineer

ClickUp ClickUp · Enterprise · United States · Product

Senior Data Engineer to build and scale a modern data platform using AWS serverless technologies, Snowflake, dbt, and Terraform. The role involves designing and optimizing data pipelines, building LLM frameworks, and supporting AI/ML workflows to enable data-driven decisions and AI-powered products.

What you'd actually do

  1. Design, build, and maintain cloud-native data infrastructure using Terraform for IaC.
  2. Develop and optimize data pipelines leveraging AWS services (Lambda, Fargate, Step Functions, S3, Kinesis, DynamoDB, Aurora, etc.) and Snowflake.
  3. Implement ELT workflows within dbt in partnership with our Analytics Engineering function
  4. Build and maintain LLM frameworks, ensuring high-quality and cost effective outputs.
  5. Automate infrastructure and pipeline deployments with CI/CD best practices.

Skills

Required

  • data engineering
  • software engineering
  • AWS cloud services
  • Terraform
  • SQL
  • Snowflake
  • dbt
  • Python
  • CI/CD workflows
  • Git-based development
  • containerization (Docker)
  • data quality
  • governance
  • observability best practices

Nice to have

  • startup and enterprise environments
  • orchestration frameworks
  • streaming/event-driven architectures
  • mentoring or leading engineers

What the JD emphasized

  • AI/ML workflows

Other signals

  • building the foundation that allows us to make smarter, faster, and data-driven decisions while also enabling AI-powered products and insights
  • Build and maintain LLM frameworks
  • Experience building pipelines to support AI/ML workflows