Senior Software Engineer, Data Platform

Crusoe · Data AI · San Francisco, CA - US · Cloud Engineering

Senior Data Engineer to architect and build foundational data platform infrastructure for AI and cloud operations. Focus on scalable systems, data quality, and collaboration.

What you'd actually do

  1. Architect Data Platform Infrastructure
  2. Build High-Performance Data Systems
  3. Champion Data Quality & Reliability
  4. Collaborate Across Engineering Teams
  5. Drive Technical Excellence

Skills

Required

  • Python
  • Go
  • data warehouses
  • data lakes
  • streaming systems
  • ETL/ELT frameworks
  • distributed computing principles
  • SQL
  • CI/CD
  • containerization
  • infrastructure automation

Nice to have

  • GCP data services
  • BigQuery
  • Dataflow
  • Pub/Sub
  • Cloud Storage
  • Apache Beam
  • AI/ML workloads
  • cloud computing platforms
  • growing or early-stage data team
  • data orchestration tools
  • Airflow
  • Dagster
  • Prefect
  • real-time data processing
  • streaming architectures

What the JD emphasized

  • early and pivotal hire
  • architect and build the foundational data platform infrastructure
  • go beyond building pipelines—you'll design and implement the systems that make those pipelines possible
  • drive projects from conception to production with minimal supervision

Other signals

  • architect data platform infrastructure
  • build high-performance data systems
  • champion data quality & reliability