Staff Software Engineer, Data Ingestion - Slack

Salesforce Salesforce · Enterprise · Washington DC Metro -, California - Palo Alto, Washington - Seattle, Washington - Bellevue, Texas - Dallas, Georgia - Atlanta, Indiana - Indianapolis, California - San Francisco, VA · Remote

Staff Software Engineer for Salesforce's Slack Data Ingestion Team, focusing on building and operating a scalable platform for ingesting data into their Lakehouse using streaming and batch approaches. The role involves designing and implementing pipelines, improving reliability with AI/agentic solutions, automating dataset lifecycle management, and leading technical initiatives.

What you'd actually do

  1. Design and develop highly scalable and resilient streaming and batch pipelines for ingesting and processing structured and unstructured datasets
  2. Design and implement Slack’s Lakehouse solutions and enable production use cases for customers
  3. Improve the reliability and performance of the services/pipelines through AI assisted and/or Agentic solutions and tools.
  4. Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration).
  5. As one of the tech leads, comfortably collaborate with cross functional partners and lead technical initiatives independently end to end.

Skills

Required

  • Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalent
  • Spark, Airflow, EMR, S3 or equivalent
  • SQL, Python, Java/Scala, Go or equivalent
  • Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana, etc.
  • Claude Code/Codex or equivalent
  • Excellent written and verbal communication and interpersonal skills

Nice to have

  • AI assisted and/or Agentic solutions and tools

What the JD emphasized

  • U.S. citizenship and willing to undergo a background check for GovSlack authorization
  • 7+ years of software/data engineering experience