Senior Software Engineer, Data Platform

Discord Discord · Consumer · San Francisco, CA · Core Tech Engineering

Senior Software Engineer to design, develop, and maintain Discord's data platform and services, supporting analytics, machine learning, and operational insights. Focus on scalable, reliable data systems and infrastructure.

What you'd actually do

  1. Define and execute the technical vision for Discord's data platform, enabling scalable, reliable, and performant data systems.
  2. Design, implement, and optimize data infrastructure to process and analyze petabytes of data across millions of users.
  3. Develop innovative data architectures to support analytics, machine learning, and operational insights.
  4. Build monitoring, logging, and alerting systems to ensure the health and performance of data services.
  5. Partner with data scientists, data engineers, product managers, and leadership to align technical solutions with business goals.

Skills

Required

  • 5+ years of experience in software engineering with a focus on large-scale distributed systems or data infrastructure.
  • Expertise in building and maintaining scalable data platforms, including data ingestion pipelines, stream processing, and batch processing systems.
  • Proficiency in programming languages such as Python, Java, Rust, or similar.
  • Proficiency with open source data projects and experience working with open source communities.
  • Hands-on experience with modern data technologies such as Kafka, Spark, Flink, Airflow/Dagster, or similar.
  • Deep understanding of database systems (e.g., SQL, NoSQL, columnar storage) and data modeling principles.
  • Strong knowledge of cloud infrastructure (AWS, GCP, or Azure), containerization tools (Docker, Kubernetes), and microservices architecture.
  • Excellent communication skills with a demonstrated ability to collaborate and influence across teams and levels.
  • Proven ability to thrive in a fast-paced environment.

Nice to have

  • A strong passion for Discord and gaming.
  • Open source contributions to data-related projects.