Staff Software Engineer - Core Ingest

Sumo Logic Sumo Logic · Enterprise · United States · Software Engineering

Staff Software Engineer focused on designing and implementing high-volume, fault-tolerant, scalable backend systems for data ingestion and processing. The role involves working with distributed systems, Kafka, Kubernetes, and Docker to manage petabytes of data daily, ensuring performance and reliability for a commercial service.

What you'd actually do

  1. Designing and implementing extremely high-volume, fault-tolerant, scalable backend systems that process and manage petabytes of customer data.
  2. Work to improve algorithms built to schedule load on clusters of thousands of machines elastically at runtime.
  3. Experience in multi-threaded programming and distributed systems
  4. Improve systems to provide performance guarantees to customers in a shared-everything multi-tenant architecture.
  5. Lead and contribute to the re-architecting of our internal message processing technology to petabyte per day scale.

Skills

Required

  • B.S. or higher in Computer Sciences or related discipline
  • 6-8+ years of industry experience
  • proven track record of ownership and delivery
  • Experience developing scalable distributed data processing solutions
  • Experience in multi-threaded programming
  • Experience in running large scalable distributed services following a microservice architecture
  • Experience in Apache Kafka
  • Hands-on object-oriented programming experience (e.g., Java, Scala)
  • Excellent verbal and written communication skills
  • Understand performance characteristics of commonly used data structures (maps, lists, trees, etc).

Nice to have

  • Experience in big data
  • 24x7 commercial service experience
  • Unix (Linux, OS X)
  • Agile software development experience (test-driven development, iterative and incremental development)

What the JD emphasized

  • petabytes of customer data
  • petabyte per day scale