Software Engineer II - Core Ingest

Sumo Logic Sumo Logic · Enterprise · United States · Software Engineering

Software Engineer II for Sumo Logic's Core Ingest team, focusing on designing and developing large-scale, distributed data processing capabilities for petabytes of customer data. The role involves improving algorithms for load scheduling, enhancing performance guarantees in a multi-tenant architecture, and contributing to the re-architecture of message processing technology. It requires experience with distributed systems, multi-threaded programming, microservices, and object-oriented programming (Java/Scala), and involves working with technologies like Kafka, Kubernetes, and Docker.

What you'd actually do

  1. Designing and implementing large data, extremely high-volume, fault-tolerant, scalable backend systems that process and manage petabytes of customer data.
  2. Working to improve algorithms built to schedule load on clusters of thousands of machines elastically at runtime.
  3. Improving systems to provide performance guarantees to customers in a shared-everything multi-tenant architecture.
  4. Contributing to the re-architecting of our internal message processing technology to petabyte per day scale.
  5. Helping manage exabytes of data using the latest and greatest technologies such as Kafka, Kubernetes and Docker.

Skills

Required

  • B.S. or higher in Computer Sciences or related discipline
  • 2+ years of industry experience
  • proven track record of ownership and delivery
  • Experience developing scalable distributed data processing solutions
  • Experience in multi-threaded programming
  • Experience in running large, scalable distributed services following a microservice architecture
  • Hands-on object-oriented programming experience (e.g., Java, Scala)
  • Excellent verbal and written communication skills
  • Willingness and experience with occasional on-call availability

Nice to have

  • Experience in big data
  • 24x7 commercial service experience
  • Experience with Apache Kafka
  • Unix (Linux, OS X) experience
  • Agile software development experience (test-driven development, iterative and incremental development)