Principal Software Developer - Storage Engine - Elasticsearch

Elastic Elastic · Enterprise · United States · Platform - Elasticsearch

Principal Software Developer for Elasticsearch's Storage Engine team, focusing on core storage and query technologies for observability workloads. Responsibilities include driving technical vision, architecture, and design, optimizing storage efficiency, advancing ES|QL query processing, and optimizing data layouts. Requires strong Java skills and experience with data storage technologies. The role will leverage AI tools for development acceleration and debugging.

What you'd actually do

  1. Lead the architectural evolution of core storage engine components, continuously identifying and resolving performance bottlenecks in indexing layouts, serialization formats, and resource utilization.
  2. Lead cross organizational initiatives to drive and build industry-leading observability solutions.
  3. Work with a globally distributed team of experienced engineers focused on the logs and metrics capabilities of Elasticsearch.
  4. Drive continuous operational and system improvements by introducing best practices for clean coding standards, demystifying complex system behaviors, untangling complexity to bring architectural clarity across the platform.
  5. Serve as a subject matter expert (SME) across key areas of Elasticsearch, acting as a trusted technical advisor and mentor to the wider engineering organization.

Skills

Required

  • designing high-performance, scalable database or search engine technologies
  • using AI to accelerate development, debug complex systems, and optimize code
  • prompt-engineering mindset
  • implemented novel techniques to efficiently index, store, and query time-series or logs data
  • experience with one or more data storage technologies like Elasticsearch, Solr, PostgreSQL, MongoDB, or Prometheus
  • strong core Java skills
  • deep understanding of its concurrency primitives
  • proven ability to design and optimize efficient data structures and algorithms
  • collaborate across functions and teams
  • drive decisions and results in a distributed team
  • asynchronous, direct, and transparent communication

Nice to have

  • built things with Elasticsearch before
  • worked with open source projects
  • familiar with different styles of source control workflow and continuous integration
  • worked on data storage technology
  • experience designing, leading, and owning cross-functional initiatives
  • past working experience with database, search engine, OS, or cloud service development

What the JD emphasized

  • proven track record of designing high-performance, scalable database or search engine technologies
  • proven track record of using AI to accelerate development, debug complex systems, and optimize code
  • prompt-engineering mindset
  • implemented novel techniques to efficiently index, store, and query time-series or logs data
  • strong core Java skills
  • deep understanding of its concurrency primitives
  • proven ability to design and optimize efficient data structures and algorithms