Principal Software Engineer - Vector Search - Elasticsearch

Elastic Elastic · Enterprise · United Kingdom · Platform - Elasticsearch

Principal Software Engineer to enhance vector similarity search functionality within Elasticsearch, focusing on building new features, improving existing ones, and resolving bugs for an industry-leading vector database offering. The role involves deep technical contributions to Lucene and Elasticsearch, potentially inventing new algorithms or data structures, and collaborating with a global team and the open-source community.

What you'd actually do

  1. Lead initiatives within Elasticsearch to produce an industry-leading vector database offering, supplying unparalleled speed and relevance in search.
  2. Contribute to Elasticsearch full time, building new search features and fixing intriguing bugs, all while making the code easier to understand. Sometimes you'll need to invent a new algorithm or data structure. Or find one and implement it. Sometimes you'll need to get close to the operating system and hardware.
  3. Work with a globally distributed team of experienced engineers focused on the vector search capabilities of Elasticsearch.
  4. Be an expert on how Elasticsearch implements vector similarity in support of search relevance and everyone will turn to you when they have a question about this area. You'll improve this area based on your questions and your instincts.
  5. Work with community members from all over the world on issues and pull requests, sometimes triaging them and handing them off to other experts and sometimes handling them yourself.

Skills

Required

  • Implemented novel techniques in vector similarity on a search platform with a large user base or progressed the field of academic research in vector similarity information retrieval.
  • Professional experience with vector similarity and vector databases, and you used HNSW, IVF, or other relevant algorithms and libraries on search platforms at scale.
  • Strong skills in core Java and are conversant in the standard library of data structures and concurrency constructs, as well as other features like lambdas.
  • High level of autonomy, and are able to take on projects and guide them from beginning to end. This covers both technical design and working with other engineers to develop needed components.
  • Excellent verbal and written communication skills.

Nice to have

  • Built things with Elasticsearch before.
  • Worked with open source projects and are familiar with different styles of source control workflow and continuous integration.
  • Experience with data storage technology.
  • Experience designing, leading and owning cross-functional initiatives.

What the JD emphasized

  • industry-leading vector database
  • vector similarity search
  • vector databases
  • novel techniques in vector similarity
  • vector similarity information retrieval
  • core Java

Other signals

  • vector similarity search
  • vector database
  • search relevance
  • large user base
  • industry-leading