Software Development Engineer, Agi - Web Information Retrieval

Amazon Amazon · Big Tech · Sunnyvale, CA · Software Development

Software Development Engineer to develop a multi-modal, multi-lingual web-scale information retrieval system combining LLMs with retrieval systems for question-answering, knowledge synthesis, and information grounding. Focus on building high-throughput data pipelines, optimizing core algorithms and ranking models, designing efficient data structures, optimizing performance/scalability/reliability, integrating ML models, developing control plane systems, and implementing real-time updates and streaming algorithms.

What you'd actually do

  1. Build high-throughput, cost-effective data pipelines to support feature extraction and indexing for our web-scale Information Retrieval (IR) system
  2. Develop and optimize the core algorithms in Rust and ranking models that power the search engine's ability to retrieve and rank relevant results for user queries.
  3. Design and implement efficient data structures and indexing techniques to store and retrieve massive amounts of web data and content using Rust programming language.
  4. Optimize the performance, scalability, and reliability of the search engine's core components, including query parsing, retrieval, ranking, and result rendering.
  5. Collaborate with machine learning teams to integrate and deploy advanced machine learning models for query understanding, ranking, and personalization.

Skills

Required

  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • 1+ years of software development engineer or related occupational experience
  • 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
  • 1+ years of Object Oriented Design experience
  • Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field

Nice to have

  • 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • Proficiency in Rust

What the JD emphasized

  • web-scale information retrieval system
  • large language models
  • retrieval systems
  • Rust programming language
  • multi-modal
  • multi-lingual

Other signals

  • multi-modal
  • web-scale information retrieval
  • large language models
  • retrieval systems
  • question-answering
  • knowledge synthesis
  • information grounding
  • universal agents