Software Development Engineer – Big Data, Aws Elastic Mapreduce (emr)

Amazon Amazon · Big Tech · Redmond, WA · Software Development

Software Development Engineer role on the AWS Elastic MapReduce (EMR) team, focusing on building and improving large-scale data processing systems and features for customers running open-source data frameworks like Hadoop and Spark. The role involves designing, developing, and operating next-generation cluster management systems and real-time data processing capabilities.

What you'd actually do

  1. Designing and building the next-generation technologies that will make EMR the best environment to run large-scale data processing workloads.
  2. Working on complex problems in distributed systems and query engines.
  3. Translation of complex functional and technical requirements into detailed architecture and design.
  4. Deliver systems and features with top-notch quality, on time.
  5. Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production EMR systems.

Skills

Required

  • 2+ years of non-internship professional software development experience
  • Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design
  • 1+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling) experience

Nice to have

  • Master's degree in Computer Science, Engineering, Mathematics, or a related field, or 5+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
  • Knowledge of Big Data application such as Spark and Presto
  • Knowledge of Container Platforms such as Docker and related technologies