Data Engineer - I, Davengers(data Avengers)

Amazon Amazon · Big Tech · IN, KA, Bengaluru · Business Intelligence

Data Engineer role focused on building and supporting a data platform that serves both business intelligence and machine learning applications. Responsibilities include designing data infrastructure, managing AWS resources, collaborating with applied scientists and other tech teams to build data pipelines for ML models, and implementing advanced analytics algorithms.

What you'd actually do

  1. Design, implement and support an analytical data infrastructure serving both business intelligence and machine learning applications
  2. Collaborate with applied scientist to integrate and build data pipeline as necessary for building and training machine learning models in AEE
  3. Collaborate with other tech teams to implement advanced analytics algorithms that exploit our rich datasets for statistical analysis, prediction, clustering and machine learning
  4. Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies
  5. Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers

Skills

Required

  • 1+ years of data engineering experience
  • Experience with data modeling, warehousing and building ETL pipelines
  • Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
  • Experience with one or more scripting language (e.g., Python, KornShell)

Nice to have

  • Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
  • Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.

Other signals

  • data platform for ML applications
  • integrate and build data pipeline for ML models
  • implement advanced analytics algorithms