Sr Engineer - Target India

Target Target · Retail · Bangalore, India

Target is hiring a Senior Data Engineer to join their Data Sciences Engineering team. This role will focus on building and maintaining foundational data sets and data pipelines to enable timely and accurate decision-making. Responsibilities include designing, programming, and supporting large-scale software solutions using Big Data technologies, implementing data structures, and embracing DevOps practices. The ideal candidate will have 5+ years of software development experience, hands-on experience with Scala/Python, and knowledge of various database and data integration technologies.

What you'd actually do

  1. Assess client needs and convert business requirements into business intelligence (BI) solutions roadmap relating to complex issues involving long-term or multi-work streams.
  2. Analyze technical issues and questions identifying data needs and delivery mechanisms
  3. Implement data structures using best practices in data modeling, ETL/ELT processes, Spark, Scala, SQL, database, and OLAP technologies
  4. Build data caches and performant APIs following internal standards and best practices.
  5. Embrace the DevOps mentality (CI/CD) by building solutions designed for availability and scalability in an iterative manner

Skills

Required

  • 4 year degree or equivalent experience
  • 5+ years of software development experience preferably in a data engineering/Hadoop development (Hive, Pig, Sqoop, Spark, etc.)
  • Hands on Experience in Object Oriented or functional programming such as Scala / Python
  • Knowledge or experience with a variety of database technologies (HBase, Postgres, Teradata, Cassandra, SQL Server, Oracle)
  • Knowledge with design of data integration using API and streaming technologies (Kafka) as well as ETL and other data Integration patterns
  • Knowledge or experience in designing various data models for ensuring scalability and performance of data usage
  • Develop test-driven solutions and provide technical guidance and heavily contribute to a team of high caliber Data Engineers by developing test-driven solutions and BI Applications that can be deployed quickly and in an automated fashion.
  • Manage and execute against agile plans and set deadlines based on client, business, and technical requirements
  • Drive resolution of technology roadblocks including code, infrastructure, build, deployment, and operations
  • Advocate for technologies, frameworks, design patterns, processes and guiding values of Data Engineering
  • Ensure all code adheres to development & security standards
  • Be able to understand the data, draw insights and make recommendations and Be able to identify any data quality issues upfront
  • Experience with test-driven development and software test automation
  • Follow best coding practices & engineering guidelines as prescribed
  • Strong written and verbal communication skills with the ability to present complex technical information in a clear and co

Nice to have

  • Experience with CI/CD toolchain (Drone, Jenkins, Vela, Kubernetes) a plus
  • Have experience working on Druid, Postgres or related technology
  • Hands on experience in building complex data pipelines and flow optimizations