Sr Engineer - Ad Tech

Target Target · Retail · Bangalore, India

Senior Data Engineer responsible for designing, developing, and maintaining robust data pipelines, distributed systems, and large-scale data platforms. This role involves building and optimizing foundational datasets using Big Data technologies and collaborating with cross-functional teams to translate requirements into data products.

What you'd actually do

  1. Assess client needs and convert business requirements into business intelligence (BI) solutions roadmap relating to complex issues involving long-term or multi-work streams.
  2. Analyze technical issues and questions identifying data needs and delivery mechanisms
  3. Implement data structures using best practices in data modeling, ETL/ELT processes, Spark, Scala, SQL, database, and OLAP technologies
  4. Build data caches and performant APIs following internal standards and best practices.
  5. Embrace the DevOps mentality (CI/CD) by building solutions designed for availability and scalability in an iterative manner

Skills

Required

  • data modeling
  • ETL/ELT processes
  • Spark
  • Scala
  • SQL
  • database technologies
  • API design
  • DevOps
  • CI/CD
  • test-driven development
  • software test automation

Nice to have

  • Hadoop development
  • Hive
  • Pig
  • Sqoop
  • Python
  • HBase
  • Postgres
  • Teradata
  • Cassandra
  • SQL Server
  • Oracle
  • Kafka
  • Jenkins
  • Kubernetes
  • Druid