Data Engineer - X Delivery

BCG BCG · Consulting · Gurgaon, Haryana, India · Technology and Engineering

This role is for a Data Engineer within BCG's X team, focusing on designing, developing, and maintaining data pipelines and solutions for consulting teams. The role involves working with various data sources, cloud platforms, and big data technologies to empower clients with data-driven decisions. While there's a basic understanding of ML methodologies mentioned, the core focus is on data engineering and analytics delivery.

What you'd actually do

  1. Delivering original analysis and insights to case teams, typically owning all or part of an analytics module whilst integrating with a case team.
  2. Design, develop, and maintain efficient and robust data pipelines for extracting, transforming, and loading data from various sources to data warehouses, data lakes, and other storage solutions.
  3. Building data-intensive solutions that are highly available, scalable, reliable, secure, and cost-effective using programming languages like Python and PySpark.
  4. Communicating analytical insights through sophisticated synthesis and packaging of results (including PPT slides and charts) with consultants, collecting, synthesizing, analyzing case team learning & inputs into new best practices and methodologies.

Skills

Required

  • Python
  • PySpark
  • AWS/GCP/Azure
  • Airflow
  • Jenkins
  • GitHub Actions
  • Terraform
  • CloudFormation
  • Docker
  • Kubernetes
  • analytical solutioning
  • advanced analytics delivery
  • distributed computing principles
  • Spark clusters

Nice to have

  • Software engineering concepts and best practices
  • API design and development
  • testing frameworks
  • packaging
  • NoSQL databases
  • HBase
  • Cassandra
  • MongoDB
  • web development technologies
  • understanding of different stages of machine learning system design and development