Global It Data Engineer Senior Specialist

BCG BCG · Consulting · Gurgaon, Haryana, India · Technology and Engineering

This role focuses on building and operating foundational data infrastructure, pipelines, and endpoints/data products to support enterprise GenAI use cases within Boston Consulting Group. The Senior Specialist will lead data integration, ingestion, and optimization, develop automated data workflows, and collaborate with stakeholders to ensure data quality, compliance, and governance.

What you'd actually do

  1. Lead the onboarding and integration of public, proprietary and third-party datasets into AWS, Snowflake and related applications
  2. Design, develop, document, and maintain robust data pipelines, ensuring seamless ingestion, migration, and rigorous testing.
  3. Develop and manage automated data workflows using Airflow DAGs, Snowflake, Python, APIs, schemas, Streamlit, and data storage solutions such as AWS S3 and Google Cloud Storage.
  4. Design and implement MCP-based GenAI workflows and solutions to enhance data assets and products.
  5. Maintain comprehensive metadata logs, asset templates, and technical documentation.

Skills

Required

  • Data Engineering
  • Data Integration
  • Snowflake
  • Python
  • Airflow
  • Streamlit
  • AWS S3
  • Google Cloud Storage
  • dbt
  • Apache Airflow
  • Agile methodologies
  • Scrum
  • Kanban
  • stakeholder engagement
  • data governance
  • data quality
  • data lineage
  • ETL/ELT

Nice to have

  • Meta Scrum
  • Data Catalog

What the JD emphasized

  • GenAI