Global It Data Engineer Senior Specialist - Daas Lighthouse

BCG BCG · Consulting · Gurgaon, Haryana, India · Technology and Engineering

This role focuses on integrating and optimizing external data into BCG's environment, developing robust data pipelines, and managing technical operations. A key responsibility is designing and implementing GenAI workflows and solutions to enhance data assets and products, and evaluating emerging technologies through MVPs or PoCs.

What you'd actually do

  1. Lead the onboarding and integration of proprietary and third-party datasets into Snowflake and related applications.
  2. Design, develop, document, and maintain robust data pipelines, ensuring seamless ingestion, migration, and rigorous testing.
  3. Develop and manage automated data workflows using Airflow DAGs, Snowflake, Python, APIs, schemas, Streamlit, and data storage solutions such as AWS S3 and Google Cloud Storage.
  4. Design and implement MCP-based GenAI workflows and solutions to enhance data assets and products.
  5. Evaluate emerging technologies and conduct MVPs or PoCs to introduce new data engineering capabilities.

Skills

Required

  • Snowflake
  • Python
  • Airflow
  • Streamlit
  • AWS S3
  • Google Cloud Storage
  • dbt
  • ETL/ELT
  • SQL
  • Data Governance
  • Data Quality
  • Metadata Management
  • Agile methodologies

Nice to have

  • MCP-based GenAI workflows
  • MVPs or PoCs
  • Slowly Changing Dimensions (SCD)
  • Change Data Capture (CDC)
  • Data Validation (DV)

What the JD emphasized

  • 8+ years of experience in Data Engineering, Data Integration, or related data-focused roles.
  • Demonstrated proficiency with technologies including Snowflake, Python, Airflow, Streamlit, AWS S3, Google Cloud Storage, dbt, and Apache Airflow.

Other signals

  • Design and implement MCP-based GenAI workflows and solutions to enhance data assets and products.
  • Evaluate emerging technologies and conduct MVPs or PoCs to introduce new data engineering capabilities.