Data Engineer III

Walmart Walmart · Retail · Bangalore, KA, India

Data Engineer III role focused on building and maintaining scalable data pipelines for ingesting, transforming, and analyzing massive datasets. The role involves ensuring data quality and efficiency, collaborating with cross-functional teams, and optimizing data pipelines for analytics and operational use. Experience with Scala, Spark, GCP (BigQuery, GCS, Data Proc), Kafka, Spark Structured Streaming, SQL, NoSQL, Git, CI/CD, Airflow, and large-scale datasets is required. Familiarity with BI tools and a plus for Generative AI/Agentic AI exposure.

What you'd actually do

  1. Design and implement scalable, high-performance data pipelines to manage massive datasets.
  2. Leverage cutting-edge technologies to ensure data accuracy, reliability, and efficiency.
  3. Collaborate with cross-functional teams, to deliver innovative, data-driven solutions.
  4. Manage and optimize data pipelines for analytics and operational use.
  5. Ensure data quality and governance across the data lifecycle.

Skills

Required

  • 4–6 years of hands-on experience building robust data solutions
  • expertise in data modeling
  • warehousing
  • ETL processes
  • distributed computing frameworks
  • Strong proficiency in Scala and Spark
  • Practical experience with Google Cloud Platform (GCP) services such as Big Query, GCS, and Data Proc
  • near real-time data ingestion using Kafka and Spark Structured Streaming
  • Strong working knowledge of both SQL and NoSQL systems
  • in-depth understanding of data warehousing concepts and best practices
  • Proficiency in Git/version control
  • CI/CD pipelines
  • workflow schedulers like Airflow
  • working with large-scale data sets
  • Bachelor's/Master's degree in Computer Science and 4+ years' experience in software engineering or related field OR Bachelor's/Master's degree with 5+ years' experience in software engineering or related field OR Bachelor's degree in Computer Science and 2 years' experience in software engineering or related field OR 4 years' ex

Nice to have

  • Familiarity with BI/visualization tools like Tableau or Looker
  • Hands-on exposure to Generative AI (Gen AI), Agentic AI