(usa) Senior, Data Engineer

Walmart Walmart · Retail · Dallas, TX +1

Senior Data Engineer at Walmart responsible for building and optimizing scalable data pipelines and models using cloud technologies, automation, and modern data engineering practices. The role involves transforming complex datasets, integrating data from multiple sources with a focus on quality, observability, and governance, and orchestrating workflows using Airflow and CI/CD pipelines. The engineer will also develop and maintain infrastructure using Terraform and optimize pipelines for reliability, performance, and cost. Collaboration with cross-functional teams is key to delivering robust technical solutions.

What you'd actually do

  1. Design and build scalable data pipelines and models using Databricks, PySpark, and SQL.
  2. Integrate and transform data from multiple sources with strong quality, observability, and governance.
  3. Orchestrate and automate workflows using Airflow and CI/CD pipelines in GitHub Actions.
  4. Develop and maintain infrastructure using Terraform and support DevOps tasks such as deployments, monitoring, and environment management.
  5. Optimize pipelines for reliability, performance, and cost across cloud environments.

Skills

Required

  • SQL
  • Python
  • PySpark
  • Databricks
  • Airflow
  • CI/CD
  • GitHub Actions
  • Terraform
  • Google Cloud Platform
  • data governance
  • data quality
  • resilient data architectures
  • Bachelor’s degree in Computer Science and 3 years' experience in software engineering or related field OR 5 years’ experience in software engineering or related field OR Master's degree in Computer Science and 1 year’s experience in software engineering or related field
  • 2 years' experience in data engineering, database engineering, business intelligence, or business analytics

Nice to have

  • machine learning concepts
  • AI and LLMs integration

What the JD emphasized

  • strong quality, observability, and governance