Senior Manager, Data Engineering- Walmart Energy

Walmart Walmart · Retail · Bentonville, AR

Senior Manager, Data Engineering role focused on building and enhancing production-grade data pipelines and platforms for Walmart Energy. Responsibilities include designing, implementing, and maintaining data ingestion, transformation, and processing frameworks, ensuring platform reliability and scalability, implementing data quality and governance frameworks, and leading cloud and platform engineering efforts. Requires strong expertise in SQL, Python, PySpark, GCP, and orchestration tools.

What you'd actually do

  1. Build and Enhance Production-Grade Pipelines: Architect and implement scalable data ingestion, transformation, and processing frameworks to drive major department initiatives, including Real-Time Energy Insights, Bill Anomaly Detection, Tariff Optimization and much more.
  2. Drive Platform Reliability and Scalability: Maintain and optimize GCP and SQL Server environments to increase stability and reduce compute/storage costs. Implement CI/CD pipelines and establish operational playbooks to streamline testing and deployment.
  3. Ensure Data Compliance and Governance: Create and maintain comprehensive data dictionaries, lineage documentation, pipeline specifications, and SLA definitions. Update SSP documentation for Element and GCP environments to meet enterprise security and audit requirements.
  4. Implement Data Quality Frameworks: Design and enforce validation rules, schema evolution checks, and automated data profiling to ensure critical datasets remain reliable and well-governed.
  5. Own Operational Excellence: Monitor production pipelines, lead incident response, and conduct root-cause analysis. Build automation for repeatable processes to reduce manual overhead and improve system uptime.

Skills

Required

  • SQL
  • Python
  • PySpark
  • GCP
  • data pipelines
  • data platforms
  • orchestration tools
  • data processing frameworks
  • CI/CD
  • automated testing
  • version control
  • deployment practices
  • data quality
  • observability
  • lineage
  • metadata
  • governance
  • security controls

Nice to have

  • SQL Server
  • Airflow
  • Element platform

What the JD emphasized

  • production-grade
  • scalable
  • production support
  • root-cause analysis
  • durable engineering improvements