Senior Data Engineer

Visa Visa · Fintech · Austin, TX

Senior Data Engineer at Visa, focusing on designing, developing, and operating scalable data pipelines and distributed data processing systems. The role involves leveraging AI-assisted techniques, including Generative AI and agentic workflows, to enhance data quality, automation, and productivity within data engineering processes. Responsibilities include building and optimizing data pipelines, developing distributed data processing solutions with Spark, implementing solutions in Scala and Python, writing SQL, and ensuring data quality and security. A key aspect is the application of AI/ML and AI Agents to automate and orchestrate engineering workflows.

What you'd actually do

  1. Design, build, and optimize large‑scale data pipelines and ETL/ELT workflows for batch and streaming processing
  2. Develop and maintain distributed data processing solutions using Apache Spark, including performance tuning and optimization
  3. Implement production‑grade data engineering solutions using Scala and Python (and Java where applicable)
  4. Leverage Generative AI and AI/ML in data engineering workflows to improve productivity, data quality, anomaly detection, monitoring, and automated validations with human oversight.
  5. Build and use AI Agents / Agentic AI to automate and orchestrate engineering workflows across validation, testing, CI execution, and operational checks.

Skills

Required

  • Apache Spark
  • Scala
  • Python
  • SQL
  • UNIX/Linux
  • Data modeling
  • Schema design
  • ETL/ELT
  • CI/CD
  • Generative AI
  • AI Agents
  • Agentic AI

Nice to have

  • Java

What the JD emphasized

  • Leverage Generative AI and AI/ML in data engineering workflows
  • Build and use AI Agents / Agentic AI to automate and orchestrate engineering workflows

Other signals

  • Leverage Generative AI and AI/ML in data engineering workflows
  • Build and use AI Agents / Agentic AI to automate and orchestrate engineering workflows