Senior Software Engineer (big Data)

Mastercard Mastercard · Fintech · O Fallon, MO +1 · Engineering

Mastercard is seeking a Backend Software Engineer to join the AI&DPE Data Engineering platform team, responsible for building and evolving large scale backend data systems, real time and batch pipelines, and AI enabled services that power analytics, decisioning, and automation across the organization. This role focuses on Scala/Python/Java, distributed data platforms (Cloudera/Spark), and cloud based architectures, with a strong emphasis on AI agent creation and intelligent automation.

What you'd actually do

  1. Design, develop, and maintain backend services and data pipelines using Scala, Python and Java
  2. Build and optimize batch and streaming workloads on Cloudera Data Platform (CDP) using Spark
  3. Design and implement high quality datamarts and curated datasets with strong emphasis on data integrity, performance, and reliability
  4. Design, build, and integrate AI powered agents that operate to support: Anomaly detection and operational intelligence, workflow automation
  5. Apply generative AI driven, or rule based agents to reduce manual effort and improve scalability across backend systems

Skills

Required

  • Scala
  • Python
  • Java
  • Cloudera Data Platform (CDP)
  • Spark
  • data modeling concepts
  • distributed systems
  • large scale data processing

Nice to have

  • Databricks
  • AWS
  • Kafka
  • Hadoop ecosystem
  • Hive/Impala
  • model monitoring
  • AI platform enablement
  • ETL tools
  • Agile / Scrum

What the JD emphasized

  • AI agent creation
  • intelligent automation
  • AI powered agents
  • generative AI driven
  • rule based agents

Other signals

  • AI agent creation
  • intelligent automation
  • generative AI driven agents