Senior Software Engineer - Data Infrastructure

Marqeta Marqeta · Fintech · Job Requisition - Premium+/Premium/National · ML, AI, Data Platform

Senior Software Engineer on the Data Infrastructure team, responsible for the data lakehouse, streaming, orchestration, and catalog platforms that power analytics and AI. This is a platform engineering role building infrastructure for other engineering teams.

What you'd actually do

  1. Define and deliver well-scoped milestones for projects, and may be a technical lead for projects on your team.
  2. Lead design for small-to-medium components and participate in design for larger components, moving from task-level impact to small-to-medium project-level impact.
  3. Have significant ownership of a component of the data infrastructure, including its reliability, performance, and developer experience.
  4. Identify gaps and propose plans towards addressing those gaps.
  5. Independently write code that is clear, well-tested, and appropriately flexible, reusable, and adaptable to changing requirements.

Skills

Required

  • Python
  • SQL
  • distributed systems
  • Apache Kafka
  • Apache Spark
  • Apache Airflow
  • Parquet
  • Hudi
  • Iceberg
  • Delta Lake
  • AWS
  • infrastructure-as-code
  • monitoring
  • alerting

Nice to have

  • payments
  • FinTech
  • Apache Iceberg
  • CDC tooling
  • Debezium
  • Kafka Connect
  • DataHub
  • Java
  • Kubernetes
  • container-based workloads
  • scalable software platforms

What the JD emphasized

  • required part of the software engineering role
  • production context
  • production experience