Senior Data Engineer, Payments

Airbnb Airbnb · Consumer · Bangalore, India · Software Engineering

Senior Data Engineer on the Payments team at Airbnb, focusing on data pipelines and models for tax, payments, and legal compliance. The role involves building and maintaining critical data infrastructure, ensuring data accuracy and quality, and collaborating with cross-functional teams. Experience with distributed data platforms, ETL schedulers, and SQL is required.

What you'd actually do

  1. Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds.
  2. Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy.
  3. Develop high quality data assets for product use-cases by partnering with Product, AI/ML and Data Science.
  4. Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework
  5. Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements.

Skills

Required

  • 6+ years of relevant industry experience
  • BE/B.tech in computer science or relevant technical degree
  • Hands on experience in DSA coding -Data structure and algorithm
  • Extensive experience designing, building, and operating robust distributed data platforms (e.g., Spark, Kafka, Flink, HBase) and handling data at the petabyte scale.
  • Strong knowledge of Scala, or Python, and expertise with data processing technologies and query authoring (SQL).
  • Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
  • Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
  • Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)
  • Excellent written and verbal communication skills

What the JD emphasized

  • compliance with Tax, Payments, and Legal regulations
  • data must be of the highest accuracy and quality
  • critical Compliance data ecosystem