Senior Data Engineer, Guest & Host

Airbnb Airbnb · Consumer · Bangalore, India · Software Engineering

This role is for a Senior Data Engineer on the Guest & Host team at Airbnb. The primary focus is on building and maintaining data pipelines and platforms that support supply vetting, quality moderation, and AI-assisted vetting processes. The role involves designing, building, and operating distributed data platforms and ETL pipelines to ensure data quality and enable insights for operations and product teams. While the role supports AI-assisted vetting, it is not directly building or researching AI models.

What you'd actually do

  1. Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, listing details, and external data feeds.
  2. Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization.
  3. Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework
  4. Collaborate with cross-functional teams, including Data Scientists, Product Managers, andSoftware Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements.
  5. Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity

Skills

Required

  • 6+ years of relevant industry experience
  • BE/B.tech in computer science or relevant technical field
  • Extensive experience designing, building, and operating robust distributed data platforms (e.g., Spark, Kafka, Flink, HBase) and handling data at the petabyte scale.
  • Strong knowledge of Java, Scala, or Python, and expertise with data processing technologies and query authoring (SQL).
  • Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
  • Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
  • Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)
  • Excellent written and verbal communication skills