Software Engineer Ii, Data Engineering

DoorDash DoorDash · Consumer · San Francisco, CA · 318 Data

Software Engineer II, Data Engineering role focused on building and scaling data infrastructure, pipelines, and data models for a data lake and data warehouse. Responsibilities include designing, developing, and implementing large-scale data solutions, ensuring data quality, and improving ETL processes. Requires proficiency in Python/Java, ETL orchestration tools, distributed computing (Spark, Hive), streaming technologies (Kafka/Flink), and database fundamentals.

What you'd actually do

  1. Design, develop and implement large scale, high volume, high performance data models and pipelines for Data Lake and Data Warehouse
  2. Develop and implement data quality checks, conduct QA and implement monitoring routines
  3. Improve the reliability and scalability of our ETL processes
  4. Manage a portfolio of data products that deliver high-quality, trustworthy data
  5. Help onboard and support other engineers as they join the team

Skills

Required

  • 3+ years of professional experience working in data engineering, business intelligence, or a similar role
  • Proficiency in programming languages such as Python/Java
  • 3+ years of experience in ETL orchestration and workflow management tools like Airflow, Flink, Oozie and Azkaban using AWS/GCP
  • Expert in Database fundamentals, SQL and distributed computing
  • 3+ years of experience with the Distributed data/similar ecosystem (Spark, Hive, Druid, Presto) and streaming technologies such as Kafka/Flink.
  • Experience working with Snowflake, Redshift, PostgreSQL and/or other DBMS platforms
  • Excellent communication skills and experience working with technical and non-technical teams
  • Knowledge of reporting tools such as Tableau, Superset and Looker
  • Comfortable working in fast paced environment, self starter and self organizing
  • Ability to think strategically, analyze and interpret market and consumer information
  • Must be located near one of our engineering hubs