Data Engineer

Lyft Lyft · Consumer · Ukraine · SCC Tech

Data Engineer on the Safety and Customer Care (SCC) team responsible for data modeling and pipelines powering the Associate and AI Agent Platform. Focus on reliability, data integrations, reporting, and efficiency improvements. Works cross-functionally to bridge business goals with data engineering, enabling access to business and user behavior insights.

What you'd actually do

  1. Owner of the core data pipeline, responsible for scaling up data processing flow to meet the rapid data growth at Lyft
  2. Evolve data model and data schema based on business and engineering needs
  3. Implement systems tracking data quality and consistency
  4. Develop tools supporting self-service data pipeline management (ETL)
  5. SQL and MapReduce job tuning to improve data processing performance

Skills

Required

  • Data Engineering
  • Data Modeling
  • Data Pipelines
  • Spark
  • Hadoop Ecosystem
  • SQL
  • Python
  • Go
  • Workflow Management Tools (Airflow, Oozie, Azkaban, UC4)

Nice to have

  • Customer care related data tables experience

What the JD emphasized

  • 4+ years of professional experience in data engineering
  • Strong experience with Spark
  • Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
  • Strong skills in a scripting language (Python, Go)
  • Good understanding of SQL Engine and able to conduct advanced performance tuning
  • Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
  • 1+ years of experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)