Lead Data Engineer, Marketing Operations and Engineering

Adobe Adobe · Enterprise · San Jose, CA

Lead Data Engineer role focused on evolving a data platform to support analytics, reporting, machine learning, and generative AI use cases. The role involves designing and developing scalable data pipelines, ETL/ELT processes, and data platforms, re-architecting data models for AI-readiness, and enabling AI-enabled workflows. Collaboration with data scientists and AI/ML teams is key to building scalable, AI-ready data systems.

What you'd actually do

  1. Lead the design and development of scalable data pipelines, ETL/ELT processes, and data platforms that support analytics, marketing measurement, and AI/ML use cases
  2. Partner with business, data science, and engineering teams to define requirements, design architectures, and deliver high-quality data products
  3. Own and evolve the data platform to ensure data quality, governance, reliability, and efficient access for analysts, data scientists, and AI systems
  4. Re-architect and optimize data models and databases to improve usability, performance, and AI-readiness (semantic layers, feature-ready datasets)
  5. Drive adoption of AI-enabled workflows to accelerate development, automate insights, and improve operational efficiency

Skills

Required

  • SQL
  • Python
  • Spark
  • modern data pipeline/orchestration tools (e.g., Airflow, dbt)
  • cloud platforms (AWS, Azure, GCP)
  • modern data platforms such as Databricks
  • data modeling
  • data quality
  • governance
  • scalable distributed systems
  • collaboration with data scientists and BI teams
  • AI/ML workflows
  • Generative AI concepts (e.g., embeddings, RAG, vector databases, LLM-powered applications)

Nice to have

  • AI-assisted development tools (e.g., Cursor, Copilot, Claude)

What the JD emphasized

  • AI/ML use cases
  • AI-ready data systems
  • AI/ML teams
  • AI systems
  • AI-readiness
  • AI-enabled workflows
  • Generative AI concepts
  • AI-assisted development tools

Other signals

  • data platform for AI/ML
  • AI-ready data systems
  • feature-ready datasets