Senior Data Engineer

Adobe Adobe · Enterprise · Bangalore, India

Senior Data Engineer at Adobe, responsible for building scalable data pipelines and applications that incorporate Generative AI and LLMs, blending structured and unstructured data. The role requires expertise in Spark, Databricks, Python, and SQL, with practical experience in AI/ML technologies and cloud platforms.

What you'd actually do

  1. Build, develop, and maintain scalable data pipelines using Apache Spark, Databricks, and Python.
  2. Write efficient and optimized SQL queries for data extraction, transformation, and analysis.
  3. Engage with multi-functional teams, including data scientists, product managers, and software engineers, to deliver data-driven solutions.
  4. Implement and optimize data models and architectures for performance and scalability.
  5. Build applications that incorporate GenAI and LLM, blending structured data with unstructured data sources.

Skills

Required

  • Apache Spark
  • Databricks
  • Python
  • SQL
  • Data Engineering
  • Software Engineering Principles
  • Generative AI
  • Large Language Models (LLMs)
  • Cloud Platforms (AWS, Azure, GCP)
  • Data Lake Architectures
  • Problem-solving

Nice to have

  • MLOps
  • model deployment
  • serving LLMs
  • Data Visualization
  • Tableau
  • Power BI
  • MERN
  • MEAN

What the JD emphasized

  • Generative AI
  • LLM
  • GenAI and LLM-based solutions

Other signals

  • GenAI and LLM-based solutions
  • data-driven insights
  • scalable data pipelines