Sr. Computer Scientist

Adobe Adobe · Enterprise · Bangalore, India

This role focuses on designing and building scalable data pipelines using Medallion Architecture, optimizing data processing, and integrating with external systems within the Advertising Cloud Search, Social, Commerce platform. It involves R&D for cost-effective solutions and collaboration with product managers. The role requires strong fundamentals in data engineering, advanced data processing technologies, and experience with ETL pipelines.

What you'd actually do

  1. Design and build efficient, robust, scalable data pipelines using Medallion Architecture
  2. Design efficient API integrations to handle data from external systems.
  3. Identify and Implement optimizations to improve the performance and efficiency of data pipelines.
  4. Special focus on R&D to challenge status-quo and build solutions that are efficient and cost effective.
  5. Collaborate with Product Managers and other collaborators to understand requirements and provide effective solutions.

Skills

Required

  • ETL pipelines
  • Apache Spark
  • Hive
  • Delta Lake or Iceberg
  • PL/SQL
  • PostgreSQL, MySQL, or other similar database systems
  • Computer Science fundamentals
  • Software architecture, design, and performance

Nice to have

  • Advertising domain
  • DataHub, OpenMetadata, and Apache Atlas
  • RESTful APIs, GraphQL, OAuth, and API authentication mechanisms
  • automation testing and monitoring tools