Sr. Software Development Engineer 4

Adobe Adobe · Enterprise · San Jose, CA

Senior Software Development Engineer 4 at Adobe, focusing on the Experience Platform's Query Service engine. This role involves designing, building, and owning critical parts of a large-scale, cloud-native data platform that applies data science and ML to improve personalized customer experiences. The position requires strong skills in big data engineering, distributed systems (Apache Spark), SaaS application development, and experience with various data storage and processing technologies. A plus is experience with LLMs for product intelligence.

What you'd actually do

  1. Own the technical design/architecture, vision and implementation strategy for major systems & components of the Adobe Experience Cloud data platform focused on distributed Query Engine.
  2. Build/code/test and own critical parts of the services to run at scale.
  3. Ability to articulate the design and code choices to multi-functional and architecture teams.
  4. Reviewing and providing feedback on features, technology, architecture, designs, and test strategies
  5. Mitigating risks & creative problem solving

Skills

Required

  • Apache Spark
  • Spark ML
  • Spark internals
  • data structures and algorithms in Scala/Java/Akka framework
  • developing, deploying, highly available, SaaS applications and services in public cloud
  • big-data engineering
  • cloud-based data warehouse
  • No-SQL
  • RDBMS/Data warehouse
  • data sharing and federation
  • cost consciousness around computation and memory requirements
  • strong verbal and written communication skills
  • Bachelor's Degree in Computer Science with 7 years experiences or MS/Ph.D Degree in Compute Science or relevant field with 5+ year experiences

Nice to have

  • LLM/vertical LLM for improving in product intelligence (SQL rewriting, anomalies, forecasting and more)

What the JD emphasized

  • Required: Proficiency in data structures and algorithms in Scala/Java/Akka framework
  • Proven knowledge in developing, deploying, highly available, SaaS applications and services in public cloud.
  • Proficiency in big-data engineering and cloud-based data warehouse.
  • In depth experience with No-SQL as well as RDBMS/Data warehouse, data sharing and federation

Other signals

  • petabytes of data
  • data science and machine learning (ML)
  • Query Service engine
  • multi-tenant cloud-native reporting platform
  • advanced analytics
  • ML techniques
  • predictive metrics
  • Apache Spark
  • Presto
  • Comet
  • Apache Airflow
  • SaaS applications
  • big-data engineering
  • cloud-based data warehouse
  • No-SQL
  • RDBMS/Data warehouse
  • data sharing and federation
  • LLM/vertical LLM for improving in product intelligence (SQL rewriting, anomalies, forecasting and more)