Data Engineer III – Palmos (enterprise Platforms)

JPMorgan Chase JPMorgan Chase · Banking · Dublin, Ireland · Corporate Sector

Data Engineer III on the Palmos platform at JPMorgan Chase, responsible for onboarding enterprise data and building scalable data pipelines. The role involves designing, developing, and maintaining data solutions for analytics, reporting, and AI/ML use cases, collaborating with various teams, and ensuring data quality and security within a data mesh architecture. Experience with Python, Spark/PySpark, Databricks, SQL, cloud platforms, and SDLC practices is required, along with hands-on experience using AI coding assist tools.

What you'd actually do

  1. Develop workflows and ELT data pipelines using Python, Spark/PySpark, and Databricks
  2. Onboard enterprise datasets into Palmos, including ingestion, transformation, and validation of data assets
  3. Build, test, and maintain scalable data pipelines and data architectures that support enterprise analytics use cases
  4. Apply data engineering best practices for performance optimization, reliability, and maintainability
  5. Support implementation of data security, governance, and entitlements frameworks to protect enterprise data

Skills

Required

  • Databricks
  • Spark/PySpark
  • Python
  • SQL
  • Data pipelines
  • Data processing systems
  • Data lifecycle
  • Cloud platforms (AWS)
  • Distributed data processing
  • SDLC practices (CI/CD, testing, deployment)
  • Problem-solving
  • Troubleshooting data and pipeline issues
  • Agile teams
  • Stakeholder collaboration
  • AI-assisted software development tools
  • Responsible AI use

Nice to have

  • Databricks lakehouse
  • Delta Lake
  • Medallion architecture
  • Palmos
  • Data mesh principles
  • Data quality tools
  • Observability tools
  • Metadata management tools
  • Analytics workloads
  • Reporting workloads
  • AI/ML workloads
  • EU regulatory and data protection environments (e.g., GDPR)

What the JD emphasized

  • Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment
  • Understanding of responsible AI use in engineering workflows