Databricks Engineer

This role focuses on data engineering tasks using Databricks, Python, and SQL within a CI/CD environment. Responsibilities include developing and maintaining data pipelines, cleaning and transforming data, and integrating client datasets. The role is part of Deloitte's AI & Engineering team, supporting clients in the Government & Public Services sector.

What you'd actually do

  1. Participate in and contribute to the development and maintenance of Data Engineering Pipelines
  2. Utilize Databricks, Python, SQL and database operations and processing concepts in a CI/CD environment
  3. Clean, standardize, and transform raw data using repeatable routines for validation, deduplication, and business-rule application to deliver client-specified output formats and curated analytics-ready tables
  4. Ingest and integrate client datasets by coordinating secure data transfers, profiling incoming files, and orchestrating end-to-end pipelines

Skills

Required

  • Databricks
  • Python
  • SQL
  • data engineering
  • data pipelines
  • CI/CD

Nice to have

  • Master's degree
  • Federal Health experience
  • Active Public Trust clearance

What the JD emphasized

  • Must be able to obtain and maintain the required Public Trust clearance for this role