Databricks Data Engineer

This role focuses on designing, building, and optimizing cloud-based data engineering solutions using Databricks, Apache Spark, Python, and SQL to support analytics and AI use cases. It involves modernizing data platforms and enabling data-driven decision-making for clients.

What you'd actually do

  1. Design, build, and maintain data pipelines and data engineering solutions using Databricks, Apache Spark, Python, and Structured Query Language (SQL)
  2. Support the modernization of enterprise data platforms by implementing cloud-based ingestion, transformation, and storage patterns
  3. Develop and maintain batch and streaming data workflows that support reporting, analytics, and artificial intelligence use cases
  4. Apply data architecture, integration, and data modeling practices to improve data quality, scalability, and platform performance
  5. Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support delivery of large-scale data transformation programs

Skills

Required

  • Databricks
  • Apache Spark
  • Python
  • SQL
  • cloud platform (AWS, Azure, or GCP)
  • data engineering
  • ETL development
  • data platform engineering
  • data pipelines
  • data models
  • data integration patterns
  • cloud-based data processing workflows

Nice to have

  • Delta Lake
  • Databricks Workflows
  • Unity Catalog
  • Git-based version control
  • CI/CD pipelines
  • batch and streaming data workloads
  • data warehousing
  • lakehouse architecture
  • performance optimization
  • analytics or machine learning data pipelines
  • consulting or client service delivery