Databricks Engineering Consultant

This role focuses on engineering data pipelines and solutions on the Databricks platform, including supporting the development and deployment of machine learning solutions. It involves implementing end-to-end Databricks solutions across data ingestion, transformation, governance, and deployment on major cloud platforms.

What you'd actually do

  1. Designing, developing, testing, and maintaining scalable data pipelines and data products on the Databricks platform using tools such as Auto Loader, Declarative Pipelines, and Structured Streaming
  2. Building and optimizing Databricks SQL endpoints, data models, and integrations with business intelligence tools to support analytics and reporting
  3. Supporting the development and deployment of machine learning solutions using Databricks, Unity Catalog, and MLflow
  4. Advising clients on implementation approaches and operational practices across Databricks data, analytics, and machine learning capabilities
  5. Implementing end-to-end Databricks solutions across data ingestion, transformation, governance, and deployment on Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)

Skills

Required

  • Databricks platform
  • SQL
  • Python
  • Apache Spark
  • AWS
  • Azure
  • GCP

Nice to have

  • Databricks Data Engineer Associate certification
  • Databricks Data Engineer Professional certification
  • Databricks Data Analyst Associate certification
  • government clients
  • public sector clients
  • higher education clients
  • US government security clearance

What the JD emphasized

  • Databricks platform
  • machine learning solutions