Lead Data Engineer

PitchBook PitchBook · Fintech · Seattle, WA · Data Operations

Lead Data Engineer role focused on designing and developing scalable data pipelines and workflows, defining best practices, improving data architecture, and mentoring a team of data engineers. The role involves integrating human-driven workflows with automated systems and applying AI/ML or automation techniques to enhance operational efficiency.

What you'd actually do

  1. Lead the design and development of scalable data pipelines and workflows that support Data Operations
  2. Define and implement best practices for data modeling, pipeline orchestration, testing, and monitoring
  3. Drive improvements in data architecture, including warehousing, transformation layers, and data access patterns
  4. Identify opportunities to modernize tooling, improve performance, and reduce operational overhead
  5. Act as a technical mentor and coach a team of data engineers with diverse experience levels

Skills

Required

  • Advanced SQL skills
  • Strong Python experience
  • Proven experience building and maintaining ETL/ELT pipelines
  • Experience with data warehousing concepts
  • Ability to design scalable, maintainable data models and systems
  • Strong communication skills
  • Demonstrated experience mentoring or guiding other engineers
  • Experience working with large-scale proprietary data environments
  • Familiarity with orchestration tools
  • Experience improving data quality, observability, and governance practices
  • Experience applying AI/ML or automation techniques to improve operational efficiency
  • Must be authorized to work in the United States without the need for visa sponsorship now or in the future

Nice to have

  • Exposure to cloud platforms (AWS, Azure, or GCP)
  • Experience with BI tools such as Tableau or Power BI

What the JD emphasized

  • Must be authorized to work in the United States without the need for visa sponsorship now or in the future