Principal Software Engineer - Data Lakes

Fivetran Fivetran · Data AI · Germany · Remote · Engineering Department

Fivetran is seeking a Principal Software Engineer to contribute to the technical architecture, design, and development of their Managed Data Lake product offering. The role involves partnering with product and engineering teams to build scalable, high-performance systems, advance open-source technologies, and set technical standards. Responsibilities include designing, developing, and operating large-scale data lake systems, contributing to open-source projects like DuckDB and Polaris, and ensuring operational excellence.

What you'd actually do

  1. Partner closely with product teams to understand requirements and design cutting-edge new capabilities that go directly into customer’s hands.
  2. Design, develop, implement, and operate highly reliable large-scale data lake systems in cooperation with a dedicated data lake engineering team.
  3. Contribute to open-source projects such as DuckDB and Polaris.
  4. Embrace Fivetran innovations with open-source standards and toolsets.
  5. Analyze fault-tolerance and high availability issues, performance and scale challenges, and solve them.

Skills

Required

  • 6+ years of hands-on or research experience with high-performance relational data management systems.
  • Deep understanding of infrastructure & software optimizations and performance engineering to drive significant performance, latency, and availability improvements.
  • Proven track record of leading and delivering large and complicated projects.
  • Strong development skills in Java and C++.
  • Solid experience with public clouds (AWS, Azure, GCP).
  • Demonstrated knowledge of columnar storage formats.

Nice to have

  • MS or PhD in Computer Science, ideally focusing on database management and/or storage engines.

What the JD emphasized

  • high-performance relational data management systems
  • infrastructure & software optimizations and performance engineering
  • leading and delivering large and complicated projects