Senior Staff Software Engineer - Binary Log Data Replication

Fivetran Fivetran · Data AI · Oakland, CA · Engineering Department

Fivetran is seeking a Senior Staff Software Engineer to focus on SQL Server and Oracle binary log reading and change data capture for their data pipeline service. The role involves building new features, improving software architecture, and ensuring reliable operation by diving deep into database transaction logs and binary log parsing for data replication.

What you'd actually do

  1. Develop and implement strategies for reading SQL Server or Oracle binary logs to enhance data replication accuracy and efficiency.
  2. Utilize reverse engineering techniques to understand and improve upon the database binary log structure for better data integrity and replication performance.
  3. Debugging and analyzing existing code that is in use by hundreds of customers today, including those operating the largest SQL Server clusters.
  4. Analyze new features introduced by SQL Server and/or Oracle in recent releases and determine how to develop supporting features.
  5. Participate in the maintenance and improvement of existing connectors; call for improvement in all areas of Fivetran's codebase and infrastructure.

Skills

Required

  • 10+ years programming in Java, C or C++ languages, with a strong background in SQL Server.
  • Experience with SQL Server and/or Oracle binary log reading and the ability to reverse engineer database binary logs.
  • Writes well-structured and performant code
  • Be able to solve critical problems for our largest customers to minimize impact.
  • Be able to dive into code that has been previously written and suggest improvements.
  • Understand and can explain how to build high performance systems and processes.
  • Able to define project requirements and be proficient at designing software and infrastructure.
  • Enjoy mentoring and growing junior develops.
  • Have an analytical mindset that helps you identify design flaws in existing systems and come up with improvements.
  • Experience understanding customer requirements and/or problems and breaking them down into engineering tasks.

Nice to have

  • Advanced knowledge in reverse engineering, particularly with database systems.
  • Experience in working with open source projects with other collaborators.
  • Experience in data processing (ETL, ELT) and/or cloud-based platforms.
  • Experience in designing and developing file, event, application, or database connectors.
  • Experienced working in a cloud environment utilizing AWS, GCP, Kubernetes, Docker, BuildKite, or similar technologies.

What the JD emphasized

  • SQL Server
  • Oracle
  • binary log parsing
  • data replication
  • performance