Senior Data Engineer

F5 F5 · Enterprise · Cork

Senior Data Engineer role focused on designing and building data models and pipelines for product data (telemetry, logs, alerts). Responsibilities include data architecture, modeling, performance optimization, data quality, observability, and adherence to data governance standards. Experience with ML data requirements is a bonus.

What you'd actually do

  1. Participate in the design and lead the implementation and optimization of data models and pipelines for multiple uses; understand and implement the data architecture and security and access standards used within the Product organization
  2. Understand and lead the implementation of data management standards for schema evolution, versioning, backfill and retry capabilities, etc.
  3. Design and manage the adoption of best practices in testing, monitoring, alerting and runbook-driven operations for pipelines; in collaboration with the Data Platform Architect, champion the development and adoption of robust RCA and remediation strategies
  4. Implement and enforce SLAs and data lifecycle management; Develop standards for data quality checks, observability, and alerting for production data systems
  5. Contribute to technical and architectural documentation; provide guidance on data cataloguing and metadata requirements to data owners

Skills

Required

  • data engineering
  • data architecture
  • data modeling
  • database performance optimization
  • pipeline performance optimization
  • data flows
  • data quality systems
  • observability systems
  • monitoring frameworks
  • alerting frameworks
  • data cataloguing
  • metadata
  • lineage
  • devops standards
  • CI/CD
  • testing frameworks
  • software engineering processes
  • data governance framework
  • communication
  • collaboration

Nice to have

  • dbt
  • Databricks
  • Unity Catalog
  • git
  • AWS
  • ML data requirements