Confluent Kafka & Flink Infrastructure Engineer

State Farm State Farm · Insurance · Bloomington, IL +3 · Technology and UX

State Farm is seeking an Infrastructure Engineer to build and operate the Event Hub platform, focusing on Confluent Kafka and Apache Flink infrastructure. Responsibilities include provisioning, configuration, management, HA/DR planning, IaC, automation, and ensuring observability and security. The role requires production experience with Kafka/Confluent, Flink, IaC, AWS, and HA/DR practices.

What you'd actually do

  1. Provision, configure, and manage Confluent Kafka (brokers, topics/partitions, ACLs, schema registry) and enforce platform governance standards (retention, quotas, security).
  2. Operate Apache Flink infrastructure (job/task managers, checkpointing, state backend) and support runtime availability and performance.
  3. Design and maintain high availability (AZ/region) and disaster recovery plans, including failover testing and runbooks.
  4. Use Infrastructure as Code (IaC) and automation to deliver reproducible, auditable infrastructure and support infrastructure CI/CD.
  5. Own observability and security for Kafka/Flink (monitoring/alerting/runbooks, encryption, IAM/VPC/network isolation, certificate and access management).

Skills

Required

  • Apache Kafka administration
  • Confluent Platform administration
  • Apache Flink operation
  • Infrastructure as Code (IaC)
  • AWS
  • High Availability (HA)
  • Disaster Recovery (DR)
  • Security for distributed systems
  • Networking for distributed systems
  • CI/CD

Nice to have

  • Confluent Cloud
  • EKS
  • ROSA
  • OpenTelemetry
  • distributed tracing
  • GitOps

What the JD emphasized

  • production experience administering Apache Kafka or Confluent Platform
  • Experience operating Apache Flink
  • Strong IaC experience
  • Proven experience with HA/DR and reliability practices