Lead Software Engineer

New Relic New Relic · Enterprise · Hyderabad, India · Telemetry Data Platform

Lead Software Engineer at New Relic responsible for architecting and building a massive-scale streaming data platform for observability ingestion pipelines, focusing on high throughput, low latency, and distributed systems using Java, Kafka, and cloud-native technologies.

What you'd actually do

  1. Define and drive the architectural roadmap for our core observability ingestion pipelines, ensuring high availability, resilience, and operational excellence.
  2. Lead the design and development of highly concurrent, distributed systems using advanced Java, Kafka, and cloud-native technologies.
  3. Act as the principal technical expert, mentoring a team of engineers and establishing rigorous standards for code quality, testing, and performance optimization.
  4. Architect multi-cloud infrastructure solutions, optimizing primarily for AWS while leveraging Azure for cross-cloud compatibility and routing.
  5. Proactively identify and eliminate systemic bottlenecks through JVM tuning, advanced concurrency management, and efficient data structure design.

Skills

Required

  • 8+ years in software engineering
  • designing and building large-scale, highly concurrent distributed systems
  • Advanced Java
  • JVM tuning
  • garbage collection optimization
  • concurrency
  • multithreading
  • Apache Kafka (or AWS MSK)
  • partition strategies
  • consumer group rebalancing
  • high-throughput tuning
  • AWS compute and data services (EKS, S3)
  • Kubernetes
  • Docker
  • data structures
  • algorithms
  • resilient microservices design
  • technical leadership
  • mentoring engineers

Nice to have

  • stream processing frameworks
  • Apache Flink
  • Kafka Streams
  • Azure equivalents (Event Hubs, AKS, Blob Storage)
  • Infrastructure as Code (IaC)
  • Terraform
  • CI/CD pipelines
  • DevSecOps best practices
  • MELT stack (Metrics, Events, Logs, Traces)
  • OpenTelemetry (OTel)
  • High Cardinality Solutions
  • high-cardinality time-series data
  • open-source contributions

What the JD emphasized

  • 8+ years in software engineering
  • large-scale, highly concurrent distributed systems
  • Expert-level proficiency in Java
  • deep knowledge of JVM tuning, garbage collection optimization, concurrency, and multithreading under extreme load
  • Mastery of Apache Kafka (or AWS MSK)
  • deep understanding of partition strategies, consumer group rebalancing, and high-throughput tuning
  • Extensive hands-on experience with AWS compute and data services (EKS, S3)
  • strong architectural knowledge of Kubernetes and Docker
  • Exceptional problem-solving skills
  • strong foundation in data structures, algorithms, and resilient microservices design
  • Proven track record of defining technical vision, mentoring engineers, and successfully leading the delivery of mission-critical systems