Senior Software Engineer

Cognite Cognite · Industrial · India · Engineering

Seeking a Senior Software Engineer to build high-performance distributed systems and data infrastructure for industrial digitalization. The role involves processing large-scale industrial datasets, developing low-latency APIs, optimizing data storage, and engineering real-time streaming solutions. Experience with Spark, Flink, Kafka, cloud platforms, and distributed systems is required.

What you'd actually do

  1. Build high-performance data pipelines using Spark, Flink, and Kafka to process terabyte-scale industrial datasets.
  2. Develop low-latency APIs and services supporting thousands of concurrent users with sub-second response times.
  3. Optimize time-series, sensor, and operational data storage and retrieval for massive scale.
  4. Engineer distributed processing solutions, including real-time streaming that handles millions of events per second.
  5. Design and evolve cost-efficient data lake architectures (S3/GCS) using modern formats like Parquet/ORC.

Skills

Required

  • Spark
  • Flink
  • Kafka
  • Scala
  • Java
  • Python
  • AWS
  • GCP
  • Azure
  • data lake
  • object storage
  • distributed data systems
  • backend engineering
  • platform engineering
  • JVM performance
  • GC tuning
  • memory management
  • REST
  • gRPC
  • caching
  • Redis
  • monitoring
  • observability
  • Prometheus
  • Grafana
  • OpenTelemetry
  • distributed systems

Nice to have

  • OLAP query performance
  • ClickHouse
  • Pinot
  • Druid
  • industrial/IoT data
  • open-source contributions
  • industrial data/AI platforms

What the JD emphasized

  • high-performance distributed systems
  • low-latency APIs
  • sub-second response times
  • millions of events per second
  • cost-efficient data lake architectures
  • 10K+ QPS
  • strong foundations in JVM performance, GC tuning, and memory management
  • high-throughput REST/gRPC services
  • advanced caching
  • monitoring and observability
  • distributed, secure, and resilient platforms
  • large-scale data
  • industrial/IoT data
  • industrial data/AI platforms