Senior Software Engineer

Microsoft Microsoft · Big Tech · Bengaluru, KA, IN · Security Research

Senior Software Engineer role focused on designing and building scalable data platforms and pipelines for threat protection strategy, utilizing big data technologies and graph-based data models. The role involves processing large-scale datasets, developing analytics solutions, and ensuring data quality and performance in production systems.

What you'd actually do

  1. Design and build scalable data platforms and pipelines to process large-scale datasets across distributed systems.
  2. Develop data processing and analytics solutions to derive insights from complex and high-volume data.
  3. Build and maintain batch and streaming pipelines using modern data technologies (e.g., Spark, Kafka).
  4. Design and implement graph-based data models, enabling efficient representation of relationships across entities.
  5. Develop graph traversal and relationship analysis logic to support advanced querying and insights (e.g., multi-hop analysis, entity linking).

Skills

Required

  • 7+ years of experience in software engineering, data engineering, or related roles.
  • Strong fundamentals in data structures, distributed systems, and data modeling (including graph modeling concepts).
  • Hands-on experience with big data technologies (e.g., Spark, Kafka, distributed storage systems).
  • Proficiency in Python and SQL.
  • Experience building scalable batch and/or streaming pipelines.
  • Understanding of graph traversal techniques (e.g., BFS/DFS, multi-hop queries, relationship aggregation).
  • Experience working with large datasets and optimizing performance (joins, partitioning, skew handling).

Nice to have

  • Familiarity with graph processing frameworks or graph databases (e.g., GraphFrames, Neo4j, TigerGraph, NetworkX).
  • Experience with cloud platforms (Azure/AWS/GCP) is a plus.