Software Engineer II - Abnormal Data Platform

Abnormal AI · Vertical AI · United States · Remote · Behavioral Security Products

Software Engineer II on the Abnormal Data Platform team, focusing on building and operating high-scale distributed systems for data storage and retrieval. The role involves working with streaming data, large-scale data storage systems, and partnering with customer teams to understand and implement their use cases. The team utilizes Generative AI tools for software development and is building a new product from scratch.

What you'd actually do

  1. Build out storage and retrieval infrastructure for our Aggregates Platform
  2. Allows our various ingestion pipelines and detection algorithms to send us billions of data points per day to be stored and processed.
  3. Making sure that such a large scale data architecture works at our scale, low latency requirements and scales with our cellular architecture
  4. Work on a series of projects towards scalability, reliability and cost optimisations.
  5. Understand the use cases and scale requirements of our customers and work to implement them.

Skills

Required

  • Experience with building and operating distributed systems and services at a high scale
  • Streaming data systems - using Kafka, Spark, Map/Reduce or similar to process large data sets
  • Working on large scale data storage systems, such as DynamoDB, Aerospike, Redis and Databricks
  • 3-5 years of overall software engineering experience
  • Strong sense of best practices in developing software
  • excellent communication skills across both verbal and written mediums

Nice to have

  • Experience with Generative AI tools like Cursor, GitHub Copilot, and Claude

What the JD emphasized

  • building a new product from scratch
  • comfortable with a level of uncertainty
  • building and operating distributed systems and services at a high scale (~billions of transactions each day)
  • streaming data systems
  • large scale data storage systems