Engineer Iii, Sdet - AI Detection and Response (aidr) (hybrid)

CrowdStrike CrowdStrike · Enterprise · Sunnyvale, CA +2

Engineer III, SDET role focused on AI Detection and Response (AIDR) at CrowdStrike. The role involves expanding test coverage, modernizing test infrastructure, and establishing quality frameworks for AI security controls. Key responsibilities include contract testing, improving test coverage across layers, and establishing efficacy testing for LLM models with measurable accuracy metrics. The role requires experience in software development, test automation, cloud SaaS products, and programming languages like Python, Go, and Javascript. Bonus points for experience testing AI/ML systems, LLM applications, and AI efficacy testing.

What you'd actually do

  1. Design and implement contract testing framework to verify API contracts between various system components.
  2. Contribute comprehensive test strategies spanning unit, integration, contract testing layers
  3. Establish testing patterns and best practices for AI-powered detection capabilities and models efficacy
  4. Develop comprehensive E2E test scenarios covering multi-collector deployments and policy enforcement workflows.
  5. Implement quality telemetry through observability with detailed reporting. Create metrics dashboards, and alerting. Work with SRE and developers to create playbooks and support documentation.

Skills

Required

  • Python
  • Go
  • Javascript
  • Cloud architectures
  • microservices
  • REST
  • gRPC
  • Protocol Buffers
  • PostgreSQL
  • Redis
  • Docker
  • Kubernetes
  • CI/CD pipelines
  • AWS/Azure/GCP
  • debugging
  • distributed systems
  • JMeter
  • Gatling
  • New Relic
  • Datadog
  • Prometheus/Grafana

Nice to have

  • AI/ML systems
  • LLM applications
  • prompt engineering security
  • Performance testing
  • ML development lifecycle
  • model training
  • evaluation
  • deployment
  • AI efficacy testing
  • adversarial testing
  • red teaming
  • browser extension testing
  • API gateway testing
  • Kong
  • Envoy
  • LiteLLM
  • Model Context Protocol (MCP)
  • agentic AI systems

What the JD emphasized

  • AI security controls
  • efficacy testing of LLM models
  • AI-powered detection capabilities
  • AI/ML systems
  • LLM applications
  • prompt engineering security
  • AI efficacy testing
  • adversarial testing
  • red teaming
  • agentic AI systems

Other signals

  • AI security controls
  • efficacy testing of LLM models
  • AI-powered detection capabilities