Flight Research Senior Machine Learning Engineer

Joby Aviation Joby Aviation · Robotics · Santa Cruz, CA · Flight Research

This role focuses on building and deploying state-of-the-art perception and reasoning algorithms for autonomous aircraft, training models, and evaluating their performance in complex environments. It involves integrating deep learning with computer vision techniques using multi-sensor inputs and ensuring reliability and robustness in safety-critical applications.

What you'd actually do

  1. Architect and deploy sophisticated algorithms for aircraft environment detection and tracking. By integrating deep learning with geometric computer vision, you will utilize multi-sensor inputs—including lidar, radar, and varied camera systems—to establish comprehensive 3D situational awareness.
  2. Construct high-performance model training pipelines and extensive evaluation systems. These frameworks must ensure reliability by identifying performance nuances in complex edge cases and rare operational scenarios.
  3. Work across multi-disciplinary teams—including controls, systems, and flight testing—to seamlessly embed and validate algorithms within our concept of operations.
  4. Drive continuous improvement of perception stacks through simulation. You will focus on optimizing latency and robustness to ensure peak performance during demanding flight conditions.
  5. Engineer specialized diagnostic and visualization tools to extract meaningful insights from field data. This involves facilitating swift root-cause analysis and resolving perception challenges in active deployments.

Skills

Required

  • C++
  • Python
  • PyTorch
  • Deep Learning
  • Computer Vision
  • Geometric Vision
  • Tracking
  • Object Detection
  • Autonomous Platforms
  • Robotics
  • MLOps

Nice to have

  • Data Curation
  • Model Experimentation
  • GPU Deployment
  • Embedded Systems
  • Autonomous Vehicles
  • Aircraft Data Processing
  • Software Engineering
  • CI/CD
  • MLflow
  • Kubeflow

What the JD emphasized

  • At least 6 years of experience developing and implementing advanced perception frameworks for autonomous platforms, including aircraft, vehicles, or robotics.
  • Bachelor's degree +8 years experience; Master's degree + 6 years experience; PhD degree + 3 years experience.
  • Deep Learning Specialization: Extensive practical knowledge of cutting-edge models for tracking and detecting objects within real-world applications.
  • Computer Vision Proficiency: Comprehensive understanding of geometric vision methods such as visual odometry, structure-from-motion, and stereo vision to facilitate accurate 3D estimation.
  • Competency in C++, Python, and PyTorch, along with various deep learning inference and training ecosystems.
  • A creative approach to engineering that includes a history of mitigating performance delays and addressing complex operational edge cases.
  • Direct experience maintaining commercial autonomous systems by diagnosing technical hurdles and improving live system dependability.

Other signals

  • training models
  • perception algorithms
  • autonomous platforms
  • deep learning
  • computer vision