Multimodal AI Algorithm Expert-emg / Interaction Perception, Pico

ByteDance ByteDance · Big Tech · San Jose, CA · R&D

Research and develop deep learning models for multimodal data fusion using sEMG, computer vision, and IMU technologies, focusing on signal acquisition, processing, and handling sensor noise for enhanced human-virtual world interaction.

What you'd actually do

  1. Research and develop innovative deep learning models with a focus on the intersection of surface electromyography (sEMG), computer vision, and IMU technologies;
  2. Design and implement sEMG signal acquisition pipelines, optimize signal quality, and perform data preprocessing tasks such as denoising and feature extraction;
  3. Explore spatiotemporal feature fusion methods (e.g., Transformer, LSTM, Spatiotemporal Convolutional Networks) to achieve efficient multimodal data fusion;
  4. Handle sensor noise and interference in various environments, optimize model performance, and improve the generalization of algorithms

Skills

Required

  • deep learning
  • training deep models
  • deploying deep models
  • speech recognition frameworks
  • 2D/3D perception algorithms
  • computer vision
  • sEMG signal acquisition
  • sEMG signal processing
  • signal denoising
  • feature extraction
  • digital signal processing
  • digital filtering
  • Fourier transforms
  • correlation analysis
  • modulation

Nice to have

  • analyzing high-dimensional time-series data
  • modeling high-dimensional time-series data
  • speech signals
  • neural signals
  • physiological signals
  • videos
  • sensor data
  • publications in accredited academic conferences
  • Kaggle competitions
  • COCO competitions
  • ImageNet competitions
  • ActivityNet competitions
  • 3D-related challenges

What the JD emphasized

  • deep learning models
  • sEMG signal acquisition
  • multimodal data fusion
  • sensor noise and interference

Other signals

  • deep learning models
  • sEMG signal acquisition
  • multimodal data fusion
  • sensor noise and interference