Data Engineer, Operations and Infrastructure Data Science

Google Google · Big Tech · Sunnyvale, CA +1

Data Engineer role focused on designing and managing data pipelines for Vertex AI operations, building automated agents for system monitoring, and creating dashboards for efficiency metrics. The role involves collaborating with data science and finance teams to translate efficiency goals into data models and tracking systems, ensuring alignment with budgetary requirements.

What you'd actually do

  1. Design and manage the data pipelines that power Vertex AI operations, ensuring they are scalable and reliable.
  2. Build and refine automated agents to monitor system health and streamline operational workflows.
  3. Create intuitive dashboards that provide clear visibility into Vertex AI efficiency metrics for both technical and finance stakeholders.
  4. Partner closely with data science and finance teams to translate complex efficiency goals into actionable data models and tracking systems.
  5. Work with finance clients to ensure technical metrics align with budgetary and resource-planning requirements.

Skills

Required

  • data processing software (e.g., Hadoop, Spark, Pig, Hive)
  • algorithms (e.g., MapReduce, Flume)
  • database administration techniques
  • data engineering
  • writing software in Java, C++, Python, Go, or JavaScript
  • managing client-facing projects
  • troubleshooting technical issues
  • working with engineering and sales services teams

Nice to have

  • technical consulting
  • data warehouses
  • data warehouse technical architectures
  • infrastructure components
  • ETL/ELT
  • reporting/analytic tools and environments
  • Big Data
  • information retrieval
  • data mining
  • machine learning
  • building multi-tier high availability applications
  • modern web technologies (e.g., NoSQL, MongoDB, SparkML, TensorFlow)
  • architecting
  • developing software
  • internet scale production-grade Big Data solutions
  • virtualized environments

Other signals

  • data pipelines
  • Vertex AI
  • data science
  • finance stakeholders
  • Google Cloud