Senior Data Engineer-3366

Comcast Comcast · Media · Philadelphia, PA

Senior Data Engineer responsible for designing, maintaining, and automating data pipelines and ETL processes using various technologies including PostgreSQL, BigQuery, PySpark, Python, Glue, and Airflow. The role involves processing data on cloud platforms (AWS, GCP), developing data visualizations, performing data analysis for optimization and insights, and collaborating with data scientists and engineers on AI/ML techniques for WiFi CX optimization. The position also requires building business insights, solving critical issues, and mentoring junior engineers.

What you'd actually do

  1. Provide technical leadership in creating, maintaining, and designing data pipelines using PostgreSQL, BigQuery, and PySpark
  2. develop and automate ETL processes using Python, Glue, and Airflow
  3. develop data visualizations using Kibana and Tableau
  4. process data on cloud platforms including AWS and Google Cloud Platform (GCP)
  5. perform data analysis to discover opportunities and address gaps

Skills

Required

  • PostgreSQL
  • BigQuery
  • PySpark
  • Python
  • Glue
  • Airflow
  • Kibana
  • Tableau
  • AWS
  • Google Cloud Platform (GCP)

What the JD emphasized

  • Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and five (5) years of experience creating, maintaining, and redesigning data pipelines using PostgreSQL, BigQuery, and PySpark; developing and automating ETL processes using Python, Glue, and Airflow; developing data visualizations using Kibana and Tableau; of which three (3) years include processing data on cloud platforms including AWS and Google Cloud Platform (GCP)

Other signals

  • work with data scientists and wireless engineers on WiFi CX optimization using AI/ML techniques