Software Engineer

PayPal PayPal · Fintech · Chicago, IL +1 · Software Engineering

Software Engineer at PayPal in Chicago, IL, responsible for designing and developing secure, high-performing data integration and ETL processes. This role involves building and maintaining robust data pipelines, implementing automated data quality checks, creating design documents, ensuring the reliability and scalability of data systems, troubleshooting data-related issues, and collaborating with stakeholders to meet data requirements. The engineer will also participate in code reviews and stay current with data engineering trends.

What you'd actually do

  1. Design and develop secure, high-performing data integration and ETL processes, participating in all stages of development from analysis to production releases.
  2. Build and maintain robust data pipelines and ETL processes to ingest, transform, and load data from various sources into data warehouse, ensuring scalability and efficiency.
  3. Implement automated data quality checks and validation processes to ensure data integrity and accuracy at scale.
  4. Create and maintain design documents and documentation of data pipelines, systems, and processes.
  5. Ensure the reliability, availability, and scalability of data systems, monitoring performance and optimizing as needed to handle increasing data volumes.

Skills

Required

  • Unix/Linux operating systems
  • SQL
  • Python
  • PySpark or Pandas
  • Google BigQuery or AWS Redshift
  • Experience optimizing performance for large-scale data processing
  • CI/CD
  • AWS or GCP