Data Engineer

Visa Visa · Fintech · Warsaw, Poland, Poland

Visa is seeking a Data Engineer to design, deliver, and evolve scalable data engineering capabilities that support Data Science, AI, and client-facing products for European markets. The role involves translating business needs into data models, creating robust data pipelines, and developing/maintaining databases using big data tools like Hadoop, Hive, and Spark, along with Python and SQL.

What you'd actually do

  1. Understand and translate business needs into data models supporting long-term solutions
  2. Build and manage large scale ETL processes to generate data assets for the region
  3. Build modular and reusable code considering the configurability and scalability while adhering to low-level design
  4. Perform thorough unit testing of development tasks and document the test results using standard defined templates
  5. Build, schedule, and manage DAGs in Apache Airflow efficiently

Skills

Required

  • 5 or more years of relevant work experience with a Bachelor's Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD
  • 2-4 years development experience in building data pipelines and writing ETL code using Hive, PySpark, SQL and Unix
  • Experience in writing and optimizing SQL queries in a big data environment
  • Experience working in Linux/Unix environment and exposure to command line utilities
  • Experience creating/supporting production software/systems and a proven track record of identifying and resolving performance bottlenecks for production systems
  • Exposure to code version control systems (git)
  • Strong communication skills
  • Ability to understand business requirements of the broader business
  • Good understanding of agile working practices and related program management skills

Nice to have

  • 6 or more years of relevant work experience with a Bachelor's Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD
  • Advanced degree in technical field (e.g. Computer Science, statistics, etc.)
  • Experience working with cloud services (e.g. AWS, GCP, Azure)
  • Good communication and presentation skills with ability to interact with different cross-functional team members at varying levels
  • Experience with visualization tools like Tableau and Power BI
  • Exposure to Financial Services or the Payments Industry