About Us Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.
At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.
Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.
Job Description
We are seeking a highly skilled Senior Software Test Engineer with deep functional knowledge of financial systems to lead the automation of data quality validation across large-scale data pipelines processing petabytes of data.
As part of the Finance Data Platform, you will design, build, and maintain scalable, automated testing frameworks that ensure the integrity, accuracy, and reliability of critical financial data. Your expertise in PySpark, Python, SQL, and Hive will be central to driving data quality standards across our enterprise data ecosystem.
This is a hybrid role. In-office expectations will be confirmed by the hiring manager.
Key Responsibilities
- Design, develop, and maintain automated data quality checks for complex, petabyte-scale data pipelines.
- Build scalable data validation frameworks using PySpark, PyTest, Python, SQL, and Hive, ensuring comprehensive test coverage.
- Partner with Data Engineering and DevOps teams to integrate automated testing into CI/CD pipelines.
- Analyze test results to identify data anomalies, root causes, and remediation strategies.
- Develop and maintain production monitoring and alerting solutions for data quality.
- Document testing standards, frameworks, and best practices, and mentor junior engineers in data quality automation.
- Continuously enhance test frameworks to improve performance, scalability, and reliability.
Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.
Qualifications
Qualifications Basic Qualifications
- Bachelor’s degree in Computer Science, Engineering, or a related field and 2+ years of relevant experience,
- OR 5+ years of relevant professional experience.
- 5+ years of experience in test engineering or data engineering roles, with a strong focus on data quality and automation.
- Advanced proficiency in PySpark and Python for large-scale data processing and validation.
- Strong experience with SQL and Hive for querying, profiling, and validating large datasets.
- Hands-on experience with Hive and HDFS.
- Solid understanding of data pipeline architectures, ETL processes, and big data best practices.
- Experience implementing CI/CD pipelines for automated data testing.
- Strong analytical, problem-solving, and communication skills.
- Ability to work independently while collaborating effectively in a fast-paced environment.
Preferred Qualifications
- 3+ years of experience with a Bachelor’s degree, or 2+ years with an advanced degree (Master’s or higher).
- 5+ years of experience in data quality automation or test engineering roles.
- Experience with data quality frameworks such as Amazon Deequ or Great Expectations.
- Familiarity with workflow orchestration tools such as Apache Airflow or AWS Step Functions.
- Exposure to data cataloging, data lineage, and metadata management tools and concepts.
Visa is an EEO Employer
Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.