Senior Software Engineer-bigdata & Hadoop Engineer With Development Experience

Visa Visa · Fintech · Austin, TX

Seeking a Senior Software Engineer with Big Data and Hadoop experience, also skilled in full-stack development and AI/ML technologies. The role involves supporting, maintaining, and enhancing Big Data platforms, contributing to software development initiatives using modern programming languages, cloud platforms, APIs, and Generative AI to deliver business solutions. Responsibilities include engineering and administration of Big Data platforms, developing automation solutions, writing clean code, building front-end and back-end services, and leveraging GenAI for innovation and productivity.

What you'd actually do

  1. Perform engineering and administration duties for Big Data platforms built on open-source technologies such as Hadoop, Spark, and HBase
  2. Design, develop, and implement automation solutions, tools and products to improve operational efficiency, platform reliability, and system scalability.
  3. Write clean, efficient, and maintainable code based on business and technical requirements, and support the testing, deployment, and validation of software solutions.
  4. Build and enhance front‑end applications using HTML, CSS, JavaScript, and SQL, applying strong UI/UX principles.
  5. Develop and maintain back‑end services using Python, Java, and related technologies, including API design and integration.
  6. Leverage Generative AI (GenAI) to drive innovative solutions, improve productivity, testing, and automation.

Skills

Required

  • Hadoop
  • Spark
  • Python
  • Java
  • Software Engineering
  • Computer Science Fundamentals
  • Data Structures
  • Front-end development (HTML, CSS, JavaScript)
  • Back-end development
  • API Design
  • Generative AI
  • LLMs
  • LangChain
  • LangGraph
  • Linux fundamentals
  • System concepts (CPU, memory, storage, networking)

Nice to have

  • Cloud platforms (AWS/GCP)

What the JD emphasized

  • 2+ year of experience with Big Data technologies (Hadoop, Spark) is required.
  • Expertise in one or more programming languages Python or Java required.
  • Proficiency in programming languages such as Python or JAVA and relevant AI libraries such as TensorFlow, PyTorch, etc.
  • Demonstrated use of Generative AI in development and testing workflows

Other signals

  • Leverage Generative AI (GenAI) to drive innovative solutions, improve productivity, testing, and automation.
  • Demonstrated use of Generative AI in development and testing workflows
  • Experience with LLMs and frameworks such as LangChain or LangGraph