Software Engineer

John Deere John Deere · Industrial · LU · Technology (CA)

Software Engineer role focused on building and operating data products within John Deere Financial's European IT department. Responsibilities include consolidating data, building scalable data pipelines using Apache Spark (PySpark) and Databricks, automating processing, and ensuring data availability and compliance for BI/Analytics consumption. The role involves data migration to a cloud-hosted Enterprise Data Lake and leveraging DevOps principles.

What you'd actually do

  1. Collaborate on data migration initiatives from on-premises to our cloud-hosted Enterprise Data Lake and automate processing capabilities.
  2. Establish scalable, secure and automated data pipelines and infrastructure to enable data analysis and collection.
  3. Develop and maintain scalable data pipelines using Apache Spark (PySpark) and cloud-based technologies.
  4. Follow industry-standard agile software design methodology for development and documentation.
  5. Support your colleagues and team members, working collaboratively and sharing knowledge in pair-programming and coding review sessions.

Skills

Required

  • Python
  • Apache Spark/PySpark
  • SQL DB
  • NoSQL DB
  • Data Lake concepts
  • Databricks workflows
  • Databricks dashboards
  • Databricks Unity Catalog
  • ETL
  • Data Modeling
  • Data Warehousing
  • large-scale datasets
  • AWS services (Lambda, API Gateway, S3)
  • DevOps
  • Continuous Integration
  • Continuous Delivery/Deployment
  • Git
  • Jenkins
  • Peer Reviews
  • Pair Programming
  • agile team environment
  • English fluency

Nice to have

  • Master’s degree in IT/Computer Science/Engineering or equivalent work experience