Description for Internal Candidates
Commercial Banking IT is working on a strategic top priority initiative called Client 360 and working on building a CIB wide Marketing and Events Data Platform. We are looking for Big Data Software Engineer with skills and experience implementing platform to large-scale processing on internal as well as public cloud. This individual will work on groundbreaking work to implement new platform for Marketing and Events for Client 360 and also enhance the existing platforms.
As a member of our Software Engineering Group we look first and foremost for people who are passionate around solving business problems through innovation & engineering practices. You will be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner continuously with your many stakeholders on a daily basis to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You’ll work in a collaborative, trusting, thought-provoking environment—one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.
Responsibilities:
Acquire data from primary or secondary data sources
Identify, analyze, and interpret trends or patterns in complex data sets
Transforming existing ETL logic on AWS Platform or Data Bricks
Innovate new ways of managing, transforming and validating data
Implement new or enhance services/scripts
Establish and enforce guidelines to ensure consistency, quality and completeness of data assets
Apply quality assurance best practices to all work products
Analyze, design and code business-related solutions, as well as core architectural changes, using an Agile programming approach resulting in software delivered on time and in budget;
Experience of working in a development teams, using agile techniques and Object Oriented development and scripting languages, is preferred
Comfortable learning cutting edge technologies and applications to greenfield project
**Qualifications ** This role requires a wide variety of strengths and capabilities, including:
Advanced knowledge of application, data and infrastructure architecture disciplines
3+ years of Experience with Python is preferred
2+ years of Experience in Java Development
2+ Experience in a Big Data technologies (e.g. AWS, Spark, Kafka, Data Bricks etc.)
Experience in writing efficient SQL's
Experience in implementing complex ETL transformations on big data platform
Strong Experience with UNIX shell scripting to automate file preparation and database loads
Experience in data quality testing; adept at writing test cases and scripts, presenting and resolving data issues
Familiarity with relational database environment (Oracle, SQL Server, etc.) leveraging databases, tables/views, stored procedures, agent jobs, etc.
Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy
Strong development discipline and adherence to best practices and standards.
Ability to manage multiple priorities and projects coupled with the flexibility to quickly adapt to ever-evolving business needs
Demonstrated independent problem solving skills and ability to develop solutions to complex analytical/data-driven problems
Must be able to communicate complex issues in a crisp and concise fashion to multiple levels of management
Excellent interpersonal skills necessary to work effectively with colleagues at various levels of the organization and across multiple locations
Experience in Data Science, Machine Learning and AI is a plus
Financial Services and Commercial banking experience is a plus
Familiarity with NoSQL platforms(MongoDB, AWS Open Search) is a plus