Lead Digital Architect

Caterpillar Caterpillar · Industrial · Bangalore, Karnataka

Lead Data Architect role focused on building a next-gen data platform with AI and advanced analytics capabilities. Responsibilities include architecting enterprise integrations, real-time data movement, data governance, and defining data architecture strategy. Requires extensive experience in Big Data, Data Warehousing, data modeling, and cloud platforms. Familiarity with AI concepts is a plus.

What you'd actually do

  1. Competent to perform all programming and provide oversight for architecture assessment and design for development assignments without close supervision; normally assigned the more complex aspects of systems work.
  2. Lead Architecture design of end-to-end enterprise integrations that serves multiple business functions.
  3. Design and implement end-to-end near real-time data movement solutions that provide core capabilities for the enterprise.
  4. Define the overall data architecture strategy aligned with business goals.
  5. Establish data governance policies, standards, and compliance Drives application development focused around delivering business valuable features

Skills

Required

  • Big Data
  • Data Warehousing
  • end-to-end real-time data movement
  • enterprise integrations
  • data governance policies
  • software quality
  • security guardrails
  • IT blueprint and roadmap
  • business strategies and objectives
  • architecture blueprints
  • enterprise business drivers and requirements
  • technical data solutions
  • application software
  • integrated testing
  • customer acceptance testing
  • software development experience
  • architecture experience
  • data models
  • scalability
  • performance
  • integration needs
  • optimizing database performance
  • indexing
  • storage strategies
  • security measures for data at rest and in transit
  • access control
  • encryption
  • compliance frameworks
  • data integration solutions
  • data flow between applications
  • APIs
  • data warehouses
  • software at scale
  • concurrency
  • Python
  • Object-Oriented programming
  • Data pipelines
  • Big Data
  • cloud-based data platforms (AWS, Azure)
  • large-scale processing
  • Large Data Lakes
  • Data Warehouse (Snowflake Preferred)
  • end-to-end near real-time data pipelines for OLTP & OLAP
  • robust Data Platforms
  • SQL
  • NO-SQL databases
  • Message brokers
  • AWS services such as Kafka/Kinesis, AWS SQS, AWS SNS, Lambda, API Gateway, DynamoDB, Aurora, AWS RDS PostgreSQL
  • Test driven development
  • behaviour driven development
  • leadership on medium to large-scale projects

Nice to have

  • AI concepts and latest developments (Gen AI, MCP, ATA, etc.)

What the JD emphasized

  • deep technical and functional expertise in Big Data, Data Warehousing, and end-to-end real-time data movement
  • architect and build Caterpillar’s state-of-the-art digital platform, while driving innovation in AI and advanced analytics
  • Competent to perform all programming and provide oversight for architecture assessment and design for development assignments without close supervision; normally assigned the more complex aspects of systems work.
  • Lead Architecture design of end-to-end enterprise integrations that serves multiple business functions.
  • Design and implement end-to-end near real-time data movement solutions that provide core capabilities for the enterprise.
  • Define the overall data architecture strategy aligned with business goals.
  • Establish data governance policies, standards, and compliance Drives application development focused around delivering business valuable features
  • Maintains high standards of software quality within the team by establishing good practices and security guardrails per Enterprise standards.
  • Knowledge of target architecture; ability to develop the IT blueprint and roadmap while aligning the architecture and processes with business strategies and objectives
  • Develop and maintain current, planned, and future state architecture blueprints. Lead in the identification and analysis of enterprise business drivers and requirements that drive the future state architecture.
  • Work with business analysts, data engineers, and stakeholders. Translate business requirements into technical data solutions
  • Communicate with end users and stake holders to help direct development, debugging, and testing of application software for accuracy, integrity, interoperability, and completeness.
  • Performs integrated testing and customer acceptance testing of components that requires careful planning and execution to ensure timely, quality results.
  • Four-year bachelor’s degree from an accredited college or university in a Computer Science or Information Technology, or related field
  • 12+ years or more of software development experience or at least 3 years of architecture experience with strong demonstrable experience.
  • 5+ years or more of experience in designing conceptual, logical, and physical data models & data models support scalability, performance, and integration needs.
  • 5+ years of Data Warehousing experience & optimizing database performance, indexing, and storage strategies
  • Expert in implementing security measures for data at rest and in transit and defining access control, encryption, and compliance frameworks
  • Strong in designing data integration solutions across systems ensuring smooth data flow between applications, APIs, and data warehouses
  • Designing, developing, deploying and maintaining software at scale, with good understanding of concurrency.
  • Working experience in Python as an Object-Oriented programming language
  • In-Depth understanding of how Data pipelines work in Big Data & expert in designing architectures for cloud-based data platforms (AWS, Azure) for large-scale processing.
  • Expertise and experience in building Large Data Lakes and Data Warehouse (Snowflake Preferred).
  • Expertise in building end-to-end near real-time data pipelines for OLTP & OLAP.
  • Strong architecture exposure for building robust Data Platforms
  • Expertise in SQL and NO-SQL databases, Message brokers and other AWS services such as Kafka/Kinesis, AWS SQS, AWS SNS, Lambda, API Gateway, DynamoDB, Aurora, AWS RDS PostgreSQL.
  • Test driven development and behaviour driven development.
  • Ability to work under pressure and within time constraints.
  • Passion for technology and an eagerness to contribute to a team-oriented environment.
  • Demonstrated leadership on medium to large-scale projects impacting strategic priorities.
  • Strong understanding of AI concepts and latest developments (Gen AI, MCP, ATA, etc.).