It Analyst Applications (matillion Etl/elt Developer – Snowflake Data Engineering)

Caterpillar · Industrial · Bangalore, Karnataka

Seeking a Matillion ETL/ELT Developer with Snowflake data engineering experience to build, optimize, and support scalable data pipelines. This role enables reliable data delivery for analytics, AI experiences, and business consumption, focusing on data warehouse operations and governed self-service analytics within the Cat Financial Insurance Services BI, Data, and AI team.

What you'd actually do

  1. Design, develop, and maintain Matillion orchestration and transformation jobs to ingest, cleanse, and deliver data from diverse source systems (e.g., insurance policy administration, claims, Salesforce, warranty/quality feeds) into Snowflake. Implement incremental and full-load patterns appropriate to each data domain.
  2. Leverage strong SQL and Snowflake engineering practices including warehouse sizing and auto-suspend configuration, clustering and partitioning strategies where applicable, query performance tuning, and cost-aware execution to ensure pipelines are efficient, scalable, and financially responsible.
  3. Collaborate with data modelers and architects to build and maintain governed, business-friendly semantic layers on top of the Snowflake data warehouse. These certified data sources serve as the single source of truth for downstream consumption — including Power BI dashboards, Snowflake Semantic Views, Polaris AI (Snowflake Intelligence), and Streamlit applications. The role requires understanding how curated, well-defined data models enable natural language querying, AI agent consumption, and self-service analytics at scale.
  4. Implement robust data validation checks, error handling, and logging within ETL workflows to ensure data accuracy, completeness, and traceability. Support data governance standards including consistent naming conventions, field-level definitions, and alignment with enterprise compliance requirements.
  5. Promote repeatable, reliable deployment practices including version control (Git), environment management (dev/test/prod), job scheduling (ActiveBatch), and on-call support as needed. Troubleshoot pipeline failures, rerun/restart job schedules, and manage support tickets in a timely manner.

Skills

Required

  • Matillion ETL/ELT
  • Snowflake
  • SQL
  • Data Engineering
  • ETL/ELT development
  • Cloud data integration
  • Version control (Git)
  • Environment management
  • CI/CD concepts for data pipelines
  • Communication and collaboration skills

Nice to have

  • Experience building or maintaining semantic/business-value layers (semantic views, curated data marts, or governed reporting layers)
  • Exposure to Snowflake Cortex AI, Snowflake Intelligence, or AI-ready data

What the JD emphasized

  • 5+ years of experience in data engineering, ETL/ELT development, or cloud data integration
  • 2+ years hands-on experience with Matillion (ETL or Data Productivity Cloud)
  • 2+ years hands-on experience with Snowflake (SQL scripting, stored procedures, streams, tasks, views, performance tuning)