Senior Principal Software Engineer - Spe

Eli Lilly Eli Lilly · Pharma · Hyderabad, India

Senior Principal Software Engineer to own architecture, design, and delivery of complex software systems, championing AI and agentic engineering practices. Responsibilities include system design, hands-on coding, building RAG pipelines and agentic systems, evaluating foundation models, and technical leadership.

What you'd actually do

  1. Own end-to-end system design for complex, distributed systems – from high-level architecture through to component design and data modelling.
  2. Architect agentic systems that reason, plan, and execute multi-step workflows using LLM orchestration frameworks (LangChain, LangGraph, CrewAI, or custom architectures).
  3. Build RAG pipelines, vector search systems, and knowledge graph integrations for enterprise use cases.
  4. Evaluate and deploy foundation models; establish guardrails, prompt management, and evaluation frameworks for production AI.
  5. Act as the go-to technical authority across multiple teams for system design and complex problem solving.

Skills

Required

  • Expert-level proficiency in at least one backend language (Node.js/TypeScript, Go, Python, Rust, or Java) with strong knowledge of a second.
  • Deep understanding of system design: distributed systems, CAP theorem, consistency models, sharding, caching, and load balancing.
  • Extensive AWS experience: compute (ECS, Lambda), storage (S3, RDS, DynamoDB, ElastiCache), networking (VPC, API Gateway, CloudFront), and IaC.
  • Strong frontend skills with React/Next.js, TypeScript, state management, and performance optimisation.
  • Proficiency in relational (PostgreSQL), NoSQL (DynamoDB, MongoDB), and vector databases (Pinecone, pgvector).
  • Hands-on experience with AI/ML applications – LLM integration, RAG systems, agentic workflows, and AI orchestration frameworks.

Nice to have

  • DevSecOps principles
  • GitHub Actions, CodeBuild
  • CloudWatch, Datadog, OpenTelemetry
  • LangChain, LangGraph, CrewAI
  • GitHub Copilot, Claude

What the JD emphasized

  • champion AI and agentic engineering practices
  • Architect agentic systems
  • Build RAG pipelines, vector search systems
  • Evaluate and deploy foundation models
  • responsible AI
  • healthcare regulatory compliance

Other signals

  • AI and agentic engineering practices
  • Architect agentic systems
  • RAG pipelines, vector search systems
  • Evaluate and deploy foundation models
  • responsible AI