Senior AI Software Engineer

Allstate Allstate · Insurance · United States · Remote

This role focuses on backend development with a strong emphasis on integrating and deploying Generative AI models, specifically fine-tuning and optimizing LLMs, and building RAG pipelines. It involves working with technologies like OpenAI, Hugging Face, LangChain, and vector databases within an enterprise context.

What you'd actually do

  1. Integrate and deploy Generative AI models (e.g., OpenAI, Hugging Face, LangChain) into production environments.
  2. Fine-tune and optimize LLMs for specific use cases.
  3. Build secure, scalable, and high-performance microservices.
  4. Monitor and improve system performance, reliability, and scalability.
  5. Implement CI/CD pipelines, containerization (Docker), and orchestration (Kubernetes).

Skills

Required

  • 3+ years of backend development experience using Java Spring Boot or Python.
  • Strong understanding of RESTful APIs, microservices architecture, and asynchronous processing.
  • Experience working with Generative AI APIs and/or open-source models.
  • Experience with LangChain, LLM orchestration, or RAG (Retrieval-Augmented Generation) pipelines.
  • Familiarity with prompt engineering, embedding models, or vector databases.

Nice to have

  • Exposure to multi-modal AI systems and agentic AI frameworks.
  • Exposure to MLOps and model deployment workflows.
  • Experience with Docker, Kubernetes, and CI/CD pipelines.
  • Experience with cloud platforms (Azure, AWS or GCP).
  • Knowledge of frontend frameworks like React or Angular.

What the JD emphasized

  • Generative AI
  • fine-tune and optimize LLMs
  • LangChain, LLM orchestration, or RAG (Retrieval-Augmented Generation) pipelines
  • prompt engineering
  • vector databases

Other signals

  • integrating Generative AI models into production environments
  • fine-tune and optimize LLMs
  • LangChain, LLM orchestration, or RAG pipelines
  • prompt engineering, embedding models, or vector databases