AI Software Engineer

Allstate Allstate · Insurance · IL · Remote

Seeking a Backend Developer with hands-on experience in Generative AI technologies to join an engineering team. The role involves building scalable backend systems and integrating AI capabilities into enterprise applications, including fine-tuning and optimizing LLMs, and deploying them into production environments.

What you'd actually do

  1. Integrate and deploy Generative AI models (e.g., OpenAI, Hugging Face, LangChain) into production environments.
  2. Fine-tune and optimize LLMs for specific use cases.
  3. Build secure, scalable and high-performance microservices.
  4. Design, develop, and maintain backend services and APIs using modern frameworks (e.g., Java Spring Boot, Node.js, or Python FastAPI).
  5. Monitor and improve system performance, reliability, and scalability.

Skills

Required

  • 3+ years of backend development experience using Java Spring Boot or Python.
  • Strong understanding of RESTful APIs, microservices architecture, and asynchronous processing.
  • Experience working with Generative AI APIs and/or open-source models.
  • Experience with LangChain, LLM orchestration, or RAG (Retrieval-Augmented Generation) pipelines.
  • Familiarity with prompt engineering, embedding models, or vector databases.

Nice to have

  • Exposure to multi-modal AI systems and agentic AI frameworks.
  • Exposure to MLOps and model deployment workflows.
  • Experience with Docker, Kubernetes, and CI/CD pipelines.
  • Experience with cloud platforms (Azure, AWS or GCP).
  • Knowledge of frontend frameworks like React or Angular.

What the JD emphasized

  • Generative AI
  • LLM orchestration
  • RAG (Retrieval-Augmented Generation)
  • prompt engineering

Other signals

  • Generative AI
  • LLMs
  • RAG
  • LangChain