The orchestrator for AI applications
Build and run the most capable AI
Orchestrate your workflows, AI apps, and agents across any models, tools, systems, and length of time. Reliably complete complex work at any scale with Durable Execution.
Install the Temporal CLI and start the dev server in the background.
Set up the hello-world-litellm-python example from github.com/temporalio/ai-cookbook.
Create a .env for my LLM API key and pause for me to fill it in.
Install Python deps with uv, then run the worker in the background and execute the Workflow.
Open localhost:8233 when done.
# Prerequisites: Python 3.10+, uv, LLM provider key
AI Requires Durable Execution To Run
Every AI team is rebuilding the same abstractions. Long running sessions, state persistence, storage & cost optimization, massive scale, visibility into execution, and resilience to external failures. Temporal handles these for you for one durable runtime.
Powerful Abstractions To Ship Complex AI
Temporal allows developers to stop building runtime infrastructure and focus on AI business logic with flexibility, reliability, and massive scale built in.
We were able to get Retool Agents out in a matter of months and support a really robust experience out the gate with a really small team…It just wouldn’t have been possible without Temporal.
Lizzie Siegrist
Product Manager, Retool
We're able to work with the agent again and again. It was really painful to do this without a workflow approach. I think for us, a workflow approach with Temporal was good because in the end, all LLM use cases are workflows.
Romain Niveau
Senior Engineering Manager, Gorgias
AI Built On Durable Execution
Write durable workflows as code
Workflows-as-code
Write your AI applications using Temporal's SDKs, which take care of any failure scenario out-of-the-box.
Orchestration
Set up workflows to orchestrate interactions across any number of distributed data stores and tools.
Durable Execution
Guarantee all executions of all processes run to completion successfully in spite of failures.
Code for the happy path only
State handling
Workflows automatically hold state over long periods of time (even years), so you don’t need state machines.
Human-in-the-loop
Easily facilitate human-in-the-loop interactions like validating LLM results or approving agent decisions.
Self-healing
Get automatic retries out-of-the-box, and maintain the ability to retry until a probabilistic LLM returns valid data.
Know what's happening and why
High scale
Code parallel tasks and concurrent workflows at incredible scale.
Easily testable
Step-debug your AI application’s execution, and test thousands of outcomes using your preferred tools.
Strong observability
Inspect and troubleshoot an AI application’s performance, inputs, and outputs from a detailed UI.
Build On An Open Foundation Of AI Frameworks
Build and monitor with popular agent frameworks and tools. Have an AI tool you're interested in integrating with Temporal? Reach out to our team.
AI Cookbook: Hands-on recipes
Step-by-step solutions that show you how to build reliable, production-ready AI systems with Temporal.
Hello World
Simple example demonstrating how to call an LLM from Temporal using the OpenAI Python API library.
Basic Agentic Loop with Tool Calling
A basic agentic loop that invokes a dynamic set of tools.
Tool calling agent
Build a simple, non-looping agent that gives agency to the LLM to choose tools, and then invokes chosen tools.
Success story: Replit
Replit migrated their popular coding agent to Temporal to improve reliability and free up time for the Platform team. Temporal orchestrates the Replit Agent control plane layer at massive scale.
Temporal gives us a lot more confidence to build the product and know that it's not going to have lots of edge cases that lead to bad user experiences.
Connor Brewster
Lead Engineer, Replit
Temporal use cases in AI
Improve the reliability and development speed of critical AI applications.
Agents
Orchestrate reliable, long-running, and human-in-the-loop agents. Protect against hallucinations and rate limiting. Scale to millions of agents.
MCP
Write Durable Tools with Temporal to improve reliability and context awareness. Make reliable long-running calls.
Inference & RAG
Orchestrate reliable interactions across LLMs and gather data across multiple datastores. Easily schedule document ingestion.
Context engineering
Orchestrate reliable data engineering pipelines to ensure your agents have the necessary information to create context for making the right decisions.
Learn more about Temporal for AI
Get started today