Aktilot – AI Document Chat using RAG with Durable Temporal Workflows

Aktilot is an open-source, self-hosted AI document chat platform that demonstrates how Temporal can orchestrate reliable AI workflows.

The project uses Temporal to coordinate long-running document ingestion and chat pipelines instead of traditional synchronous request flows.

Current workflows include:

• DocumentWorkflow – chunks documents, generates embeddings, and indexes them into ChromaDB with durable retries and checkpointing.
• ChatWorkflow – performs hybrid BM25 + vector retrieval, reranking, LLM response generation, and conversation persistence as a durable workflow.
• BenchmarkWorkflow (planned) – evaluates retrieval quality and latency across different retrieval strategies.

The project demonstrates several Temporal patterns including:

• Durable execution
• Activity retries
• Long-running workflows
• AI pipeline orchestration
• Failure recovery without restarting completed steps
• Workflow observability

Aktilot is intended as both a production-ready self-hosted document AI platform and a reference implementation for engineers building AI systems with Temporal.

Feedback and contributions are welcome.

Author#

Vikas Pandey Principal Software Engineer | Open Source Contributor

GitHub: https://github.com/vikas0686 Website: https://vikaspandey.dev/ LinkedIn: https://www.linkedin.com/in/vikaspandey0686/