Shypd.aiThe largest open index of AI toolsLanarky is an open-source web framework for building LLM microservices. It is built on FastAPI and offers built-in streaming support over HTTP and WebSockets for real-time AI applications.
Trending
About
Lanarky is a Python (3.9+) web framework designed specifically for developers building microservices with Large Language Models (LLMs). Built on top of FastAPI, it provides a fast and modern foundation, incorporating all the features developers appreciate from FastAPI. A key differentiator is its LLM-first approach, offering flexibility without vendor lock-in to specific LLM tooling frameworks or cloud providers. Lanarky includes built-in streaming support for both HTTP and WebSockets, which is crucial for real-time LLM applications like chatbots. The project is open-source and free to use, though it is currently in maintenance mode, meaning active feature development has ceased, but critical bugs and security issues will be addressed.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
