Shypd.aiThe largest open index of AI toolscontinuous-eval is an open-source package for data-driven evaluation of LLM-powered applications. It offers modularized evaluation with tailored metrics for various pipeline modules.
Explore
About
continuous-eval is an open-source package designed for the data-driven evaluation of applications powered by Large Language Models (LLMs). It provides a modular approach to evaluation, allowing users to apply tailored metrics to each specific module within their LLM pipeline. The tool includes a comprehensive library of metrics to facilitate thorough assessment. It supports the evaluation of diverse LLM use cases, including Retrieval-Augmented Generation (RAG), code generation, and the utilization of agent tools.