Shypd.aiThe largest open index of AI toolsUQLM is an Open Source & Models tool that provides a Python package for uncertainty quantification in language models. It helps detect hallucinations in large language models using state-of-the-art techniques.
Trending
About
UQLM (Uncertainty Quantification for Language Models) is an open-source Python package designed to detect hallucinations in large language models (LLMs). It offers a comprehensive suite of response-level scorers for quantifying the uncertainty of LLM outputs, with higher scores indicating a lower likelihood of errors. The package categorizes scorers into Black-Box (consistency-based, universal compatibility), White-Box (token-probability-based, faster/cheaper but requires internal access), LLM-as-a-Judge (customizable via prompt engineering), Ensemble (combines multiple scorers for robust estimates), and Long-Text (claim-level scoring for factual precision). UQLM supports various LangChain Chat Models and provides extensive documentation and example notebooks for different uncertainty quantification approaches.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
