Shypd.aiThe largest open index of AI toolsllm_benchmark is an Open Source tool for evaluating large language models (LLMs). It uses a private, rolling question bank to track the long-term evolution of models, focusing on logic, math, programming, and human intuition.
Trending
About
llm_benchmark is an open-source project dedicated to the long-term evaluation of large language models (LLMs). It employs a private, continuously updated question bank to assess models' capabilities in areas such as logic, mathematics, programming, and human intuition. The benchmark aims to observe the evolutionary trends of various LLMs over time, rather than providing a comprehensive or authoritative ranking. With a modest question bank of around 28 questions and 270 test cases, which are updated monthly and kept private, the project emphasizes a unique evaluation methodology. Each question is scored out of 10, based on multiple scoring points, with strict requirements for correct derivation processes and adherence to output formats. The project shares its evaluation approach and personal insights, encouraging users to conduct their own assessments based on specific needs.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
