Shypd.aiThe largest open index of AI toolsLong-Context is an open-source research tool that provides code and tooling for LLM context expansion. It includes evaluation scripts and benchmark tasks to assess a model's information retrieval capabilities.
Trending
About
Long-Context is an open-source repository from Abacus.AI designed to provide code and tooling for Large Language Model (LLM) context expansion. It offers a comprehensive suite of evaluation scripts and benchmark tasks specifically tailored to assess a model’s information retrieval capabilities within expanded contexts. The repository details various experimental results, including different positional encoding schemes like linear scaling and fine-tuning approaches, and provides instructions for reproducing and building upon these findings. It also shares weights for best-performing models, such as the scale 16 model, which is expected to perform well up to 16k context lengths. The project includes novel evaluation datasets like an extended LMSys dataset and WikiQA (Free Form QA and Altered Numeric QA) to rigorously test models across varying context lengths and answer locations, addressing potential issues like models answering from pre-trained knowledge rather than provided context.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
Also listed in
