Xgen

Visit Tool

xgen is an open-source LLM by Salesforce AI Research, offering 8k sequence length for long sequence modeling. It provides models for research and development in natural language processing.

Claim this tool

2Views

At a glance

Pricing

Open Source

Free tier

Yes

API

Yes

Skill level

Technical

About

What is xgen?

XGen is a family of open-source large language models (LLMs) developed by Salesforce AI Research, specifically designed for long sequence modeling tasks. The models, including XGen-7B-4K-Base and XGen-7B-8K-Base, support sequence lengths of 4K and 8K respectively. An instruction-finetuned version, XGen-7B-8k-Inst, is also available for research purposes. These models are released for research and development in natural language processing, particularly for academic studies. Users can install the necessary tokenization package (OpenAI Tiktoken) via pip and integrate the models using the HuggingFace Hub, making them accessible for auto-regressive sampling in Python environments.

Best used for

Ideal for AI researchers and developers who need to experiment with long sequence modeling, develop advanced NLP applications, and conduct academic studies on LLMs. Especially valuable for those requiring models with extended context windows for complex tasks.

Common actions

model long sequences

develop NLP applications

conduct AI research

experiment with LLMs

face swapping"AI Agents"github copilotdeepfakeworkflowsautomated workflowlow-code/no-codecollaborationopen-source

Capabilities

Key features

8K sequence length
4K sequence length
Instruction-finetuning
HuggingFace Hub integration
Tiktoken tokenization

Target Audience

professordeveloperresearcher

Integrations

huggingface

Pricing & Plans

Open Source

Free

FAQs

What are the primary sequence lengths supported by XGen models?

XGen offers models with different sequence lengths. Specifically, XGen-7B-4K-Base supports a 4K sequence length, while XGen-7B-8K-Base supports an 8K sequence length, catering to varying context requirements.

Is XGen suitable for commercial applications?

The XGen models are primarily released for research purposes, particularly in support of an academic paper. Users are strongly advised to evaluate potential concerns related to accuracy, safety, and fairness before deploying for any downstream purposes, especially high-risk scenarios.

How can I access and use the XGen models?

The XGen models are available on the HuggingFace Hub. You can integrate them into your projects using the `transformers` library in Python, after installing the `tiktoken` package for tokenization.

Trending

Subcategories trending in Coding & Development

Code Assistants DevOps & Infrastructure No-Code / Low-Code Testing & QA Backend & APIs Prompt Engineering

Trending

Also listed in

This tool also appears in

Research & Education › Academic Research AI Agents & Automation › AI Frameworks & Infra

Explore

Browse AI tools by category

Content & Design Productivity & Business Coding & Development AI Agents & Automation Research & Education Wellness & Lifestyle Career Development Marketing & Growth Data & Analytics Customer Support & CX Finance E-commerce