Shypd.aiThe largest open index of AI toolsAgentLab is an open-source framework for developing, testing, and benchmarking web agents on diverse tasks. It is designed for scalability and reproducibility, offering unified LLM APIs and parallel experiment execution.
Trending
About
AgentLab is an open-source framework developed by ServiceNow for the creation, evaluation, and benchmarking of web agents. It provides a scalable and reproducible environment for researchers and developers to work with various benchmarks supported by BrowserGym. Key features include easy large-scale parallel agent experiments using Ray, a unified LLM API for OpenRouter, OpenAI, Azure, and self-hosted models, and support for running benchmarks like WebArena and WorkArena. The framework also offers various reproducibility features, a unified leaderboard, and tools like AgentXray for visualizing experiment results through a Gradio interface. It is designed to accelerate web agent research by providing robust building blocks and evaluation capabilities.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
