wangtao
/
autogen
Not watched
1
0
Fork 0
Code
Releases 127 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
3011 Commits
199 Branches
282 MB
15 Download
 
 
 
 
 
 
Tree: cc5f96906e
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'cc5f96906e'
${ noResults }
autogen/python/packages/agbench/benchmarks
Jack Gerrits 538f39497b
Replace create_completion_client_from_env with component config (#4928) 		1 year ago
..
AssistantBench Replace create_completion_client_from_env with component config (#4928) 1 year ago
GAIA Replace create_completion_client_from_env with component config (#4928) 1 year ago
HumanEval Replace create_completion_client_from_env with component config (#4928) 1 year ago
WebArena Replace create_completion_client_from_env with component config (#4928) 1 year ago
.gitignore Adding Benchmarks to agbench (#3803) 1 year ago
README.md Adding Benchmarks to agbench (#3803) 1 year ago
process_logs.py Adding Benchmarks to agbench (#3803) 1 year ago

README.md

Benchmarking Agents

This directory provides ability to benchmarks agents (e.g., built using Autogen) using AgBench. Use the instructions below to prepare your environment for benchmarking. Once done, proceed to relevant benchmarks directory (e.g., benchmarks/GAIA) for further scenario-specific instructions.

Setup on WSL

  1. Install Docker Desktop. After installation, restart is needed, then open Docker Desktop, in Settings, Ressources, WSL Integration, Enable integration with additional distros – Ubuntu

  2. Clone autogen and export AUTOGEN_REPO_BASE. This environment variable enables the Docker containers to use the correct version agents.

    git clone git@github.com:microsoft/autogen.git
export AUTOGEN_REPO_BASE=<path_to_autogen>

  3. Install agbench. AgBench is currently a tool in the Autogen repo.

    cd autogen/python/packages/agbench
pip install -e .
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

This is a mirror of AutoGen from GitHub. AutoGen is a framework that enables the development of LLM applications using multiple agents that can converse with each other to solve tasks.

Python SVG Jupyter Notebook C# TSX other