Gagan Bansal
240e15d38f
Add left chat panel to the viz
2 years ago
Gagan Bansal
021c68a343
Improve the visualization
2 years ago
Gagan Bansal
02e01d70d6
Add d3 based visualizer
2 years ago
Gagan Bansal
5e94ba1116
Remove print statement
2 years ago
Gagan Bansal
63bfe837ec
Add caching
2 years ago
Gagan Bansal
1b01377339
Improve progress report and printing format
2 years ago
Gagan Bansal
8585edb71f
Add ability to output profile to a file
2 years ago
Gagan Bansal
2ae01982fe
Improve error handling
2 years ago
Gagan Bansal
b8916c3852
Update readme
2 years ago
Gagan Bansal
eac54231db
Improve and add CLI
2 years ago
Gagan Bansal
6f70e338b5
Improve readme and printing
2 years ago
Gagan Bansal
24d0780e26
Add initial profiler
2 years ago
Adam Fourney
3824685272
Align Orchestrator settings to match TwoAgents
2 years ago
afourney
b068528bc9
Merge pull request #2500 from microsoft/ct_webarena-dockerfix
Fix Dockerfile + Add response_format to Template + Fix requirement.txt
2 years ago
afourney
5b47f0196b
Merge pull request #2493 from microsoft/webarena_split
Webarena add Test Validation split
2 years ago
gagb
363ad107fe
removed unnecessary platform specific dependencies
2 years ago
gagb
998e918e02
Update orch template to use response format var
2 years ago
Adam Fourney
b2463077ab
Added comments to explain the test/validation split logic.
2 years ago
Eduardo Salinas
035659f944
rename args
2 years ago
Eduardo Salinas
6520505239
code fmt
2 years ago
Eduardo Salinas
bd2b10ea88
Update Dockerfile
2 years ago
Eduardo Salinas
bb30c7babe
Merge branch 'ct_webarena' into add-firefox
2 years ago
Eduardo Salinas
32e59b1e66
add firefox to scenario.py and other tweaks
2 years ago
Adam Fourney
34fa8b0ade
Split WebArena into test and validation sets, based on template identifier.
2 years ago
Adam Fourney
2da2b586d1
Added punkt dependency to Dockerfile.
2 years ago
afourney
18eba94d14
Merge pull request #2468 from microsoft/gagb-ct_webarena
Add Orchestrator to WebArena
2 years ago
Gagan Bansal
f217348200
Remove unused file
2 years ago
Gagan Bansal
55b9429be3
Remove unused file
2 years ago
Gagan Bansal
e15ba0ace3
Add initial autogenbench template for Orchestrator
2 years ago
Gagan Bansal
567ccc1025
Run pre-commit on all files
2 years ago
afourney
9ad2b7bfcc
Merge pull request #2399 from microsoft/gagb-ct_webarena
Improve documentation of MMWebsurfer
2 years ago
Eduardo Salinas
9f324e9011
rename event
2 years ago
Eduardo Salinas
19df31d540
fixup
2 years ago
Eduardo Salinas
86ea88d6e6
fixup
2 years ago
Eduardo Salinas
f5f96cbb63
add to scenario.py
2 years ago
Eduardo Salinas
628e47c0bc
add logging to multimodal_web_surfer
2 years ago
Gagan Bansal
0646a6257e
Run precommit
2 years ago
gagb
4a083b81e4
Ignore results dir
2 years ago
Adam Fourney
0c7dffaf4d
Updated Dockerfile for webarena
2 years ago
Adam Fourney
d579a7d51c
Added tabulation for WebArena
2 years ago
Adam Fourney
891fc9b62b
Addressed some issues with scoring.
2 years ago
Adam Fourney
6804bc2ff5
Added eval code to webarena
2 years ago
Adam Fourney
1a08fd7b24
Added prompting to indicate to agents that they are on Postmill.
2 years ago
Adam Fourney
e7944ae75d
run_cmd.py
2 years ago
Adam Fourney
d9dd280e7b
Added the ability to scroll controls, and fixed a bug with option names.
2 years ago
Adam Fourney
285e47c511
Added sample ENV file, and cleaned up scenario.py
2 years ago
afourney
061a857b3d
AutoGenBench: Handle Ctrl-C more gracefully. ( #2174 )
* Prints the version of AutoGenBench from the command line, closing i1458
* Added autogenbench version to timestamp.txt
* Attempting to fix formatting.
* Add a gitignore for autogenbench
* Generalize to read all template dirs from Templates
* AutoGenBench logs telemetry when available.
* Remove spaces if present from template names.
* Bump version.
* Fixed formatting.
* Allow native warning to be skipped. Mount autogen repo in Docker if it can be found (experimental).
* Native execution now occurs in a venv.
* Bump version.
* Fixed a prompt escaping bug evident in GAIA task '6f37996b-2ac7-44b0-8e68-6d28256631b4'
* Updated all scenarios to use template discovery.
* Update with main version of runtime_logging.
* Better handling of Ctrl-C and cleanup of unused containers.
* Even stronger hinting that containers should be removed.
---------
Co-authored-by: gagb <gagb@users.noreply.github.com>
2 years ago
Adam Fourney
a3d26e918f
Merge branch 'autogenbench' into ct_webarena
2 years ago
Adam Fourney
618533a0ac
Added debug dir for websurfer output.
2 years ago
Adam Fourney
92282ce186
Better handling of Ctrl-C and cleanup of unused containers.
2 years ago