dora-rs
/
dora
Not watched
1
0
Fork 0
Code
Releases 124 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
Tree: 98cbff4108
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '98cbff4108'
${ noResults }
dora/benches/vlm/magma.yaml

21 lines
451 B
Raw Blame History 

  1. nodes:

  2.   - id: benchmark_script

  3.     path: ../mllm/benchmark_script.py

  4.     inputs:

  5.       text: llm/text

  6.     outputs:

  7.       - text

  8.       - image

  9.     env:

  10.       TEXT: "Please only generate the following output: This is a cat"

  11.       TEXT_TRUTH: "This is a cat"

  12. 

  13.   - id: llm

  14.     build: pip install -e ../../node-hub/dora-magma

  15.     path: dora-magma

  16.     inputs:

  17.       text: benchmark_script/text

  18.       image: benchmark_script/image

  19.     outputs:

  20.       - text