dora-rs
/
dora
Not watched
1
0
Fork 0
Code
Releases 124 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
3867 Commits
57 Branches
16 MB
7567 Download
 
 
 
 
 
 
Branch: main
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'main'
${ noResults }
dora/benches/llms
Ignavar d5c38b958d Ease of use changes to not manually have to install libraries like librosa and opencv when running benches in virtual env 9 months ago
..
.gitignore Rename benchs -> benches to be conformant with cargo 10 months ago
README.md Ease of use changes to not manually have to install libraries like librosa and opencv when running benches in virtual env 9 months ago
llama_cpp_python.yaml Ease of use changes to not manually have to install libraries like librosa and opencv when running benches in virtual env 9 months ago
mistralrs.yaml Ease of use changes to not manually have to install libraries like librosa and opencv when running benches in virtual env 9 months ago
phi4.yaml Ease of use changes to not manually have to install libraries like librosa and opencv when running benches in virtual env 9 months ago
qwen2.5.yaml Ease of use changes to not manually have to install libraries like librosa and opencv when running benches in virtual env 9 months ago
transformers.yaml Ease of use changes to not manually have to install libraries like librosa and opencv when running benches in virtual env 9 months ago

README.md

Benchmark LLM Speed

If you do not have a python virtual environment setup run

'''bash
uv venv --seed -p 3.11
'''

Then Use the following command to run the benchmark:

dora build transformers.yaml --uv
dora run transformers.yaml --uv

You should see a benchmark details.

Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed datafl

Rust Python TOML Markdown C other