dora-rs
/
dora
Not watched
1
0
Fork 0
Code
Releases 124 Wiki evaluate Activity
Issues 0 Pull Requests 0 Datasets Model Cloudbrain HPC
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
530 Commits
57 Branches
16 MB
7715 Download
Tree: 992b8251c2
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '992b8251c2'
${ noResults }
dora/examples/python-dataflow/run.sh

run.sh 305 B
Raw Normal View History

DRAFT: Fixing Python linking error This commit is an initial draft at fixing #147. The error is due to the fact that pyo3 has linked the libpython from the compilation and not trying to use libpython that is available in `LD_LIBRARY_PATH`. The current only solution to disable the linking is to use the `extension-module` flag. This requires to make the python `runtime-node` packaged in a python library. The python `runtime-node` should also be fully compatible with the other operators in case we want hybrid runtime. The issue that i'm facing is that. Due to the packaging, I have to deal with the `GIL` that is present from the start of `dora-runtime` node. This however makes the process single threaded wich is impossible. So, I have to disable it, but when I do, I have a race condition: ```bash Exception ignored in: <module 'threading' from '/usr/lib/python3.8/threading.py'> Traceback (most recent call last): File "/usr/lib/python3.8/threading.py", line 1373, in _shutdown assert tlock.locked() AssertionError: ``` The issue is the same as https://github.com/PyO3/pyo3/issues/1274 To fix this issue, I'm going to look again at the different step to make this work. But this is my current investigation.
3 years ago
​
Add python installer and run script
3 years ago
​
​
​
​
​
​
Runtime tracing (#95) * add opentelemetry feature to python op * modify `python-dataflow` to test opentelemetry * change `timer` topic to `tick` * adding tracing to `shared_libraries` * example install refactoring * Rename `input` to `dora_input` for python ex
3 years ago
Run python exemple inside of python env
3 years ago
​
DRAFT: Fixing Python linking error This commit is an initial draft at fixing #147. The error is due to the fact that pyo3 has linked the libpython from the compilation and not trying to use libpython that is available in `LD_LIBRARY_PATH`. The current only solution to disable the linking is to use the `extension-module` flag. This requires to make the python `runtime-node` packaged in a python library. The python `runtime-node` should also be fully compatible with the other operators in case we want hybrid runtime. The issue that i'm facing is that. Due to the packaging, I have to deal with the `GIL` that is present from the start of `dora-runtime` node. This however makes the process single threaded wich is impossible. So, I have to disable it, but when I do, I have a race condition: ```bash Exception ignored in: <module 'threading' from '/usr/lib/python3.8/threading.py'> Traceback (most recent call last): File "/usr/lib/python3.8/threading.py", line 1373, in _shutdown assert tlock.locked() AssertionError: ``` The issue is the same as https://github.com/PyO3/pyo3/issues/1274 To fix this issue, I'm going to look again at the different step to make this work. But this is my current investigation.
3 years ago
 12345678910111213 
  1. #python3 -m venv .env

  2. # . $(pwd)/.env/bin/activate

  3. # Dev dependencies

  4. pip install maturin

  5. cd ../../apis/python/node

  6. maturin develop

  7. cd ../../../examples/python-dataflow

  8. 

  9. # Dependencies

  10. pip install --upgrade pip

  11. pip install -r requirements.txt

  12. 

  13. cargo run -p dora-coordinator -- --run-dataflow dataflow.yml

DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed datafl