haixuanTao
88643b955d
Adding `recv_async` dora method to retrieve data in python async
10 months ago
haixuanTao
a9aa556b9c
Adding metrics for node api
10 months ago
Somay (DIIN)
e5f8b35be4
All flags integrated mentioned in #878 except N & E
10 months ago
7SOMAY
d12b232199
Fixed node-hub linting issues
10 months ago
Haixuan Xavier Tao
066d47007c
Adding run comand within python API ( #875 )
This PR makes it possible to run dataflow from python using:
```python
from dora import run
# Make sure to build it first with the CLI.
# Build step is on the todo list.
run("qwen2.5.yaml", uv=True)
```
Making it easier to run dataflow based on our needs
10 months ago
Mati-ur-rehman-017
ffc251f135
Applied pyupgrade style
10 months ago
haixuantao
4d454e3db9
Adding run comand within python API
10 months ago
Philipp Oppermann
10b2435381
Replace deprected pyo3 `to_object` call with `into_pyobject`
10 months ago
Mati-ur-rehman-017
5e25cb52fc
Only D417 error remain
10 months ago
Mati-ur-rehman-017
3332c0a1ce
Fixed D100 issues
10 months ago
Mati-ur-rehman-017
259451ff10
.tomlFixes
10 months ago
Mati-ur-rehman-017
dd4de848ac
fixed #828
10 months ago
7SOMAY
20781fb4e2
#807 Fixed
10 months ago
haixuanTao
8b19716b3e
Fix pip installation of development dora node api python
10 months ago
haixuanTao
095156941f
Migrate the CI to --uv
11 months ago
Philipp Oppermann
ee15517dce
Make `ShmemChannel` `Sync` as required by pyo3 0.23
10 months ago
haixuantao
d3a48d7b17
Bump arrow version to latest version
10 months ago
yjhmelody
ca614753a1
chore: use workspace edition
1 year ago
sunxunle
0fa5863b4f
chore: fix some typos in comment ( #759 )
Signed-off-by: sunxunle <sunxunle@ampere.tech>
1 year ago
haixuantao
9e3142d086
Fix license and readme and requires-python
1 year ago
haixuantao
d3fdbf5e0a
Minor python esthetics
1 year ago
haixuantao
2e4c9c16b9
Fix version setting and add setting up architecture in CI/CD
1 year ago
haixuanTao
6614504a07
Adding better documentation
1 year ago
haixuanTao
b0e6a160fe
Small renaming of buffer to ipc buffer to make ipc buffer more explicit
1 year ago
haixuanTao
c4b1e32124
Improve naming convention
1 year ago
haixuanTao
0d007609f5
Adding pyarrow cuda helper function to support zero copy GPU
1 year ago
haixuanTao
dd10bbf85c
Bump `pyo3` version to `0.22`
1 year ago
Philipp Oppermann
8e8034d103
Set `repository` metadata for all our crates
1 year ago
Philipp Oppermann
6a3dcecf33
Refactor: Move message definitions to `dora-message` crate
First step towards versioning the message definitions indepedently.
1 year ago
Philipp Oppermann
9cec8df1cc
Delay dropping of `DoraNode` in Python until all event data is freed
When dropping the `DoraNode`, it waits for the remaining drop tokens. This only works if all the dora events were already dropped before. With the Python GC, this is not guaranteed as some events might still be live on the heap (the user might even use them later). In such cases, we waited until we ran into a timeout, which resulted in very long exit times (see https://github.com/dora-rs/dora/issues/598 ).
This commit fixes this issue by adding a reference-counted copy of the `DoraNode` and `EventStream` to every event given to Python. This way, we can ensure that the underlying `DoraNode` is only dropped after the last event reference has been freed.
1 year ago
haixuanTao
2b1299deba
Derive Node special method
1 year ago
EricLBuehler
233192f41e
Update deps
1 year ago
Eric Buehler
61d12274fb
Merge pull request #1 from haixuanTao/improve-eric-pyo3-derive-special-method
Add derivation fo python ros2 bridge
1 year ago
EricLBuehler
65b71810b6
Merge remote-tracking branch 'upstream/main' into proc_macro_dir
1 year ago
haixuanTao
42dcb07237
Add derivation fo rpython ros2 bridge
1 year ago
haixuanTao
c4263e6c8f
Remove bound from definition of .to_py_dict
1 year ago
haixuanTao
ae9aea24e0
update stubs definition
1 year ago
haixuanTao
b2eace277d
Transform custom PyEvent into standard python dictionary for easier debuggability.
Currently having a custom PyEvent make debugging very hard as fields are hidden within the class PyEvent that is defined within Rust Code.
Python user are getting really confused about this obscure class.
This PR transforms the class into a standard python dictionary.
1 year ago
EricLBuehler
8ff6d39a84
Use the new crate
1 year ago
Haixuan Xavier Tao
f34cbe2ffc
Merge pull request #517 from dora-rs/detached-python-process
Run dynamic node
1 year ago
haixuanTao
7d3a5de1c5
Make rust flexible logic and make sure to always use env variables DORA_NODE_CONFIG if it exists.
This remove the complexity of having to rename the node id when used within a yaml configuration.
1 year ago
EricLBuehler
19e26358b6
Rename and use multiple_pymethods trait
1 year ago
EricLBuehler
c40204d4d6
Format
1 year ago
EricLBuehler
5995ac28de
PoC in Node
1 year ago
Haixuan Xavier Tao
d7be6a49e3
Merge pull request #472 from Michael-J-Ward/pyo3-bounds
Update Pyo3 bounds
1 year ago
haixuanTao
3ad402ce45
Add dynamic node event loop and dynamic node connection
1 year ago
Michael-J-Ward
bf088fc1eb
lint: fix clippy lint
1 year ago
Michael-J-Ward
25884b658a
update pyo3 to new bounds api
1 year ago
EricLBuehler
6c62246e53
Fix typos
1 year ago
haixuantao
0f530906aa
Add dataflow_id getter in python
1 year ago