188 Commits (split-cli)

Author SHA1 Message Date
  haixuanTao bc68de3bbd Change `MetadataParameters` into a `BTreeMap` to allow user defined metadata as well as enable more flexibility in managing metadata 1 year ago
  Haixuan Xavier Tao 16ef29ab80
Merge pull request #601 from dora-rs/delay-node-drop 1 year ago
  Philipp Oppermann 9cec8df1cc
Delay dropping of `DoraNode` in Python until all event data is freed 1 year ago
  chang xu bccb1ae27d
Add domain unix socket supports (#594) 1 year ago
  haixuanTao 329844358a Reduce timeout time and increase grace duration so that node exit gracefully within one second 1 year ago
  haixuanTao 5b7a614c14 Reduce drop token time from 30s to 1s as most of the time the drop token is having a race condition with the GIL in python. 1 year ago
  haixuanTao 7d3a5de1c5 Make rust flexible logic and make sure to always use env variables DORA_NODE_CONFIG if it exists. 1 year ago
  haixuanTao 3f2f274036 Remove unnecessary condition on dynamic node 1 year ago
  haixuanTao a0a95b730c Rename dynamic node listener -> local listener 1 year ago
  haixuanTao 3ad402ce45 Add dynamic node event loop and dynamic node connection 1 year ago
  haixuanTao b5de93e5f5 Pretty Print Rust object when called from Python print 1 year ago
  Michael-J-Ward dfe298eb1e lint: fix clippy lints 1 year ago
  Philipp Oppermann 14bb4fbfb7
Merge pull request #429 from dora-rs/out_dir 1 year ago
  haixuanTao f4fbd6562f Sending data recordings into an `out/<DATAFLOW_ID>/input,arrow` folder to make it easier to manage multiple data coming from multiple runs of a dataflow 1 year ago
  haixuanTao 629a218ddb `copy_array_into_sample` do not need to return a result 2 years ago
  haixuanTao 0568656ef0 Remove unused dependencies for faster compile time 2 years ago
  haixuanTao 8648ce92ce Format document 2 years ago
  haixuanTao 1ad35fa817 Add `recv_async_timeout` 2 years ago
  haixuanTao 0cd5281325 Use duration instead of f32 secs 2 years ago
  haixuanTao b1b69693b7 Adding a timeout method to not block indefinetely 2 years ago
  haixuanTao e45975f65a Use cleaner `__from_elem` `avec` constructor 2 years ago
  haixuanTao fe065eec6f replace const cache line with 128 to match arrow 2 years ago
  haixuanTao 23d7f7a968 Use `CACHELINE_ALIGN` constant to align data into the right cache size corresponding to the architecture 2 years ago
  haixuanTao 4cd9b4d71e Fix `x86` pip release by type hinting integer 2 years ago
  Philipp Oppermann 85338b61e2
Consider alignment when copying array into raw buffer 2 years ago
  Philipp Oppermann ad3f0482ac
Avoid alignment errors by aligning raw data on deseralization 2 years ago
  Philipp Oppermann ac7d1740c3
Fix alignment errors when receiving empty arrays 2 years ago
  Philipp Oppermann c6ce45785f
Rework raw data to arrow array conversion 2 years ago
  Philipp Oppermann 8cc5837cfa
Update `arrow` and `pyo3` dependencies to latest versions 2 years ago
  Philipp Oppermann 14a5531311
Fix doc test 2 years ago
  Philipp Oppermann 6140681ab9
Rename and reexport `Data` enums 2 years ago
  Philipp Oppermann 9a10280595
Simplify reading of primitive and string types from arrow arrays 2 years ago
  Philipp Oppermann 89f980e753
Simplify arrow array construction through new `IntoArrow` trait 2 years ago
  Philipp Oppermann 6154415cbc
Update Rust APIs and rust-dataflow-example to use arrow types 2 years ago
  Philipp Oppermann 7d96e03eed
Start to make Rust node API typed using arrow 2 years ago
  Philipp Oppermann 7451135d34
Fix reconstruction of buffers and child data from received data slices 2 years ago
  Philipp Oppermann 19f9cc7c90
Add support for arbitrary Arrow types in Python API 2 years ago
  Philipp Oppermann b3e5bf90f5
Add new MergeExternalSend trait for usage in Python 2 years ago
  Philipp Oppermann ffaea07e31
Revert new Send requirement for 'merge_external' 2 years ago
  Philipp Oppermann dfa71c77c5
Merge branch 'main' into python-ros2-bridge-example 2 years ago
  haixuanTao b20ef2391d Optimise sending of small vector for python 2 years ago
  haixuanTao 0220d1ef65 Adding `data_type` to metadata for typing output 2 years ago
  haixuanTao 6b910ab619 Adding `arrow-schema` as dependency 2 years ago
  haixuanTao eb515c7755 Removing lifetime to the Metadata struct 2 years ago
  haixuanTao 19172523df Update `pyo3` and `arrow` version to use latest version 2 years ago
  Philipp Oppermann 7a21d965a9
Implement event stream merging for Python 2 years ago
  Philipp Oppermann e2899c382e
Merge pull request #311 from dora-rs/external-events 2 years ago
  Haixuan Xavier Tao 53198b861b
Merge pull request #248 from dora-rs/shmem-read-only 2 years ago
  Philipp Oppermann 8401d8654e
Merge pull request #310 from dora-rs/send-output-bytes 2 years ago
  Philipp Oppermann c4bd9d3edf
Add convenience functions for merging external event streams with `EventStream` 2 years ago