156 Commits (89f980e7538fb863fa1304cda5ee46722b406c44)

Author SHA1 Message Date
  Philipp Oppermann 89f980e753
Simplify arrow array construction through new `IntoArrow` trait 2 years ago
  Philipp Oppermann 6154415cbc
Update Rust APIs and rust-dataflow-example to use arrow types 2 years ago
  Philipp Oppermann 7d96e03eed
Start to make Rust node API typed using arrow 2 years ago
  Philipp Oppermann 7451135d34
Fix reconstruction of buffers and child data from received data slices 2 years ago
  Philipp Oppermann 19f9cc7c90
Add support for arbitrary Arrow types in Python API 2 years ago
  Philipp Oppermann b3e5bf90f5
Add new MergeExternalSend trait for usage in Python 2 years ago
  Philipp Oppermann ffaea07e31
Revert new Send requirement for 'merge_external' 2 years ago
  Philipp Oppermann dfa71c77c5
Merge branch 'main' into python-ros2-bridge-example 2 years ago
  haixuanTao b20ef2391d Optimise sending of small vector for python 2 years ago
  haixuanTao 0220d1ef65 Adding `data_type` to metadata for typing output 2 years ago
  haixuanTao 6b910ab619 Adding `arrow-schema` as dependency 2 years ago
  haixuanTao eb515c7755 Removing lifetime to the Metadata struct 2 years ago
  haixuanTao 19172523df Update `pyo3` and `arrow` version to use latest version 2 years ago
  Philipp Oppermann 7a21d965a9
Implement event stream merging for Python 2 years ago
  Philipp Oppermann e2899c382e
Merge pull request #311 from dora-rs/external-events 2 years ago
  Haixuan Xavier Tao 53198b861b
Merge pull request #248 from dora-rs/shmem-read-only 2 years ago
  Philipp Oppermann 8401d8654e
Merge pull request #310 from dora-rs/send-output-bytes 2 years ago
  Philipp Oppermann c4bd9d3edf
Add convenience functions for merging external event streams with `EventStream` 2 years ago
  Philipp Oppermann d382761e2d
Add convenience function `send_output_bytes` 2 years ago
  Philipp Oppermann 326c650f1f
Implement `Stream` for `EventStream` 2 years ago
  Philipp Oppermann 979573689a
Switch to forked `shared_memory_extended` crate 2 years ago
  Philipp Oppermann f4498a4abf
Map shared memory region as read-only in receiver 2 years ago
  Philipp Oppermann 4da34d82d9
Merge branch 'main' into event-timestamps 2 years ago
  Philipp Oppermann 984ee364e4
Fill in timestamps when sending events from node to daemon 2 years ago
  Philipp Oppermann e0559b031e
Add HLC clock to daemon and to all event types 2 years ago
  Philipp Oppermann 482b282d92
Document `dataflow_descriptor` methods 2 years ago
  Philipp Oppermann 0bf31b750e
WIP: Add `uhlc` timestamps to all events and update HLC clocks 2 years ago
  Philipp Oppermann 8a439c3411
Pass dataflow descriptor to Rust nodes via API 2 years ago
  haixuanTao 51b35aa463 Fix doc test by adding imports 2 years ago
  haixuanTao f9d8fac8e5 Adding Rust docstring documentation 2 years ago
  Philipp Oppermann 132957ad34
Fix: Don't ignore subscribe results 2 years ago
  Philipp Oppermann 8ec45239ce
Send empty map empty arrays to `None` when sending outputs 2 years ago
  Philipp Oppermann 1948a45e6d
Copy outputs directly into shared memory in dora runtime 2 years ago
  Philipp Oppermann d7cd3708a7
Add `allocate_data_sample` and `send_output_sample` methods to Rust node API 2 years ago
  Philipp Oppermann c1544f8257
Allow accessing data multiple times on Python event type 2 years ago
  Philipp Oppermann a308c48f3e
Refactor Rust node API to ensure proper stopping 2 years ago
  Philipp Oppermann abd850c81e
Send drop tokens over separate channel 2 years ago
  Philipp Oppermann ef37caa3ed
Add arrow support for Python operator inputs 2 years ago
  Philipp Oppermann e413d38a8a
Validate `arrow::ArrayData` creation 2 years ago
  Philipp Oppermann 6688ae3072
Close outputs directly on drop to notify subscribers immediately 2 years ago
  Philipp Oppermann a19a746d5a
Report remaining drop tokens before event stream thread finishes 2 years ago
  Philipp Oppermann 59f4dde8e4
Improve tracing output 2 years ago
  Philipp Oppermann bb822a5ff4
Move pending drop token handling to separate function 2 years ago
  Philipp Oppermann 0ed4dcf0f6
Handle drop tokens asynchronously instead of waiting for them 2 years ago
  Philipp Oppermann 446fa7f0dc
Wait for remaining drop tokens before breaking from event stream thread 2 years ago
  Philipp Oppermann a661030c56
Break from drop token wait loop on timeout 2 years ago
  Philipp Oppermann 453e03c0e9
Warn if shared memory regions are closed before receiving drop tokens 2 years ago
  Philipp Oppermann 9030e729fe
Extract event stream loop into separate function 2 years ago
  Philipp Oppermann 983a26f664
Box shared memory instance to reduce size of `Event` enum 2 years ago
  Philipp Oppermann 0d0d6630a1
Add TODO 2 years ago