55 Commits (edb2a28d2f91c863cbeebaf9bf32d9636c04b9a5)

Author SHA1 Message Date
  Philipp Oppermann 2eeb40b1ff
Fix operator API: Box optional error string since `Option<String>` is not FFI-safe 2 years ago
  haixuanTao e45975f65a Use cleaner `__from_elem` `avec` constructor 2 years ago
  haixuanTao fe065eec6f replace const cache line with 128 to match arrow 2 years ago
  Philipp Oppermann ad3f0482ac
Avoid alignment errors by aligning raw data on deseralization 2 years ago
  Philipp Oppermann 6154415cbc
Update Rust APIs and rust-dataflow-example to use arrow types 2 years ago
  Philipp Oppermann 7d96e03eed
Start to make Rust node API typed using arrow 2 years ago
  Philipp Oppermann 19f9cc7c90
Add support for arbitrary Arrow types in Python API 2 years ago
  haixuanTao 0220d1ef65 Adding `data_type` to metadata for typing output 2 years ago
  Philipp Oppermann 8ec45239ce
Send empty map empty arrays to `None` when sending outputs 3 years ago
  Philipp Oppermann 1948a45e6d
Copy outputs directly into shared memory in dora runtime 3 years ago
  Philipp Oppermann ef37caa3ed
Add arrow support for Python operator inputs 3 years ago
  haixuanTao 2f6eb3833f Address PR comments by removing unsued event, removing reloading todos, and removing `info!` on `cli` querying of `coordinator` 3 years ago
  haixuanTao 2d76cd5cc8 Add `Reload` event containing `dataflow_id, node_id, op_id` that needs to be reloaded 3 years ago
  haixuanTao ff2006f77b Rewrite `Context` flowing using `tracing` instead of opentelemetry 3 years ago
  haixuanTao 1fdb8486db Use global tracer instead of redeclaring a local tracer for opentelemetry 3 years ago
  haixuanTao 1e965452d5 Replace opentelemetry with tokio::tracing 3 years ago
  haixuanTao b01465dfe7 Add opentelemetry capability to the runtime 3 years ago
  haixuanTao bfd32f1fd7 Push error into the `init_done` channel for debugging context 3 years ago
  Philipp Oppermann 07063e4ff9
dora-runtime: Only subscribe to daemon once all operators are ready 3 years ago
  Philipp Oppermann 152076ad87
Use separate `telemetry` feature in `dora-runtime` 3 years ago
  haixuanTao 70e6d4ce8f Remove code duplicate for tracing subscriber and use env variable to manage log level. 3 years ago
  Philipp Oppermann 7232a31b57
Send `InputClosed` events to operators too 3 years ago
  Philipp Oppermann a9203e0274
Add intermediate operator channel buffer to avoid blocking runtime 3 years ago
  Philipp Oppermann de786ef101
Fix some warnings in runtime 3 years ago
  Philipp Oppermann cdc0be1206
Rename `FfiEvent` to `RawEvent` 3 years ago
  Philipp Oppermann 62319f1ec1
Add support for Rust operators again 3 years ago
  Philipp Oppermann 5375628930
Allow operators to stop the full dataflow 3 years ago
  Philipp Oppermann 5cc0e8b840
Fix: Make `download_file` asynchronous 3 years ago
  Philipp Oppermann 2495218cd3
Merge branch 'main' into url-source 3 years ago
  Philipp Oppermann e2c0e97b8f
Download files to `build` subfolder and set them as executable 3 years ago
  Philipp Oppermann 8fbe60acf0
Merge branch 'main' into uhlc 3 years ago
  Philipp Oppermann 64cf49703b
Implement download support for custom nodes 3 years ago
  Philipp Oppermann a37d3ee6c8
Don't parse operator source always as URI 3 years ago
  Philipp Oppermann 13d3a91683
Implement support for downloading operator sources 3 years ago
  Philipp Oppermann c4da2cbdad
Refactor: Move configuration to `core` crate 3 years ago
  Philipp Oppermann 9ba990b816
Fix opentelemetry access 3 years ago
  Philipp Oppermann 1c1891446a
Add `uhlc` timestamp to message metadata 3 years ago
  Philipp Oppermann 808b6679ad
Fix clippy warnings 3 years ago
  haixuanTao 7fa6c472f8 make context live long enough to trace `on_input` 3 years ago
  Philipp Oppermann 55b411e668
Reduce number of `tracing` and `metrics` feature gates 3 years ago
  Xavier Tao c2bb4c1f67
Runtime tracing (#95) 3 years ago
  Philipp Oppermann 2a9495cb68
Merge pull request #84 from dora-rs/cli 3 years ago
  Philipp Oppermann c9ec58db1c
Implement a cli `check` command that verifies paths and input mappings 3 years ago
  Philipp Oppermann 6ab39e229b
Don't serialize data to provide true zero-copy reading and writing 3 years ago
  Philipp Oppermann 0df06fce86
Send metadata in messages encoded with capnproto 3 years ago
  Philipp Oppermann 848e136a75
Move communication layer implementation into separate library 3 years ago
  Philipp Oppermann 03348c5be8
Redesign communication layer to be synchronous and add support for iceoryx 3 years ago
  Philipp Oppermann 9866328bf8
Merge branch 'main' into safer-ffi 3 years ago
  Philipp Oppermann c54209ff98
Pass `SendOutput` by reference 3 years ago
  Philipp Oppermann 933affaf16
Rename type 3 years ago