61 Commits (5924e8743bdeafa89fd76be1d649fbe36ce7e782)

Author SHA1 Message Date
  haixuantao f72991b09c Add Cause to stpo 7 months ago
  Shar-jeel-Sajid a049e97e7c clippy linting automatic fix 10 months ago
  haixuanTao 3775a3c08b Make downloading file use `content_dosposition` header or the filename within the url to get the path avoiding to create confusion on the name of the file. 1 year ago
  haixuanTao 7bcb132075 Retrieve `open_telemetry_context` from metadata parameters. 1 year ago
  Michael-J-Ward cd8ed19620 deps: upgrade pyo3 and arrow deps 1 year ago
  haixuanTao 629a218ddb `copy_array_into_sample` do not need to return a result 2 years ago
  Philipp Oppermann 2eeb40b1ff
Fix operator API: Box optional error string since `Option<String>` is not FFI-safe 1 year ago
  haixuanTao e45975f65a Use cleaner `__from_elem` `avec` constructor 2 years ago
  haixuanTao fe065eec6f replace const cache line with 128 to match arrow 2 years ago
  Philipp Oppermann ad3f0482ac
Avoid alignment errors by aligning raw data on deseralization 2 years ago
  Philipp Oppermann 6154415cbc
Update Rust APIs and rust-dataflow-example to use arrow types 2 years ago
  Philipp Oppermann 7d96e03eed
Start to make Rust node API typed using arrow 2 years ago
  Philipp Oppermann 19f9cc7c90
Add support for arbitrary Arrow types in Python API 2 years ago
  haixuanTao 0220d1ef65 Adding `data_type` to metadata for typing output 2 years ago
  Philipp Oppermann 8ec45239ce
Send empty map empty arrays to `None` when sending outputs 2 years ago
  Philipp Oppermann 1948a45e6d
Copy outputs directly into shared memory in dora runtime 2 years ago
  Philipp Oppermann ef37caa3ed
Add arrow support for Python operator inputs 2 years ago
  haixuanTao 2f6eb3833f Address PR comments by removing unsued event, removing reloading todos, and removing `info!` on `cli` querying of `coordinator` 2 years ago
  haixuanTao 2d76cd5cc8 Add `Reload` event containing `dataflow_id, node_id, op_id` that needs to be reloaded 2 years ago
  haixuanTao ff2006f77b Rewrite `Context` flowing using `tracing` instead of opentelemetry 2 years ago
  haixuanTao 1fdb8486db Use global tracer instead of redeclaring a local tracer for opentelemetry 2 years ago
  haixuanTao 1e965452d5 Replace opentelemetry with tokio::tracing 2 years ago
  haixuanTao b01465dfe7 Add opentelemetry capability to the runtime 2 years ago
  haixuanTao bfd32f1fd7 Push error into the `init_done` channel for debugging context 2 years ago
  Philipp Oppermann 07063e4ff9
dora-runtime: Only subscribe to daemon once all operators are ready 2 years ago
  Philipp Oppermann 152076ad87
Use separate `telemetry` feature in `dora-runtime` 2 years ago
  haixuanTao 70e6d4ce8f Remove code duplicate for tracing subscriber and use env variable to manage log level. 2 years ago
  Philipp Oppermann 7232a31b57
Send `InputClosed` events to operators too 2 years ago
  Philipp Oppermann a9203e0274
Add intermediate operator channel buffer to avoid blocking runtime 2 years ago
  Philipp Oppermann de786ef101
Fix some warnings in runtime 2 years ago
  Philipp Oppermann cdc0be1206
Rename `FfiEvent` to `RawEvent` 2 years ago
  Philipp Oppermann 62319f1ec1
Add support for Rust operators again 2 years ago
  Philipp Oppermann 5375628930
Allow operators to stop the full dataflow 3 years ago
  Philipp Oppermann 5cc0e8b840
Fix: Make `download_file` asynchronous 3 years ago
  Philipp Oppermann 2495218cd3
Merge branch 'main' into url-source 3 years ago
  Philipp Oppermann e2c0e97b8f
Download files to `build` subfolder and set them as executable 3 years ago
  Philipp Oppermann 8fbe60acf0
Merge branch 'main' into uhlc 3 years ago
  Philipp Oppermann 64cf49703b
Implement download support for custom nodes 3 years ago
  Philipp Oppermann a37d3ee6c8
Don't parse operator source always as URI 3 years ago
  Philipp Oppermann 13d3a91683
Implement support for downloading operator sources 3 years ago
  Philipp Oppermann c4da2cbdad
Refactor: Move configuration to `core` crate 3 years ago
  Philipp Oppermann 9ba990b816
Fix opentelemetry access 3 years ago
  Philipp Oppermann 1c1891446a
Add `uhlc` timestamp to message metadata 3 years ago
  Philipp Oppermann 808b6679ad
Fix clippy warnings 3 years ago
  haixuanTao 7fa6c472f8 make context live long enough to trace `on_input` 3 years ago
  Philipp Oppermann 55b411e668
Reduce number of `tracing` and `metrics` feature gates 3 years ago
  Xavier Tao c2bb4c1f67
Runtime tracing (#95) 3 years ago
  Philipp Oppermann 2a9495cb68
Merge pull request #84 from dora-rs/cli 3 years ago
  Philipp Oppermann c9ec58db1c
Implement a cli `check` command that verifies paths and input mappings 3 years ago
  Philipp Oppermann 6ab39e229b
Don't serialize data to provide true zero-copy reading and writing 3 years ago