95 Commits (88643b955d4031d6ca7c02741a812288e47e8f61)

Author SHA1 Message Date
  haixuanTao 88643b955d Adding `recv_async` dora method to retrieve data in python async 10 months ago
  Shar-jeel-Sajid 852417a270 replacing to_object 10 months ago
  Shar-jeel-Sajid 48c3bb5b4a Removing Deprecation 10 months ago
  Shar-jeel-Sajid a049e97e7c clippy linting automatic fix 10 months ago
  Philipp Oppermann 49aef8bac6
Move more implementation code out of `dora-message` into `dora-core` 1 year ago
  haixuanTao 3775a3c08b Make downloading file use `content_dosposition` header or the filename within the url to get the path avoiding to create confusion on the name of the file. 1 year ago
  haixuanTao dd10bbf85c Bump `pyo3` version to `0.22` 1 year ago
  Philipp Oppermann 6a3dcecf33
Refactor: Move message definitions to `dora-message` crate 1 year ago
  haixuanTao 7bcb132075 Retrieve `open_telemetry_context` from metadata parameters. 1 year ago
  Philipp Oppermann 9cec8df1cc
Delay dropping of `DoraNode` in Python until all event data is freed 1 year ago
  haixuanTao c4263e6c8f Remove bound from definition of .to_py_dict 1 year ago
  haixuanTao b2eace277d Transform custom PyEvent into standard python dictionary for easier debuggability. 1 year ago
  Haixuan Xavier Tao d7be6a49e3
Merge pull request #472 from Michael-J-Ward/pyo3-bounds 1 year ago
  Michael-J-Ward af332c18f7 remove deprecated `py::new_pool` 1 year ago
  Michael-J-Ward 25884b658a update pyo3 to new bounds api 1 year ago
  EricLBuehler 6c62246e53 Fix typos 1 year ago
  Michael-J-Ward 3b59b026b4 lint: allow type-complexity for select signatures 1 year ago
  haixuanTao c6948c1644 Only use conda if conda is present 1 year ago
  haixuanTao 629a218ddb `copy_array_into_sample` do not need to return a result 2 years ago
  haixuanTao fd7c0939df Run `cargo fmt --all` 2 years ago
  haixuanTao 135d6433fb Trace send_output as it can be a big source of overhead for large messages. 2 years ago
  haixuanTao ab3fde910a Put reloading flag outside of the loop to keep the state of reloading 2 years ago
  haixuanTao 5bff656138 Add an error catch in python `on_event` when using hot-reloading 2 years ago
  haixuanTao e45975f65a Use cleaner `__from_elem` `avec` constructor 2 years ago
  haixuanTao fe065eec6f replace const cache line with 128 to match arrow 2 years ago
  haixuanTao 739cfd57f7 Change type hinting frfom Uint8 only array to any array 2 years ago
  Philipp Oppermann ad3f0482ac
Avoid alignment errors by aligning raw data on deseralization 2 years ago
  Philipp Oppermann 6154415cbc
Update Rust APIs and rust-dataflow-example to use arrow types 2 years ago
  Philipp Oppermann a882104b93
Fix: Count buffer length instead of owned capacity when sending arrow data 2 years ago
  Philipp Oppermann 19f9cc7c90
Add support for arbitrary Arrow types in Python API 2 years ago
  haixuanTao 90c28de777 Fix clippy warnings about unnecessary `.clone()`, `.into()`, borrowing and let statement 2 years ago
  haixuanTao b20ef2391d Optimise sending of small vector for python 2 years ago
  haixuanTao e944b794a3 Adding `data_type` parsing 2 years ago
  haixuanTao d55df9a326 Adding documentation for the send method 2 years ago
  Philipp Oppermann 049e5e1e43
Make runtime pass dataflow descriptor to Python operators 2 years ago
  haixuanTao c80a1958cb Show node name in process and put error after Traceback 2 years ago
  Philipp Oppermann 8ec45239ce
Send empty map empty arrays to `None` when sending outputs 2 years ago
  Philipp Oppermann 1948a45e6d
Copy outputs directly into shared memory in dora runtime 2 years ago
  Philipp Oppermann c1544f8257
Allow accessing data multiple times on Python event type 2 years ago
  Philipp Oppermann 235f6da79d
Support sending arrow data from operators 2 years ago
  Philipp Oppermann ef37caa3ed
Add arrow support for Python operator inputs 2 years ago
  Philipp Oppermann 4cee14ae04
Restore operator state through `__dict__.update` 2 years ago
  haixuanTao 835f7db2d1 Fix wrongly rebased python operator definition 2 years ago
  haixuanTao 5e30fa6f57 Hot reload python operator when receiving `Reload` event 2 years ago
  haixuanTao ff2006f77b Rewrite `Context` flowing using `tracing` instead of opentelemetry 2 years ago
  haixuanTao 1fdb8486db Use global tracer instead of redeclaring a local tracer for opentelemetry 2 years ago
  haixuanTao 1e965452d5 Replace opentelemetry with tokio::tracing 2 years ago
  haixuanTao b01465dfe7 Add opentelemetry capability to the runtime 2 years ago
  haixuanTao bfd32f1fd7 Push error into the `init_done` channel for debugging context 2 years ago
  Philipp Oppermann 07063e4ff9
dora-runtime: Only subscribe to daemon once all operators are ready 2 years ago