Chrislearn Young
bfedbe4b62
Merge branch 'main' into fix-all-clippy-warning
10 months ago
Chrislearn Young
dcfaee05b7
Fix all `cargo clippy` warning
10 months ago
Philipp Oppermann
92cea2426b
Add proper documentation to `dora-node-api` crate ( #1056 )
Also includes a bit or regorganization to streamline the API.
10 months ago
Haixuan Xavier Tao
05547d841d
Fix many `cargo clippy` warning ( #1070 )
10 months ago
Philipp Oppermann
7028d89c9e
Fix doctest
10 months ago
Chrislearn Young
bcf591deb4
Remove rust--toolchain.toml and use rust-version in Cargo.toml
10 months ago
Chrislearn Young
715ee0286b
Fix many `cargo clippy` warning
10 months ago
Philipp Oppermann
7036f8dd5f
Merge branch 'main' into rust-api-docs
10 months ago
Philipp Oppermann
287b71d893
Document remaining items of `dora-node-api` crate
10 months ago
Philipp Oppermann
3986a74a35
Reexport futures crate
10 months ago
Chrislearn Young
cc9eeac472
Made some changes to make clippy happy
10 months ago
Philipp Oppermann
933078843a
Fix python roundtrip test by exposing `buffer_into_arrow_array`
11 months ago
Philipp Oppermann
611eb54881
Remove missing imports
11 months ago
Philipp Oppermann
00db990a12
Move data conversion functions to private module + continue docs
11 months ago
Philipp Oppermann
baa42baaa4
Fix some clippy warnings
11 months ago
Philipp Oppermann
4625efd23d
Start documenting dora node API crate
11 months ago
Philipp Oppermann
125d5a0443
Merge branch 'main' into git-source
11 months ago
haixuantao
f72991b09c
Add Cause to stpo
11 months ago
haixuantao
5988a65ea2
Expose all input closed message as a stop message
11 months ago
Philipp Oppermann
2a05324692
Fix some warnings
11 months ago
Philipp Oppermann
9d917bdaa9
Parse dataflow descriptor lazily in node APIs
The dataflow descriptor format still changes often, which led to parse errors. By doing the parsing lazily, this should only affect users of the `dataflow_descriptor` function from now on.
11 months ago
sjfhsjfh
51190788ba
refactor: use builder style
fix: logging thread block
1 year ago
mivik
eaae7af4c3
feat(node): change logging level of discarding to debug
1 year ago
mivik
9e687ccae8
feat(node): add warning for discarding events
1 year ago
haixuanTao
26c3917470
Fix GPU Memory not displayed
1 year ago
haixuanTao
48cb5ae709
Use current tokio threadpool and update otlp to latest version
1 year ago
haixuanTao
a9aa556b9c
Adding metrics for node api
1 year ago
Shar-jeel-Sajid
2c70244418
automatic clippy fix
1 year ago
Shar-jeel-Sajid
a049e97e7c
clippy linting automatic fix
1 year ago
haixuantao
649902783c
Fix CI/CD
1 year ago
Philipp Oppermann
ee15517dce
Make `ShmemChannel` `Sync` as required by pyo3 0.23
1 year ago
haixuantao
f33ee1e811
Fix scheduler not being used when called through node timeout
1 year ago
yjhmelody
ca614753a1
chore: use workspace edition
1 year ago
Haixuan Xavier Tao
2d9d27bf0d
Make unknown output acceptable ( #755 )
Make unknown output acceptable and warn once in case of typo
1 year ago
haixuantao
f467c1353d
increase delay duration
1 year ago
haixuanTao
3e5a3d7d91
Fix NON_INPUT_EVENT
1 year ago
haixuanTao
acf4d0cb44
Fix typo
1 year ago
haixuanTao
aefb8f02ab
Rewrite the scheduler to avoid overhead
1 year ago
haixuanTao
90752a0bb7
Make the non input event a priority when collecting next event
1 year ago
haixuanTao
f77f400da2
Add a scheduler to the node api to manage fairness among inputs
1 year ago
haixuanTao
411436d3bb
Replace drop token mecanism on closed channel by leaving drop token active on the receiver side and closing sender side shared memory with a lower timeout
1 year ago
haixuanTao
a2d651446b
Dropping remaining drop token on exit so that the origin node does not get stuck
1 year ago
haixuanTao
45a7ee9437
Reduce `eventstream` timeout as it is linked to Python cleanup race condition that is cleaning up node first and then python arrow reference.
1 year ago
haixuanTao
7487ce17c3
Fix clippy warning
1 year ago
haixuanTao
5ccdbc593e
Moving queue size and making node flume queue bigger
1 year ago
Philipp Oppermann
49aef8bac6
Move more implementation code out of `dora-message` into `dora-core`
Ensures that we need to update `dora-message` less often.
1 year ago
haixuanTao
60496e62ea
Better error linting for unknown output
1 year ago
Haixuan Xavier Tao
01b561a0aa
Make dora versions compatible by using separate versioning for `dora-message` crate ( #614 )
By versioning the `dora-message` crate individually, we can use the
semver rules to encode which versions are compatible. This way, we can
allow different versions of dora to work together (e.g. CLI version can
be different than node API version), as long as the message formats are
compatible. Breaking message format changes are signaled by a
semver-incompatible release of `dora-message`. For example, 0.4.0 is not
compatible with 0.3.5.
One alternative approach could be to use the main version to signal
compatibility, i.e. the common version that we use for all dora crates.
This has the disadvantage that we might need to bump the minor version
of the main dora crate every time we want to change the message format
in a breaking way. As we still expect semi-regular breaking changes to
the message format in the near future, we want to avoid this churn. Once
we consider the message format more stable, we plan to revisit this
approach.
Fixes https://github.com/dora-rs/dora/issues/504
TODO
- [x] Update release script: We should not try to publish the
`dora-message` crate if there is no new version.
- [x] Relax version checks to only compare major/minor version
(according to semver compatibility rules).
1 year ago
Michael-J-Ward
96c6ba0f1d
fix simple lintst in api
1 year ago
Philipp Oppermann
8e8034d103
Set `repository` metadata for all our crates
1 year ago