Chrislearn Young
26f9973ae3
cargo fmt
5 months ago
Chrislearn Young
dcfaee05b7
Fix all `cargo clippy` warning
6 months ago
Chrislearn Young
bcf591deb4
Remove rust--toolchain.toml and use rust-version in Cargo.toml
6 months ago
Philipp Oppermann
125d5a0443
Merge branch 'main' into git-source
7 months ago
Philipp Oppermann
38ff2c8d63
Run `dora` executable in release mode for examples
Avoids stack overflows on Windows
7 months ago
haixuantao
d155ee789a
Fix stop in example nodes
7 months ago
Philipp Oppermann
15ee34e8f1
Fix: Use new `TracingBuilder` in `multiple_daemons` example
7 months ago
Philipp Oppermann
51ed0194c7
Rework and refactor for two-step build
7 months ago
Philipp Oppermann
90733aabeb
Send build output to CLI
The coordinator now sends an immediate `DataflowStartTriggered` reply when receiving a `DataflowStart` command. This enables the CLI to directly attach to the dataflow and observe the build output.
To wait until the build/spawning is done, this commit introduces a new `WaitForSpawn` command, to which the coordinator replies with a `DataflowSpawned` message once the node has been started. We use this command for the `dora build` command.
9 months ago
Philipp Oppermann
d9d23a4a76
Improve log printing for multiple daemons example
9 months ago
Philipp Oppermann
0fabf16ff0
Remove superfluous extra build step in example `run.rs` scripts
9 months ago
Philipp Oppermann
bcb861932c
Make `dora build` command behave like `dora start` without spawning
Instead of running all the build commands directly, run them on their intended target machines through the coordinator.
This commit is a breaking change because a coordinator connection is now required for `dora build`.
9 months ago
Philipp Oppermann
68d09a1c0c
Merge branch 'main' into zenoh-daemon
11 months ago
haixuantao
4de5c687fd
Fix multiple daemon example
11 months ago
Philipp Oppermann
8f87659b4f
Don't error if local listen port is already in use
11 months ago
Philipp Oppermann
2e6584c390
Add distributed deployment instructions to README for multiple-daemons example
11 months ago
Philipp Oppermann
c4138ee228
Add README with run instructions to multiple-daemons example
11 months ago
Philipp Oppermann
804d57dbeb
Fix `multiple-daemons` example
11 months ago
Philipp Oppermann
0f3c0fb2fe
Assign unique ID to each daemon
The previous machine ID is still used, but optional. Users don't need to ensure that the chosen machine IDs are unique anymore because they are augmented with a UUID.
11 months ago
yjhmelody
ca614753a1
chore: use workspace edition
1 year ago
Philipp Oppermann
7c44e7a2e6
Move more types from `dora-core` to `dora-message` to avoid dependency
Make `dora-message` a dependency of `dora-core`, instead of the other way around. This way, we can continue to freely bump the version of `dora-core` with the other workspace crates, without introducing errors such as #708 .
1 year ago
haixuanTao
1855800fec
fix multi daemon example
1 year ago
Hennzau
0f949a5e5a
fix failed to replace source with path
1 year ago
Hennzau
8bb6dc3141
new syntax for dataflow examples
1 year ago
Philipp Oppermann
3ec1e45119
Ensure that we don't publish example crates
1 year ago
Philipp Oppermann
6a3dcecf33
Refactor: Move message definitions to `dora-message` crate
First step towards versioning the message definitions indepedently.
1 year ago
Philipp Oppermann
cf45f11257
Fix example
1 year ago
Philipp Oppermann
8056c23db7
List failed and finished dataflows in `dora list`
1 year ago
haixuanTao
a96a5d6b79
Update local listen port argument
1 year ago
haixuanTao
a0a95b730c
Rename dynamic node listener -> local listener
1 year ago
haixuanTao
d180aa7345
Adding configuration for dynamic nodes port
1 year ago
Philipp Oppermann
142d218610
Add support for custom coordinator control port numbers in CLI
1 year ago
Michael-J-Ward
5f873844c6
fix: multiple-daemons example dataflow definition
Previously, this dataflow relied on an incorrect shared library.
1 year ago
Michael-J-Ward
dfe298eb1e
lint: fix clippy lints
1 year ago
Philipp Oppermann
6115ddbb4d
Revert "update dora_coordinator::start to return bound addr instead of just the port"
This reverts commit 1ba763cd67 .
1 year ago
Philipp Oppermann
e76f497939
Revert "revert to daemons listening to 127.0.0.1 by default"
This reverts commit 4af82a4833 .
1 year ago
Michael-J-Ward
4af82a4833
revert to daemons listening to 127.0.0.1 by default
clients can not connect to `0.0.0.0` on windows.
1 year ago
Michael-J-Ward
1ba763cd67
update dora_coordinator::start to return bound addr instead of just the port
1 year ago
Michael-J-Ward
3a6323ff0c
feat: add bind configuration for coordination daemon
Ref: #459
1 year ago
haixuanTao
c641d97d18
Increase the wait time for the daemon for the CI
1 year ago
haixuanTao
eadf6b3557
Remove sleep in multiple daemons as compiling dora cli is fast enough
2 years ago
haixuanTao
28be4a6663
Fix example by using the right daemon command
2 years ago
haixuanTao
05f919e06c
Use cli to spawn daemon run-dataflow to avoid confused exe path
2 years ago
haixuanTao
054ae5afcc
Fix multiple daemon example
2 years ago
haixuanTao
f85011837d
Remove unused runtime args from examples
2 years ago
haixuanTao
a2de951d98
Remove setup tracing from examples to make it more simple
2 years ago
Philipp Oppermann
9a10280595
Simplify reading of primitive and string types from arrow arrays
- introduce a new `ArrayData` wrapper struct
- implement `TryFrom` to convert to primitive types and strings
- update examples to use the new conversion functions
2 years ago
Philipp Oppermann
89f980e753
Simplify arrow array construction through new `IntoArrow` trait
2 years ago
Philipp Oppermann
ddf8035d2f
Adjust multiple-daemons example
2 years ago
Philipp Oppermann
6154415cbc
Update Rust APIs and rust-dataflow-example to use arrow types
2 years ago