Philipp Oppermann
68d09a1c0c
Merge branch 'main' into zenoh-daemon
11 months ago
haixuantao
4de5c687fd
Fix multiple daemon example
11 months ago
Philipp Oppermann
8f87659b4f
Don't error if local listen port is already in use
11 months ago
Philipp Oppermann
2e6584c390
Add distributed deployment instructions to README for multiple-daemons example
11 months ago
Philipp Oppermann
c4138ee228
Add README with run instructions to multiple-daemons example
11 months ago
Philipp Oppermann
804d57dbeb
Fix `multiple-daemons` example
11 months ago
Philipp Oppermann
0f3c0fb2fe
Assign unique ID to each daemon
The previous machine ID is still used, but optional. Users don't need to ensure that the chosen machine IDs are unique anymore because they are augmented with a UUID.
11 months ago
yjhmelody
ca614753a1
chore: use workspace edition
1 year ago
Philipp Oppermann
7c44e7a2e6
Move more types from `dora-core` to `dora-message` to avoid dependency
Make `dora-message` a dependency of `dora-core`, instead of the other way around. This way, we can continue to freely bump the version of `dora-core` with the other workspace crates, without introducing errors such as #708 .
1 year ago
haixuanTao
1855800fec
fix multi daemon example
1 year ago
Hennzau
0f949a5e5a
fix failed to replace source with path
1 year ago
Hennzau
8bb6dc3141
new syntax for dataflow examples
1 year ago
Philipp Oppermann
3ec1e45119
Ensure that we don't publish example crates
1 year ago
Philipp Oppermann
6a3dcecf33
Refactor: Move message definitions to `dora-message` crate
First step towards versioning the message definitions indepedently.
1 year ago
Philipp Oppermann
cf45f11257
Fix example
1 year ago
Philipp Oppermann
8056c23db7
List failed and finished dataflows in `dora list`
1 year ago
haixuanTao
a96a5d6b79
Update local listen port argument
1 year ago
haixuanTao
a0a95b730c
Rename dynamic node listener -> local listener
1 year ago
haixuanTao
d180aa7345
Adding configuration for dynamic nodes port
1 year ago
Philipp Oppermann
142d218610
Add support for custom coordinator control port numbers in CLI
1 year ago
Michael-J-Ward
5f873844c6
fix: multiple-daemons example dataflow definition
Previously, this dataflow relied on an incorrect shared library.
1 year ago
Michael-J-Ward
dfe298eb1e
lint: fix clippy lints
1 year ago
Philipp Oppermann
6115ddbb4d
Revert "update dora_coordinator::start to return bound addr instead of just the port"
This reverts commit 1ba763cd67 .
1 year ago
Philipp Oppermann
e76f497939
Revert "revert to daemons listening to 127.0.0.1 by default"
This reverts commit 4af82a4833 .
1 year ago
Michael-J-Ward
4af82a4833
revert to daemons listening to 127.0.0.1 by default
clients can not connect to `0.0.0.0` on windows.
1 year ago
Michael-J-Ward
1ba763cd67
update dora_coordinator::start to return bound addr instead of just the port
1 year ago
Michael-J-Ward
3a6323ff0c
feat: add bind configuration for coordination daemon
Ref: #459
1 year ago
haixuanTao
c641d97d18
Increase the wait time for the daemon for the CI
1 year ago
haixuanTao
eadf6b3557
Remove sleep in multiple daemons as compiling dora cli is fast enough
2 years ago
haixuanTao
28be4a6663
Fix example by using the right daemon command
2 years ago
haixuanTao
05f919e06c
Use cli to spawn daemon run-dataflow to avoid confused exe path
2 years ago
haixuanTao
054ae5afcc
Fix multiple daemon example
2 years ago
haixuanTao
f85011837d
Remove unused runtime args from examples
2 years ago
haixuanTao
a2de951d98
Remove setup tracing from examples to make it more simple
2 years ago
Philipp Oppermann
9a10280595
Simplify reading of primitive and string types from arrow arrays
- introduce a new `ArrayData` wrapper struct
- implement `TryFrom` to convert to primitive types and strings
- update examples to use the new conversion functions
2 years ago
Philipp Oppermann
89f980e753
Simplify arrow array construction through new `IntoArrow` trait
2 years ago
Philipp Oppermann
ddf8035d2f
Adjust multiple-daemons example
2 years ago
Philipp Oppermann
6154415cbc
Update Rust APIs and rust-dataflow-example to use arrow types
2 years ago
Philipp Oppermann
e13415d532
Send cross-machine outputs directly to target daemon without involving coordinator
The coordinator is our control plane and should not be involved in data plane operations. This way, the dataflow can continue even if the coordinator fails.
2 years ago
Philipp Oppermann
f6219203dc
Fix `multiple-daemons` example: Use new `_unstable_` prefix for deploy keys
2 years ago
Philipp Oppermann
bf12a7b496
Canoncialize dataflow path to determine working dir
The path should also be valid on the receiving node, which might run in a different directory.
2 years ago
Philipp Oppermann
aac5e6515a
Integrate `dora-runtime` into `dora-daemon`
Removes the separate `dora-runtime` binary. The runtime can now be started by passing `--run-dora-runtime` to `dora-daemon`. This change makes setup and deployment easier since it removes one executable that needs to be copied across machines.
2 years ago
Philipp Oppermann
72a57ce1ef
Remove deprecated `communication` options from dataflow examples, templates, and docs
2 years ago
Philipp Oppermann
17c52e3482
Use control messages in `multiple-daemons` example instead of sleeping
2 years ago
Philipp Oppermann
9f76239c71
Run distributed dataflow in `multiple-daemons` example
2 years ago
Philipp Oppermann
4f649e884e
Only set ctrl-c handler in deamon when it's run as a binary
2 years ago
Philipp Oppermann
c515651264
Start working on a example that uses multiple daemons
2 years ago