Philipp Oppermann
6154415cbc
Update Rust APIs and rust-dataflow-example to use arrow types
2 years ago
haixuanTao
90c28de777
Fix clippy warnings about unnecessary `.clone()`, `.into()`, borrowing and let statement
2 years ago
Philipp Oppermann
a16efcbaa4
Merge pull request #326 from dora-rs/use-cargo-instead-of-git-in-template
Use cargo instead of git in Rust `Cargo.toml` template
2 years ago
haixuanTao
4ff932ceaf
Remove logs formatting for easier copy paste out of cli
2 years ago
haixuanTao
d59f47ddc0
Use cargo instead of git in template `Cargo.toml`
By using cargo instead of git, we make compilation not have to git clone
dora project.
2 years ago
haixuanTao
b02745eef8
Use optional instead of | as it does not work on windows
2 years ago
haixuanTao
4b616a8346
Make typing more explicit
2 years ago
haixuanTao
d55df9a326
Adding documentation for the send method
This PR/commit adds documentation for the send_output method.
Follow up discussion: https://github.com/orgs/dora-rs/discussions/317#discussioncomment-6475816
2 years ago
Haixuan Xavier Tao
0cfed32ab2
Merge pull request #318 from dora-rs/fix-dep
Replace unmaintained `atty` crate with `std::io::IsTerminal`
2 years ago
Philipp Oppermann
21c3fe33cd
Replace unmaintained `atty` crate with `std::io::IsTerminal`
There is a current vulnerability (low severity) and the crate appears to be unmaintained. Since Rust 1.70, we should be able to use the new `IsTerminal` trait of the standard library instead.
2 years ago
haixuanTao
c54bd504e1
Use python3 within the template to avoid python2 confusion
2 years ago
haixuanTao
ff66581156
Merge branch 'meua/main'
2 years ago
haixuanTao
224d1b4c81
Add python3 as default interpreter
2 years ago
Philipp Oppermann
3bb665ae00
Pass dataflow result to CLI
2 years ago
haixuanTao
5d9605ec84
Add command description
2 years ago
haixuanTao
664e8d48ba
Minor refactoring
2 years ago
haixuanTao
e3079a88bd
Refactor to multi-daemon branch
2 years ago
haixuanTao
3b6b7663b9
Make cli less verbose
2 years ago
haixuanTao
cb39cb00a1
Improve error message for logs
2 years ago
haixuanTao
ca182bb131
Provide a way to access logs through the CLI
2 years ago
Philipp Oppermann
8bf124a014
Merge branch 'main' into multiple-daemons
2 years ago
Philipp Oppermann
bf12a7b496
Canoncialize dataflow path to determine working dir
The path should also be valid on the receiving node, which might run in a different directory.
2 years ago
Philipp Oppermann
c28427d8da
Pass parsed dataflow descriptor instead of path
We still need to pass the path through a new `working_dir` field as we haven't figured out deployment of compiled nodes/operators yet.
2 years ago
Philipp Oppermann
aac5e6515a
Integrate `dora-runtime` into `dora-daemon`
Removes the separate `dora-runtime` binary. The runtime can now be started by passing `--run-dora-runtime` to `dora-daemon`. This change makes setup and deployment easier since it removes one executable that needs to be copied across machines.
2 years ago
Philipp Oppermann
72a57ce1ef
Remove deprecated `communication` options from dataflow examples, templates, and docs
2 years ago
Philipp Oppermann
5068e14fb1
Improve error message when failing to connect to coordinator
2 years ago
Philipp Oppermann
d3e380a80f
Don't print file location on errors in dora CLI
This information is not relevant to users and might confuse them.
2 years ago
Philipp Oppermann
f0b10261a4
Remove special-casing of dora list again
We now exit with an error exit code again when no coordinator is running.
2 years ago
Philipp Oppermann
0679b1cc3c
CLI: Improve error messages when coordinator is not running
2 years ago
Philipp Oppermann
7b8de70f88
Set deploy defaults when resolving aliases
Ensures that we set them also when using the daemon's `run_dataflow` function for examples.
2 years ago
haixuanTao
c2071e7539
Fix clippy and remove unwanted `.unwrap`
2 years ago
haixuanTao
fb694dfcc4
Add `dora-cli` name for tracing
2 years ago
haixuanTao
2f6eb3833f
Address PR comments by removing unsued event, removing reloading todos, and removing `info!` on `cli` querying of `coordinator`
2 years ago
haixuanTao
edf59d5318
Fix CI issue with not retrieving UUID
2 years ago
haixuanTao
8f05ec79a1
Add attach logic and hot-reloading logic to the cli
2 years ago
haixuanTao
2b1ae1ad93
Add `runtime_path` arg into descriptor check
typography
2 years ago
haixuanTao
a15cf4a64d
add `is_valid` method to make validation optional
2 years ago
haixuanTao
704d8db565
Use validation logic on every yaml description to avoid undefined behaviour
2 years ago
haixuanTao
db92865c3f
Remove duplicated `read_descriptor` function
2 years ago
Philipp Oppermann
7f3041ed6c
Allow configuring queue size per input
2 years ago
Haixuan Xavier Tao
18d2c558c0
Merge pull request #211 from dora-rs/add-rust-api-info
Make `dora-rs` publishable on `crates.io`
2 years ago
haixuanTao
8e58396213
remove header file from template
2 years ago
haixuanTao
ad2d08dc97
Copy c header file in template to avoid copying it from outside of
the src code.
This is link to a release issue. See: https://users.rust-lang.org/t/include-str-does-not-work-when-releasing-because-of-changed-pathes/15551
testing new release version
2 years ago
haixuanTao
7a7a20a298
Add missing licenses and centralise license definition
test new crates version release
2 years ago
haixuanTao
101ddd2092
add documentation and description to all crates
test rc 2 version
fix version typo
Test crates.io new dora tag release
2 years ago
haixuanTao
f5b65d6de7
Remove unused dependencies to simplify publishing
Remove unused dependencies
2 years ago
haixuanTao
4c137f8505
Add documentation to the cli within the helper mode.
This commit add documentation to the cli. The cli will now show the
following documentation when prompted without arguments:
```bash
(dora3.10) ~/D/C/dora ❯❯❯ dora-cli (dora3.10) cli-documentation ✭ ✱
dora-rs cli client
Usage: dora-cli <COMMAND>
Commands:
check Check if the coordinator and the daemon is running
graph Generate a visualization of the given graph using mermaid.js. Use --open to open browser
build Run build commands provided in the given dataflow
new Generate a new project, node or operator. Choose the language between Rust, Python, C or C++
up Spawn a coordinator and a daemon
destroy Destroy running coordinator and daemon. If some dataflows are still running, they will be stopped first
start Start the given dataflow path. Attach a name to the running dataflow by using --name
stop Stop the given dataflow UUID. If no id is provided, you will be able to choose between the running dataflows
list List running dataflows
help Print this message or the help of the given subcommand(s)
Options:
-h, --help Print help information
-V, --version Print version information
```
2 years ago
Philipp Oppermann
f2fb2ffab6
Merge pull request #210 from dora-rs/remove-workspace-path
Clean up: Remove workspace path
2 years ago
Philipp Oppermann
7ede910fad
Add an internal cli argument to create template with path dependencies
2 years ago
haixuanTao
f1cf0864a4
Remove static path from workspace dependency
Removing those path make it easier to move package, reduce path management
reduce complexity and make it easier to export crates to `crates.io`
2 years ago